Yeah, it's only a cover... But before messing with anything, I'd clean it well and try and find where any leak is coming from. Might not be the box.
I'd be tempted to pull it out and have a good look through everything. Worst thing about removing boxes is the the half shafts. Everything else is easy/straight forward.
Edit- just realised we're talking about the 6 spd box... The cover is different (magnesium not pressed steel) and holds two bearings in place. When you pull it off, you need to ensure you don't twist it diagonally- it needs to come straight off so the bearings don't get damaged. Easier when warmed up a bit. Also the most common place for a leak on vdub boxes is the output flange seals (next to the diff).