I did my pollen filter yesterday. It took 5 minutes or so to take the necessary bits off to access the filter (all straight forward but stupidly unecessary by design IMO), and then one and HALF HOURS trying to put it all back together!! Why? 2 reasons:
First, because of the air conditioner feed pipe into the glove box that needs to be reconnected was a b4st@rd and simply couldnt be done until my missus came home giving me a second pair of hands (she pushed from inside the glovebox whilst I pushed from the outside.
Second, even removing the fusebox (and bracket) and dropping it down, it still leaves the wiring loom attached to it which sits there like a cruise liner mooring rope! Thick, unflexable and difficult to move or work round. It simply got in the way of sliding out and in the filter into the hole.
So my recommendation is NOT to remove the glovebox at all especially if you have this aircon pipe attached - I dont think removing it is that necessary as the work can still be done from underneath with it in place. (If you dont have this pipe connected then yes, go for it. The resultant space will help a little by giving extra light if nothing else).