My guild is discussing this very subject; What to do about inactive members?
Having a roster full of inactive people is definitely not a good selling point. I think that's worse than having a small number of people in the guild who are active.
One of the issues we're facing is that we're a multi-gaming group and many of the folks on the GW roster are active in other games & activities. So, it's a wonderful piece of fun to work out. When should someone be dropped for inactivity? 2 months? 3? (we're leaning towards 3)
Then there's the issue of whether to let them back in if they become active again? My guild is pretty close knit and has been around for years, so many of the guys have been around since before GW - they'd be welcome back with open arms. For the inactive guys we've picked up recently, it would depend on how involved they got with the guild outisde the game, as well (forums, etc.)
If we do take this course of action, we'll announce it ahead of time and give everyone the opportunity to log in and that all they'd have to do in the future to avoid this would be to log in once in a while

. We will also make it perfectly clear that the only reason that they are being dropped is for inactivity and if they become active again, they're more than welcome to re-apply for membership.
Maybe you should get with your Leader & other officers (the active ones) to sort it out.