It's the nature of the game. In my guild it's hard to get a group going for anything other than 40 man stuff (at which point everyone goes freaking nuts trying to get in). Hopefully post-BC that won't be an issue. :p
With the cap being lowered to 25 man for raids, wouldn't it just get worse?