I just levered the bugger off with a screwdriver; end of problem. I deep-sixed the caplock key, too. I've never missed the damn things, either. I still have a Windows key on the right-hand side.
In my case it's especially annoying because if I hit the windows key in IL-2 I lose my force-feedback and I have to re-start the game.
Here's a good tip I discovered, though: If you accidentally hit the windows key and you realise before you let it go, simply press and hold another less critical key, then rlease the Windows key; disaster averted!
_________________________
Check out
HardBall's Aircraft Viewer. "This is an invaluable asset for all IL-2 aficionados", PC Pilot Magazine, May 2006.