If you're using XP themes, that seems to somehow cause this problem sometimes. Try disabling them or using VWMHideTasksOnSwitch.

If you're not using XP themes then I don't know...