This used to happen to me as well. Try using "VWMNoSwitchOnFocus". This will prevent automatic switching when a window on a different desktop is focused. The downside is that Alt+Tabbing to such a window will not automatically change desktops for you.