Tasks modules typically don't know the concept of "virtual desktops". Instead, look for a setting in your VWM module. VWMHideTasksOnSwitch or something like that. Not all VWMs support it though.