Control Panel > Display > Desktop > Customize Desktop, and uncheck Internet Explorer.

(On XP anyways)