It's your quicklaunch folder...change the shortcuts you have in it.

edit - And so there's no confusion, it's located at:

%SystemDrive%\Documents and Settings\%username%\Application Data\Microsoft\Internet Explorer\Quick Launch