is this a standard xp driver or did you install it after doing an update?

if its an update then you can roll back to before you installed the updates and then when you go to download them on the microsoft website click on "custom install" and go through the updates and see if you can find the driver, once you've deselected it it will never try and download it again.

but i am sure theres a way of uninstalling the driver through device manager??