Manually Uninstall Device Drivers

Hi. Looked around, but couldn't find an answer to the
following question:

I recently installed some "bad" drivers in XP Pro for a
game control device (Playstation game controller to USB
adapter). Turns out I didn't need to install the drivers
at all as XP Pro can handle it with its own drivers, but
I'm left wondering if recent problems getting XP to
recognize my gaming device have something to do with these
bad drivers.

I can't see the drivers being installed anywhere on the
computer, but is there any way I can make sure they did
any damage and delete their influence permanently? I
thought maybe I could search the registry for the names of
the .dll and .inf file, but I don't want to do anything in
regedit without a good amount of research. All I've done
so far is to delete all of the bad .inf and .dll files.

Thanks for the help.