Just deleting registered DLL's is a messy thing. I suggest using the uninstaller that came with the plug-in, or use the Add/Remove Programs control panel.
You can either re-install the plug-in, and then uninstall it, or find the registry entries that point to where it used to be and delete them (risky if you're not a regedit hack).