You were correct that installing the drivers that came with the stick was a bad idea.
Not the end of the world, though. Just go to the device manager and uninstall the drivers.
You need to use a program called Zadig to install the correct one.
Go to RTLSDR.org and click on the Windows link under software for the instructions. There is an additional plugin that you will need to run the RTL with HDSDR, which I am not too familiar with. I switched to SDR# and haven't looked back.