Instead of using setup.py you should use pip install.
You need to remove all the files manually and then undo any changes done during the installation manually.
To record a list of installed files, you can use:
python setup.py install --record files.txt