Clean Up Dependencies

[jasonlyik]

pyproject.toml has a number of dependencies listed which don't seem to be used, we can take them off of the list so that the package installation is cleaner.