Fix deploy so that all matrix builds don't try and publish

[dogonthehorizon]

Only one matrix build will properly pass when releasing a new version of the library because they're all trying to deploy to PyPI.

Figure out how to publish from the latest version only (this may require going to generic builds)