Fully automated release

[msaroufim]

🚀 The feature

We're close to fully automated releases with our new nightly build setup by leveraging nightly builds. The remaining gaps are

• [x] #1620
• [ ] A process to eyeball metrics from our benchmark scripts and notify us of any issues @lxning
• [ ] A script release.py --date 20220601 --version 0.6.2 which would take care of uploading all binaries in one go

Motivation, pitch

With past work on Github Actions we've made it possible to make nightly releases in one day vs a week. If we do this work in addition we can start doing official releases in a few mins

Alternatives

No response

Additional context

No response