flytekit
flytekit copied to clipboard
Improve pyflyte register
TL;DR
this PR improves the code behind pyflyte register accomplishing,
- faster performance
- better visualization
- simplified logic with a clean flow
- all programmatic APIs, to invoke programmatically
Type
- [ ] Bug Fix
- [x] Feature
- [ ] Plugin
Are all requirements met?
- [x] Code completed
- [x] Smoke tested
- [x] Unit tests added
- [x] Code documentation added
- [x] Any pending items have an associated Issue
Complete description
pyflyte register used legacy methods and some techniques that are not required if you are within the python VM. For example, since we have SerializationSettings, it is not necessary to re-hydrate the objects simply to replace the identifiers. Moreover, the logic is further simplified and it is possible to perform repo level registration using a simple api and/or through flyteremote.
TODO: UnionML can now use this lower level api