flytekit icon indicating copy to clipboard operation
flytekit copied to clipboard

Published 20 hours ago • verified publisher icon flyteorg

Improve pyflyte register

Open kumare3 opened this issue 1 year ago • 0 comments

TL;DR

this PR improves the code behind pyflyte register accomplishing,

  • faster performance
  • better visualization
  • simplified logic with a clean flow
  • all programmatic APIs, to invoke programmatically

Type

  • [ ] Bug Fix
  • [x] Feature
  • [ ] Plugin

Are all requirements met?

  • [x] Code completed
  • [x] Smoke tested
  • [x] Unit tests added
  • [x] Code documentation added
  • [x] Any pending items have an associated Issue

Complete description

pyflyte register used legacy methods and some techniques that are not required if you are within the python VM. For example, since we have SerializationSettings, it is not necessary to re-hydrate the objects simply to replace the identifiers. Moreover, the logic is further simplified and it is possible to perform repo level registration using a simple api and/or through flyteremote.

TODO: UnionML can now use this lower level api

kumare3 avatar Oct 14 '22 05:10 kumare3