metaflow
metaflow copied to clipboard
Netflix
:rocket: Build and manage real-life ML, AI, and data science projects with ease!
This PR adds two new features: ad-hoc user event support via the new `@emit_event` decorator and arbitrary JSON-encoded user event data. `@emit_event` allows users to emit ad-hoc events from within...
This cleaned up a few uses of the decospec where individual plugins were having to parse the decospec. Two other minor changes to improve error message and allow for echoing...
Metaflow allows certain pieces of kubernetes/argo workflows to be specified in flows via the `kubernetes` and `schedule` decorators and the `kubernetes` or `argo-workflows` flags. However, Argo workflows is a very...
We are using Argo Workflows extensively for all of our workflows. We are looking to rollout Metaflow, but there are several pieces of Argo functionality not currently supported by Metaflow....
…low` command Simply add a `cmd` directory in your extension and the usual __init__.py or mfextinit_*.py file containing a function called `get_cmd_clis` which returns a list of CLIs to add....
Current behavior: @conda_base generates a separate conda env directory for each (flow, dependencies) combo. Requested behavior: Metaflow should recycle conda envs if they are identical dependencies. Background: We are transitioning...
Spot GPU is low cost gpu provide by cloud provider https://aws.amazon.com/ec2/spot/pricing/
We add support for the `gs` datastore (to match the `gs://` URL scheme encouraged by Google Cloud Storage). The thread / process pool executor machinery implemented for Azure Blob Storage...
