metaflow
metaflow copied to clipboard
Netflix
:rocket: Build and manage real-life ML, AI, and data science projects with ease!
One of our users seemed to have a incorrect file lock. There was no indication of a problem, Output was "Bootstrapping conda environment" and then it would hang. eventually user...
This PR adds support for GCS as a datastore using the GCS Python client (no optimizations on top of the vanilla client). All of the patterns adopted here were taken...
Pull request for adding the functionality of branching of tasks based on a condition. The following changes are made - 1. With the already existing implementation, a join operation is...
Pull request for an initial implementation of streamlined API's for Amazon Sagemaker. Includes 3 functions: "fit", "deploy", and "predict". The primary algorithms this was built around were [XGBoost](https://docs.aws.amazon.com/sagemaker/latest/dg/xgboost.html) and [Linear...
Same as with the namespace, allow to set the target kubernetes context rather than using the current active context.
Hi, I was wondering if it's possible to run a flow from anything other than a script: e.g. ```python from flow import ParameterFlow ParameterFlow() ``` I'm currently getting the following...
When `metaflow.S3` is used as a context manager and raises `MetaflowS3NotFound`, the `close` method [attempts to remove the temporary directory](https://github.com/Netflix/metaflow/blob/master/metaflow/datatools/s3.py#L359). When this occurs on an NFS mounted filesystem, a `.nfs*`...
We have a reverse proxy in front of the Metaflow service implementing JWT based authentication. To pass the token, we're currently doing this: ```bash export METAFLOW_SERVICE_HEADERS="{\"Authorization\": \"Bearer $METAFLOW_TOKEN\"}" ``` The...
Hi there, thanks again for the great work on Metaflow :-) **Context** - We have a couple of flows, with say 10 steps each. We have a use case where,...
In some environments like AWS Cloud9 or `aws-vault`, there's a background process that updates AWS credentials at ~/.aws/credentials (or env vars) periodically. Currently, Metaflow/`boto` don't refresh these credentials, leading to...
