metaflow
metaflow copied to clipboard
Netflix
:rocket: Build and manage real-life ML, AI, and data science projects with ease!
It is currently a little difficult to navigate the various tasks in a foreach and users may want to answer questions like: - what is the variable over which I...
[From Darshan Patel](https://outerboundsco.slack.com/archives/C02116BBNTU/p1644298359534659) on [Metaflow Slack](slack.outerbounds.co) - hey team, I'm getting an error while running a flow on AWS Batch. Metaflow is able to create a batch job definition and...
It would be nice to have this when you are not using Conda, the purpose being to track the plain deps as part of the Flow.
Metaflow currently supports Py>=3.4 (with limited support for Py2.7) and R>=3.8. The GH tests only test for Py3.7 and R4.1. We should ensure we test on the whole set of...
Hi there, first of all, thank you for the great work on metaflow! We're using metaflow and we've encountered the following error: ``` [5f9e2b9f-a7fe-416d-8471-cdd6f265bd2b] File "/app/metaflow/metaflow/datastore/datastore.py", line 455, in [5f9e2b9f-a7fe-416d-8471-cdd6f265bd2b]...
A system administrator may want to disable an option, e.g. `--max-workers` to enforce a system-wide setting. We could provide a way to disable selected options, or override any settings globally....
The [Terraform Deployment](https://admin-docs.metaflow.org/metaflow-on-aws/deployment-guide/terraform-deployment) section of the published deployment guide links to an [outdated README](https://github.com/Netflix/metaflow-tools/blob/master/aws/terraform/README.md). The `Netflix/metaflow-tools` repo has been archived in favor of `outerbounds/metaflow-tools` and its version of the [relevant...
Metaflow tries to make the life of data scientists easier; this sometimes means providing ways to optimize certain common but expensive operations. Processing large dataframes in memory can be difficult...
Adding code that tries to resolve this issue #683 Looking forward for any kind of feedback as this is my first contribution to Metaflow
Pasting the README from [runsascoded/mf-pip-issue](https://github.com/runsascoded/mf-pip-issue), where I have some repro files as well: # Metaflow/`pip`/Batch issue Metaflow runs `pip install awscli … boto3` [while setting up task environements in Batch](https://github.com/Netflix/metaflow/blob/2.4.8/metaflow/metaflow_environment.py#L85),...
