metaflow
metaflow copied to clipboard
:rocket: Build and manage real-life ML, AI, and data science projects with ease!
refactors MetaflowEnvironment init and changes one getter into an instance variable
[Context](https://outerbounds-community.slack.com/archives/C020U025QJK/p1628794165053700?thread_ts=1628793030.050900&cid=C020U025QJK) in http://slack.outerbounds.co
The integration with Airflow is quite interesting. I think it would be great to support Dagster as well, as they are becoming a good/modern and data/ML-oriented alternative to Airflow. [Airflow's...
Hi there I have an idea and some lines of code, which I would like to propose/discuss with you @saikonen ### Identified shortcoming At the moment `metaflow` can not be...
This PR is intended to address #355 and is an alternative approach to the one implemented in #1260. It is not finished and should serve as a discussion point. A...
Both `@kubernetes` and `@batch` have attributes that can't be set via `@resources` (e.g. `tmpfs`). To set these attributes, you need to use the decorator, but using the decorator forces the...
I'm currently working on updating my Metaflow infrastructure, and I have been considering transitioning the ECS Fargate services from a public network to a private network as part of this...
Reference to Issue https://github.com/Netflix/metaflow/issues/1010 * Added support to delete one object using s3 client * Added support to delete multiple objects. * Added support to delete objects recursively.
I'm working on a HPC cluster with an on-premise integration of an S3 service (scality) We have a lot of ressources availables and very particular network configuration (Our S3 server...