metaflow
metaflow copied to clipboard
Netflix
:rocket: Build and manage real-life ML, AI, and data science projects with ease!
The metaflow batch CLI supports `list` and `kill` for identifying running jobs on a flow and killing them if needed. This is useful if you get disconnected from the terminal...
If a flow has the `@trigger_on_finish` decorator, you can locally test it being triggered by an already completed flow. We do this by passing a `--trigger` option to the `run`...
Fixes https://github.com/Netflix/metaflow/issues/1627. Adds: 1. `BATCH_DEFAULT_TAGS` to metaflow config - a map of default AWS tags to apply to batch jobs 2. `tags` kwarg to the AWS batch decorator - a...
We have some cost allocation tags we'd like to add which are not tied to a given user. As such, we'd like to be able to tag and then allocate...
- I am trying to run a metaflow flow on a Kubernetes cluster (specifically a `kind` cluster that is running on my laptop). - AWS creds are provisioned inside the...
Hi, I'm currently exploring Metaflow, specifically its functionality related to [Triggering Flows Based on External Events](https://docs.metaflow.org/production/event-triggering/external-events), and I'm curious about its applicability to the following use case: Assume I have...
Made a new implementation for the naming convention of the sensor objects with a hash, to ensure all instances fit within th 63 character limit as issue #1591 outlined that...
Over the years, we have received a number of sporadic reports of `@batch` jobs failing without anything on the Metaflow console but CloudWatch containing messages like: ``` | 2023-05-03T13:58:18.077-07:00 |...
from https://outerbounds-community.slack.com/archives/C02116BBNTU/p1675778656523159 via chat.metaflow.org
first draft for fixing argo workflows workflow name maxLength. Previously 253 characters have been allowed, but this causes launching workflows through Argo UI to fail for names longer than 63...
