metaflow

metaflow copied to clipboard

TypeError: rename: src should be string, bytes or os.PathLike, not NoneType

3

While creating triggering flow using AWS Step Functions, on **irregular** basis I got this error: ```TypeError: rename: src should be string, bytes or os.PathLike, not NoneType``` I'm using python=3.9 and...

Sypek

Metaflow crashes on AWS Batch if folder called `metaflow` is present in the working directory

5

I have created the stack using the [MetaFlow CloudFormation template](https://github.com/Netflix/metaflow-tools/blob/master/aws/cloudformation/metaflow-cfn-template.yml). I can run flows locally, but flows fail if I add the `@batch` decorator. For example, this flow Code ```python...

shchur

There is a race between Metaflow detecting that a pod failed execution and the reason for pod failure being set on the pod. As a result, at times, the failure...

shrinandj

Support GCP-auth for private PyPi repositories

1

Quoting [a Slack discussion](https://outerbounds-community.slack.com/archives/C02116BBNTU/p1702840561962419): >Hello all, we are running a docker container for our dev environment. I am able to use the container shell and use pip to install packages...

tuulos

feature: custom annotations revisited

3

reintroduces the feature first merged in #1442 which had to be reverted in #1516 due to a regression that broke annotations for recording user and project info. This feature keeps...

saikonen

IDEs (e.g. PyCharm) don't recognize Metaflow decorators

4

Metaflow decorators are imported at the runtime, so IDEs can't find them based on static analysis. We could find a way to make the setup more IDE-friendly. Context: https://gitter.im/metaflow_org/community?at=5f8e151898a7774f1b53afc6

tuulos

Add a `@local` decorator

1

Currently you can use `@batch` to decorate single steps that you want to force to run on batch even without using `--with batch`. However, you cannot do the opposite and...

romain-intel

introduce ability to add new Azure credential providers through Metaflow extensions

saikonen

Expose more accurate task / run lifecycle via Client API

1

Today, you can use [the Client API](https://docs.metaflow.org/metaflow/client) to see whether a task/run has completed successfully (including caught exceptions) through `.finished` and `.successful` attributes. Through the current API, you are not...

tuulos

How to remove old artifacts?

1

I have a question. If you run python metaflow flow periodically, it keeps piling up in artifacts, but I want to manage it, but I don't know how I want...

sungreong