flyte icon indicating copy to clipboard operation
flyte copied to clipboard

[BUG] `uri` of the input with `Any` type of the workflow is incorrect when run remotely

Open Mecoli1219 opened this issue 1 month ago • 1 comments

Describe the bug

When running this workflow in remote Flyte deployment with commandpyflyte run --remote <file_name>.py wf1 --a 1, the uri of the input will be like /var/...... This will cause an error as the remote entity couldn't access the local file.

My python file:

from flytekit import task, workflow
from typing import Any

@task()
def t1(a: Any) -> int:
    if type(a) == int:
        return a + 1
    return 0

@workflow()
def wf1(a: Any) -> int:
    return t1(a=a)

Error Message:

FileNotFoundError: Failed to convert inputs of task '<file_name>.t1':
  [Errno 2] No such file or directory: '/var/folders/bl/kvjgvw0n5dddmglqdwy4zmpw0000gn/T/flyte-dlkg2l19/raw/2c9421ed6fd50ff5693cd38840c39c48/57b865dff2967bb348047887fad8262c'

Expected behavior

Similar to FlyteFile, Flytekit should upload the data to s3 so that the data will be accessible to the workflow & task.

image Image provided by @Future-Outlier

Additional context to reproduce

No response

Screenshots

image

Are you sure this issue hasn't been raised already?

  • [X] Yes

Have you read the Code of Conduct?

  • [X] Yes

Mecoli1219 avatar May 29 '24 08:05 Mecoli1219