flyte
flyte copied to clipboard
[BUG] `uri` of the input with `Any` type of the workflow is incorrect when run remotely
Describe the bug
When running this workflow in remote Flyte deployment with commandpyflyte run --remote <file_name>.py wf1 --a 1
, the uri
of the input will be like /var/.....
. This will cause an error as the remote entity couldn't access the local file.
My python file:
from flytekit import task, workflow
from typing import Any
@task()
def t1(a: Any) -> int:
if type(a) == int:
return a + 1
return 0
@workflow()
def wf1(a: Any) -> int:
return t1(a=a)
Error Message:
FileNotFoundError: Failed to convert inputs of task '<file_name>.t1':
[Errno 2] No such file or directory: '/var/folders/bl/kvjgvw0n5dddmglqdwy4zmpw0000gn/T/flyte-dlkg2l19/raw/2c9421ed6fd50ff5693cd38840c39c48/57b865dff2967bb348047887fad8262c'
Expected behavior
Similar to FlyteFile, Flytekit should upload the data to s3 so that the data will be accessible to the workflow & task.
Image provided by @Future-Outlier
Additional context to reproduce
No response
Screenshots
Are you sure this issue hasn't been raised already?
- [X] Yes
Have you read the Code of Conduct?
- [X] Yes