onepanel icon indicating copy to clipboard operation
onepanel copied to clipboard

Files larger than 10 mb do not have a download option (Workflows)

Open absolution747 opened this issue 4 years ago • 5 comments

Is your feature request related to a problem? Please describe. File that are larger than 10 mb do not download from the Outputs Artifacts in workflows

Describe the solution you'd like Files of trained models often exceed 10 mb. One panel with its intutive user interface is a great means to quickly train models on the cloud. Having the ability to dowload files of all sizes via the UI would be a great plus in terms of utility.

Describe alternatives you've considered So far it has been suggested to download the file directly from the object storage in such situation for the current build.

absolution747 avatar Jan 27 '21 09:01 absolution747

Any progress on this? It is quite a frustrating bug

dk-data avatar Jul 28 '21 10:07 dk-data

Hey @dk-data,

We've upgraded it for workspace files, but are still working on it for artifact storage files. The issue is exposing the minio-gateway while keeping the other services private.

I'm going to be testing a work-around this week and testing it for different providers. I'll post updates here.

Vafilor avatar Jul 28 '21 16:07 Vafilor

Update

The work-around looks to be working for Azure/Gke.

Now need to

  • [x] Test with S3 (make sure nothing incompatible came in)
  • [x] Update CLI
  • [x] Test UI

Vafilor avatar Jul 30 '21 00:07 Vafilor

Hey @dk-data,

Just wanted to let you know this is in the final testing stages. You can check it out in https://github.com/onepanelio/onepanel/releases/tag/v1.0.0-rc.2 if you like.

There's still a few more things we want to get into v1 before we do an official release, but the file stuff should be good.

Vafilor avatar Aug 04 '21 23:08 Vafilor

Hi @Vafilor - sorry for late reply. Appreciate you putting in the workaround for this, looks good on my end.

dk-data avatar Aug 06 '21 14:08 dk-data