DSGT-DLP
Upload File View
Describe the solution you'd like Create view just like dashboard to showcase user uploaded files to S3. We want to propagate the S3 URL of the file the user wants to train to the backend instead of having to store the file in the form of a json string. The current approach won't scale well to larger files.
Basic steps:
- Wrapper to upload file to S3 via presigned URL (@dwu359 has this endpoint working)
- Identifying files user uploaded in S3 (set Time to live for S3 objects to X number of days)
- Dashboard view or a "popup" for user to drag the files they want
- Upload icon to have a "dropdown" for user to select what file they want to use for training
- Changes on backend pipeline to be made
Setup Instructions (what branch to work off of) Run the following commands
git checkout dev
git pull origin dev
git checkout -b upload-dashboard
FYI: If you are not able to immediately run git checkout dev, make sure you commit your changes in the current branch or run git stash and then execute the above commands
I was thinking of having the file uploaded to be tied to the train space. For example, when the train space is deleted, all file uploads, result files, & other data related to the train space is also deleted.
So instead of having an entire file view like a dropbox solution, we could instead have an extra column in the datagrid displaying all of the files names for each train space
And then in the 1st step for training, we can add an upload existing dropbox-like file view there to select already uploaded files from other train spaces
A file view in the dashboard can work, but I feel like users make not know right away that they need to go the file view to upload files there for training.