S3 bucket synchronization

[nashugame]

Facing an issue with synchronisation of uploaded data done via CLI/application with S3 interface of the Onyxia. Data is uploaded on S3, is accessible through CLI/application but is not viewable from my-files interface of the Onyxia.

[fcomte]

can you send us the error message when you browse file from onyxia-web ? There is no synchronisation.. Onyxia-web just send S3 request to data storage so you should be able to see what's going wrong in network exchange

[nashugame]

There is no error as such. It's just that If I upload something on S3 bucket via program/CLI, the same content is not reflected on my-files UI interface of Onyxia. Though the content is there in S3 if I try to access it using program/CLI.

[garronej]

Hi @nashugame,

The web UI dosen't suscribe to S3 events yet.
Right now you have to hit the refresh button to see the changes.

[nashugame]

Hello @garronej , I had already tried the refresh button to see the changes, but it's not working. It's working only for the data uploaded via Onyxia UI not for the one done via CLI/program.

[garronej]

Is that so? And is you refresh the page?

[nashugame]

Yup, tried both refresh button as well as refreshing the webpage

[fcomte]

maybe a problem related to the other bug... maybe we doesn't not use region information in the web browser

[fcomte]

can you send us the S3 response to the OnyxiaWeb call to Amazon S3 service ? (the request who list the bucket)

[nashugame]

[fcomte]

how did you upload this file ? with UI ... do you see it inside a jupyter or vscode ?

[nashugame]

Yup, uploaded using UI. Able to access the uploaded stuff inside jupyter/vscode using CLI but not the vice-versa.

[fcomte]

this is so strange .. I have no idea at the moment