CodaLab deployment with MinIO

[Didayolo]

@loicsarrazin @dtuantran

We have already observed that we usually have issues when installing CodaLab using MinIO for the storage.

Example issues:

• #2843
• #2787
• #2960

What is the fix for this? Should we update the documentation? Is this working using the Python3 version (currently the lri-python3-storage branch)?

[loicsarrazin]

as @yobibytes mentionned in #2787, they had to modify some of the package's code that is out of this project. The main issue here in my understanding is that the boto version compatible with the python 2 version of the app is not compatible with minio and a local configuration (using self-signed certificates).

Here are some actions that we could take:

• Evaluate if it's possible to install locally version 1.5 that uses up-to-date libraries and that, I believe, have those additional env vars.
• Document the modifications mentionned by @yobibytes so that people using legacy code can still patch their local versions., and commit changes that are within the scope of our code

[Didayolo]

Here are some actions that we could take

If the packages are not conflicting in the Python3 version, then we should just considered the problem solved and wait until the Python3 version is the main branches of the repo.

[loicsarrazin]

The wiki was updated for the non-ssl local setup : https://github.com/codalab/codalab-competitions/wiki/Minio-storage
I will be updating the ssl part later next week.

[Didayolo]

Great news!

I think we can let this issue open and close it once you've updated the wiki.

[Didayolo]

Issue to keep in mind: #3054

[Didayolo]

@dtuantran

Unfortunately Loic left and this is still an open issue.

For local setup I guess SSL is not mandatory.

Do you think there is still a subject here or do we close this ticket?