Tasko Olevski

@Panaetius now mypy fails in a bunch of places. Not sure how it did not fail before.

In light of the findings from #3094 I propose that we close this and open new issues that will implement the required changes to make this happen. The POC does...

Plan: - setup a simple flask rpc server - this server can create/destroy statefulsets that contain cloned projects - a background thread in the server is making sure that old...

This can be done in several ways: - Add to the metadata store in the repo to indicate that a run is underway but that the commit should happen later...

After a few hours or googling it seems that s3 file uploads are very doable in the core service. Basically it would involve the following: - get the ui to...

@Panaetius I think that it should definitely handle parallel uploads. The core service will have to issue upload urls per-file (i.e. per s3 object). And I believe that chunked uploads...

This is one way we could achieve this: - create an operator that would handle two resources BlankCache and HydratedCache - BlankCache is an instance of the core service that...

Handling long running jobs becomes a bit more complicated but doable: - One way is to introduce another CRD for the operator called CacheJob (or something like that), this essentially...

My first step is to create a simple POC to see what kind of latency we get for the scenario of: - send a simple non-blocking read request - create...

Using the link from zenodo (i.e. https://zenodo.org/record/7995513) worked. But using the doi you can get from the zenodo website (https://doi.org/10.5281/zenodo.7995513) does not work.