Provide schemas locally?

Open sdruskat opened this issue 3 years ago • 3 comments

Currently, schemas for CodeMeta and CFF are being downloaded through each run.

It'd be good to avoid this for performance reasons, options are:

Retrieve schemas and cache locally
Provide offline versions of the schemas
Leave as is

Jan 13 '23 17:01 sdruskat

This is also a problem within the prepare step of deposit, when the requirement schema are being downloaden again and again. (We just added a TODO about this in #105)

It might be good to have a caching mechanism in place that is aware of versions and has configurable expiration times, so caches get invalidated at some point.

Instead of creating all of this on our own: is there a good cache implementation for Python avail?

Also, there needs to be a decision about caching within CI. We can include this limited to this kind of materials in our templates, but it would be good to have a single directory for it to keep the setup simpler.

Jan 13 '23 17:01 poikilotherm