earth2studio
earth2studio copied to clipboard
🚀[FEA]: Improve caching experience
Is this a new feature, an improvement, or a change to existing functionality?
New Feature
How would you describe the priority of this feature request
Critical (currently preventing usage)
Please provide a clear description of problem you would like to solve.
Presently the model cache works fine, it operates in the .cache folder.
However all files are stored there, and because of this the file names are hashed to prevent conflicts. This makes it hard to know what file is what and in some cases, like onnx checkpoints w/ separate weight files, can break things.
I think this can be improved by:
- Make name hashing optional, this is allowed in Fsspec and should be an option here
- Make models default cache location its own subfolder
- Models do not hash file names by default since we control the location, we can safely avoid conflicts