LVM
LVM copied to clipboard
Consider hosting the models and datasets in GitHub directly using XetData add-on
Hey there! I work at XetHub and we built a GitHub app that scales GitHub repos to handle large files (upto 100 TB). No cost for public repos.
Here's an example where we hosted a bunch of .onxx model files in the Git repo: https://github.com/onnx/models/issues/632#issue-2007245752
This way, your local folder doesn't need a .gitignore file and the GitHub state matches your local state since you can just keep your large files in the same folder. I'd be happy to coordinate and make this happen
Thank you for the tips!