geotrellis-chatta-demo icon indicating copy to clipboard operation
geotrellis-chatta-demo copied to clipboard

Move TIFs in repository to S3 or LFS

Open hectcastro opened this issue 7 years ago • 5 comments

There are currently over 100MB of TIFs included in the repository. We should move them to S3 and download them as part of the development environment setup, or migrate them to Git LFS.

hectcastro avatar Jun 30 '17 15:06 hectcastro

Git LFS should be fine, i tested it but decided not to merge as it would require to delete tiffs from all commits :\

P.S. there is an issue for GT repo too: https://github.com/locationtech/geotrellis/issues/2074

pomadchin avatar Jun 30 '17 15:06 pomadchin

A rough constraint with LFS is that GitHub limits bandwidth consumption at the organization level to 1GB. This project alone has 100-200MB of TIFs. A few repository clones or CI builds will run through the 1GB organizational limit really quick.

hectcastro avatar Jul 01 '17 16:07 hectcastro

Such a limit :\ I think than we know the answer.

pomadchin avatar Jul 02 '17 09:07 pomadchin

Does this mean the only viable option is to move them to S3?

rossbernet avatar Jul 06 '17 14:07 rossbernet

I believe so.

hectcastro avatar Jul 06 '17 19:07 hectcastro