ACT icon indicating copy to clipboard operation
ACT copied to clipboard

Exclude Test Data from Packaging

Open mgrover1 opened this issue 3 years ago • 1 comments

As was raised in #468 , it would be good to exclude the data files from packaging, which would cut down the space by ~68 mb. If users are interested in using it, they can clone the repo, and access it from there.

mgrover1 avatar May 27 '22 19:05 mgrover1

Can ARM provide storage directory for our data that we can pull for testing?

kenkehoe avatar Jun 06 '22 17:06 kenkehoe

For this, we'll have to see how the ADC folks can store this. Py-ART stores it at a webpage, which then can be downloaded using pooch. @mgrover1 Have you spoke to at all to Giri with regards to this before I reach out?

zssherman avatar Feb 15 '23 15:02 zssherman

If we have the location, I can always change the code over.

zssherman avatar Feb 15 '23 15:02 zssherman

We can move ahead with this!

mgrover1 avatar Feb 15 '23 15:02 mgrover1

@mgrover1 Where is the data going to be stored? Trying to think of how or where to pull it from

zssherman avatar Feb 15 '23 16:02 zssherman

ARM is going through some FTP security changes. I wonder if we had a second GitHub repo of just data files we could avoid any future problems? Also, would be self contained all in GitHub vs. spread across different entities.

kenkehoe avatar Feb 15 '23 16:02 kenkehoe

@mgrover1 made good progress on getting the repo up for the data. I added the rest of the test files in a PR to the repo, once that's done and v2 goes through (so there isn't conflicts and overlap) I can change the testing calls to use the arm_data repo for the testing.

zssherman avatar Nov 08 '23 21:11 zssherman

@zssherman @AdamTheisen - I cut the first release(s) of arm-test-data, and it is installable via pypi! Waiting on feedback on the conda-forge recipe, but that should be good to go by tomrrow.

mgrover1 avatar Nov 09 '23 22:11 mgrover1

@mgrover1 Awesome sounds good!

zssherman avatar Nov 09 '23 22:11 zssherman