elephant icon indicating copy to clipboard operation
elephant copied to clipboard

[ENH] add caching action for elephant-data

Open Moritz-Alexander-Kern opened this issue 10 months ago • 1 comments

This PR adds a GitHub Actions runner for caching data from the Gin Elephant data repository and enabling local data usage for validation tests with the elephant.datasets module. This reduces the time required for data retrieval from gin, overall reducing the runtime of the GitHub Actions runners.

GitHub Actions Runner: Added a new GitHub Actions runner to cache data from the Gin Elephant data repository. Caching action is configured to execute as a cron job on a daily basis. This automated process ensures that data caches remains up-to-date.

Local Data Usage for Validation Tests: The elephant.datasets module has been modified to use local data for validation tests. Additionally validation tests across various modules have been adapted to accommodate the option of using either local data or retrieving data from the Gin Elephant repository. The path to local data can be provided by setting the environment variable ELEPHANT_DATA_LOCATION.

Changes to CI Current CI runners have been adapted to retrieve the cached elephant-data.

Moritz-Alexander-Kern avatar Apr 18 '24 13:04 Moritz-Alexander-Kern

Coverage Status

coverage: 88.401% (+0.05%) from 88.35% when pulling f6e63537f7f5d669bc392eb3657c3d498534033c on INM-6:enh/add_caching_action into 0984e19769b6bbe5d8495024949167a8a565c93f on NeuralEnsemble:master.

coveralls avatar Apr 18 '24 14:04 coveralls

Hello @Moritz-Alexander-Kern! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! :beers:

Comment last updated at 2024-04-26 12:29:37 UTC

pep8speaks avatar Apr 19 '24 14:04 pep8speaks