movement icon indicating copy to clipboard operation
movement copied to clipboard

Add support for downloading publicly available datasets #340

Open demoncoder-crypto opened this issue 8 months ago • 9 comments

The implementation includes: A new public_data.py module with functions to list, get info about, and fetch datasets Proper input validation and local caching in ~/.movement/public_data Comprehensive unit tests verifying all functionality An example file demonstrating typical usage patterns Documentation explaining available datasets, parameters, and citations

demoncoder-crypto avatar Mar 26 '25 07:03 demoncoder-crypto

Thanks for attempting to tackle this @demoncoder-crypto. We are experiencing a high volume of PRs at the moment, but we will get to reviewing this eventually.

Could you deal with the pre-commit and linting failures in the meantime? You can do pre-commit install (needed only once), followed by pre-commit run -a in your development environment.

After that the checks should automatically apply to all commits you attempt.

niksirbi avatar Mar 26 '25 11:03 niksirbi

Thanks @niksirbi for comments, I tried to fix pre-commit issues. Please let me know if they are up to expectation. thanks

demoncoder-crypto avatar Mar 27 '25 04:03 demoncoder-crypto

Downloading file 'videos/rotating-mouse_eye-tracking_stim-uniform_video.mp4' from 'https://gin.g-node.org/neuroinformatics/movement-test-data/raw/master/videos/rotating-mouse_eye-tracking_stim-uniform_video.mp4' to 'C:\Users\Freiz.movement\data'. The package gets stopped here and nothing happens then when i try sphinx build C:\Users\Freiz\AppData\Roaming\Python\Python311\Scripts\sphinx-build.exe -b html source build Is there a way to fix this?

demoncoder-crypto avatar Mar 27 '25 16:03 demoncoder-crypto

Thanks @lochhh I will work on these issues by tomorrow, I am really grateful for such detailed response.

demoncoder-crypto avatar Apr 04 '25 17:04 demoncoder-crypto

@lochhh @niksirbi I have tried to fix the errors, do let me know if they are up to expectation

demoncoder-crypto avatar Apr 05 '25 11:04 demoncoder-crypto

Thanks @demoncoder-crypto for the changes. As you can see the CI checks are still failing and the key implementations (places marked with "placeholder implementation", for instance in movement/public_data.py and movement/examples/public_datasets.py) are still missing. There are also merge conflicts with the main branch which need resolving.

lochhh avatar Apr 30 '25 09:04 lochhh

Thanks @lochhh I will fix them soon.

demoncoder-crypto avatar Apr 30 '25 09:04 demoncoder-crypto

Converting this PR to draft as it's still missing the key implementations for downloading public datasets.

lochhh avatar Jul 03 '25 10:07 lochhh