openneuro
openneuro copied to clipboard
Validator cannot fetch content on s3-PUBLIC while the dataset remains private
What went wrong?
Datasets with snapshots created have their data exported to S3 but left inaccessible without presigned URLs. The annexed files are then dropped from the server, with the idea that the validator can fetch S3 remote data. The validator does not know how to generate pre-signed URLs or use AWS credentials to fetch the data, resulting in large numbers of NIFTI_HEADER_UNREADABLE errors.
Expected behavior
Validation should not depend on the presence of local data, if it is available on s3-PUBLIC
How to reproduce
No response
Desktop
- OS:
- Browser:
- Version:
Phone
- Device:
- OS:
- Browser:
- Version:
Additional information
No response