openneuro icon indicating copy to clipboard operation
openneuro copied to clipboard

Validator cannot fetch content on s3-PUBLIC while the dataset remains private

Open effigies opened this issue 2 weeks ago • 2 comments

What went wrong?

Datasets with snapshots created have their data exported to S3 but left inaccessible without presigned URLs. The annexed files are then dropped from the server, with the idea that the validator can fetch S3 remote data. The validator does not know how to generate pre-signed URLs or use AWS credentials to fetch the data, resulting in large numbers of NIFTI_HEADER_UNREADABLE errors.

Expected behavior

Validation should not depend on the presence of local data, if it is available on s3-PUBLIC

How to reproduce

No response

Desktop

  • OS:
  • Browser:
  • Version:

Phone

  • Device:
  • OS:
  • Browser:
  • Version:

Additional information

No response

effigies avatar Dec 15 '25 15:12 effigies