shield
shield copied to clipboard
[BUG] Outputs bigger than 15G are not being saved
Describe the bug Outputs bigger than 15G are not being saved by the s3 plugin on the s3 bucket (they just don't show there after) despite that it says: "upload complete; uploaded xxx bytes of data" and ends with 0 exit code.
To Reproduce Steps to reproduce the behavior:
- Create simple pipe in shell:
pv --stop-at-size -s 15G /dev/zero | \
/shield/plugins/s3 store -e "${SHIELD_STORE_ENDPOINT}"
- Run it and verify that it ends successfully, but there is no such file on s3 after.
- Change size to for example "-s 14990M" and run again. Verify that now there is a file.
Expected behavior Size should be limited only by s3 limits: https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html
Screenshots If applicable, add screenshots to help explain your problem.
SHIELD versions (please complete the following information):
- SHIELD 8.7.0