Ryan AI Dev

amazon also recommends keeping an index of the current files in a dynamodb index... said it was the basis for EMRFS for mapreduce to get around the eventual consistency list...

Looking at these libraries now: https://github.com/Netflix/s3mper http://techblog.netflix.com/2014/01/s3mper-consistency-in-cloud.html i think the major thing with our use cases causing these issues is that we are putting dat into that bucket as we...

The problem that happened this weekekend was this: Blueshift successfully processed files in s3 in the manifest and removed them. Then more files were added to the s3 bucket. Blueshift...

i was thinking i was goign to add a config setting called : s3_consistency :strict so that i could turn that additional validation on or off depending on my use...

i get these timeouts all the time.. do i really need to patch the code in this way as a workaround?

same..i used local install and docker image to make sure it wasn't python... my key works because if i change it i get api key error.. > i am experiencing...