cariaso

resolved in https://github.com/cariaso/dna/commit/1cf6e7b028c5e5d89f1603c3c893f62793abe015

The changes above are humorous. The changes at https://github.com/cariaso/dna are real.

> I assume this is an error while trying to connect to a unix-based control socket. yes > By "networked storage" you mean NFS or ...? AWS EBS gp3 is...

adding a TransferConfig of multipart_threshold=1 will work around this, in all except the pathological 0 byte file scenario. ``` from boto3.s3.transfer import TransferConfig threshold = 1 config = TransferConfig(multipart_threshold=threshold) s3Client.copy(...

I chased it all the way down to a function called `emit` and looked at the full request. It looked like amazon's servers just didn't do what the api asked...

@cariaso just to clarify is the metadata lost when using the default multipart_threshold value? yes, metadata is lost with the default multipart_threshold value. On Wed, Aug 3, 2022 at 8:49...

I'm actively on this, and will probably have an update in a few days.

promethease_report_1166_Punarvasu_Tab.txt:gs101 promethease_report_1166_Punarvasu_Tab.txt:gs221 promethease_report_1166_Punarvasu_Tab.txt:gs247 promethease_report_1166_Punarvasu_Tab.txt:gs184 promethease_report_1166_Punarvasu_Tab.txt:gs154 promethease_report_1166_Punarvasu_Tab.txt:gs158 promethease_report_14_Little bit_Tab.txt:gs145 promethease_report_14_Little bit_Tab.txt:gs151 promethease_report_14_Little bit_Tab.txt:gs273 promethease_report_14_Little bit_Tab.txt:gs250 promethease_report_14_Little bit_Tab.txt:gs256 promethease_report_14_Little bit_Tab.txt:gs101 promethease_report_14_Little bit_Tab.txt:gs128 promethease_report_14_Little bit_Tab.txt:gs159 promethease_report_14_Little bit_Tab.txt:gs173 promethease_report_14_Little bit_Tab.txt:gs209 promethease_report_14_Little bit_Tab.txt:gs232 promethease_report_14_Little bit_Tab.txt:gs234...

https://s3.amazonaws.com/snpedia/public/opensnp_genosets.txt.gz 711 opensnp users 15084 reported genosets number of times reported gs# 685 gs154 542 gs101 503 gs217 499 gs184 481 gs233 456 gs144 428 gs232 419 gs160 392 gs234...

just to reinforce, I'm seeing exactly this same issue. Specific messages: As soon as all of the qsubs are done, it waits only briefly then shows ``` [WARNING]DEAD job? 1472384971.0...