s3cmd icon indicating copy to clipboard operation
s3cmd copied to clipboard

MD5 sum capital letters

Open PRyC opened this issue 6 years ago • 2 comments

Hi

I want use s3cmd to send (put and sync) files to Aliyun OSS (AlibabaCloud, like s3). But I have a problem with the md5 sum - capital letters:

DEBUG: MD5 sums: computed=fee38491ac2a63dde34fbaa990af09a1, received="FEE38491AC2A63DDE34FBAA990AF09A1" WARNING: MD5 Sums don't match!

Any idea?

Best regards, Patryk

PRyC avatar Aug 05 '18 09:08 PRyC

I'm not merging the following PR that could fix this issue: https://github.com/s3tools/s3cmd/pull/1002 Because:

  • using "codecs.decode" is very not good in term of performance. (like the comparison is around x40 slower with this change)
  • The best way to do that would be simply to apply a ".lower()" to the foreign hex str. (still x5 slower for the comparison operation)

But:

  • i'm wondering if some more general clever trick should not be used to not slow down the operations with other cloud providers.
  • The change will also have to be done when we compare file list for sync
  • A little bit of thinking needs to be done that such a change is adequate with other providers that could not use "md5 hex" in their ETags.

fviard avatar Mar 22 '20 00:03 fviard

any updates for this situation when i use it for buckup in gitlab?

Danny5487401 avatar Dec 15 '23 01:12 Danny5487401