Chong Zhang
Chong Zhang
I had the same issue, and when I added a debug line after https://github.com/fsspec/s3fs/blob/main/s3fs/core.py#L2269 to print out the `data1_size`, it prints out the value which is smaller than the `self.blocksize`...
Could it be related to the cache? I tried different cache options but still got the same error.
https://github.com/fsspec/s3fs/blob/main/s3fs/core.py#L2020 https://github.com/fsspec/filesystem_spec/blob/master/fsspec/spec.py#L1568 TBH I am new to s3fs and not sure it's related to this different chunk size.