mountpoint-s3
mountpoint-s3 copied to clipboard
Error with aria2c: Failed to write into the segment file
Mountpoint for Amazon S3 version
mount-s3 1.9.1
AWS Region
No response
Describe the running environment
Running on EC2 Ubuntu 22 (AMI ubuntu/images/hvm-ssd/ubuntu-jammy-22.04-amd64-server-20240701)
Mountpoint options
mount-s3 <BUCKET_NAME> $HOME/s3 --allow-delete --allow-overwrite
What happened?
Tried downloading 5.2GiB file directly to S3 via mountpoint with aria2c
aria2c https://storage.googleapis.com/alphafold/alphafold_params_2022-12-06.tar -d $HOME/s3
Generates error:
09/27 19:40:17 [NOTICE] Downloading 1 item(s)
09/27 19:40:17 [NOTICE] Allocating disk space. Use --file-allocation=none to disable it. See --file-allocation option in man page for more details.
[#0ab2ec 0B/5.2GiB(0%) CN:1 DL:0B] [FileAlloc:#0ab2ec 4.4GiB/5.2GiB(86%)]
09/27 19:40:25 [ERROR] Exception caught
Exception: [DefaultBtProgressInfoFile.cc:220] errorCode=1 Failed to write into the segment file s3/alphafold_params_2022-12-06.tar.aria2
[#0ab2ec 0B/5.2GiB(0%) CN:1 DL:0B]
09/27 19:40:25 [ERROR] Error when trying to flush write cache
Exception: [AbstractDiskWriter.cc:459] errNum=5 errorCode=17 Failed to write into the file s3/alphafold_params_2022-12-06.tar, cause: Input/output error
09/27 19:40:25 [ERROR] CUID#7 - Download aborted. URI=https://storage.googleapis.com/alphafold/alphafold_params_2022-12-06.tar
Exception: [AbstractCommand.cc:403] errorCode=17 URI=https://storage.googleapis.com/alphafold/alphafold_params_2022-12-06.tar
-> [DownloadCommand.cc:124] errorCode=17 Write disk cache flush failure index=0
09/27 19:40:25 [NOTICE] Download GID#0ab2ece0458de8f7 not complete: s3/alphafold_params_2022-12-06.tar
Download Results:
gid |stat|avg speed |path/URI
======+====+===========+=======================================================
0ab2ec|ERR | 415KiB/s|s3/alphafold_params_2022-12-06.tar
Status Legend:
(ERR):error occurred.
aria2 will resume download if the transfer is restarted.
If there are any errors, then see the log file. See '-l' option in help/man page for details.
NOTE: The following two commands both complete successfully:
-
wget https://storage.googleapis.com/alphafold/alphafold_params_2022-12-06.tar -P s3
-
aria2c https://storage.googleapis.com/alphafold/alphafold_params_2022-12-06.tar
In other words, I can use wget to download to the mounted folder, and aria2 to download to ec2, but NOT aria2 to download to the mounted folder
Relevant log output
No response