dvc
dvc copied to clipboard
dvc push not updating Push %
Bug Report
Issue name
dvc push -v -j 4: Doesn't update Pushing %, B/s transferred, or transfer times.
Description
When I run dvc push to an S3 bucket the % always reports 0%. I think it's pushing because I can see my outbound network traffic spike, but the percentage never changes.
dvc push -v -j 4
2024-09-13 12:06:26,854 DEBUG: v3.55.2 (conda), CPython 3.11.10 on macOS-14.6.1-arm64-arm-64bit
2024-09-13 12:06:26,854 DEBUG: command: /Users/myid/workspace/myproject/.venv/bin/dvc push -v -j 4
Collecting |0.00 [00:00, ?entry/s]
2024-09-13 12:06:27,058 DEBUG: Preparing to transfer data from /Users/myid/workspace/myproject/.dvc/cache/files/md5' to 's3://my-dvc-data-bucket/data/files/md5'
2024-09-13 12:06:27,058 DEBUG: Preparing to collect status from 'my-dvc-data-bucket/data/files/md5'
2024-09-13 12:06:27,058 DEBUG: Collecting status from 'my-dvc-data-bucket/data/files/md5'
2024-09-13 12:06:29,488 DEBUG: Estimated remote size: 4096 files
2024-09-13 12:06:29,489 DEBUG: Large remote (3 oids < 4.096 traverse weight), using object_exists for remaining oids
2024-09-13 12:06:29,490 DEBUG: Querying 3 oids via object_exists
2024-09-13 12:06:30,456 DEBUG: Preparing to collect status from '/Users/myid/.dvc/cache/files/md5'
2024-09-13 12:06:30,457 DEBUG: Collecting status from '/Users/myid/.dvc/cache/files/md5'
Pushing
0%| |Pushing to s3 0/3 [00:00<?, ?file/s]
0%| |/Users/myid/.dvc/cache/files/md5/9b/f40a981a0f663131cd5df87949dd2e 0.00/73.8M [00:00<?, ?B/s]
Reproduce
- dvc init
- dvc remote add -d myremote s3://my-dvc-data-bucket/data
- Copy 3 encrypted zip files dataset1.zip, dataset2.zip, dataset3.zip to ./data
- dvc add data/*
- dvc push -v -j 4
Expected
I would expect the Pushing %, B/s transferred, or transfer times to update as it's uploading to S3.
Environment information
MacOS Macbook M3 Max
Output of dvc doctor
:
dvc doctor DVC version: 3.55.2 (conda)
Platform: Python 3.11.10 on macOS-14.6.1-arm64-arm-64bit Subprojects: dvc_data = 3.16.5 dvc_objects = 5.1.0 dvc_render = 1.0.2 dvc_task = 0.4.0 scmrepo = 3.3.7 Supports: http (aiohttp = 3.10.5, aiohttp-retry = 2.8.3), https (aiohttp = 3.10.5, aiohttp-retry = 2.8.3), s3 (s3fs = 2024.6.1, boto3 = 1.34.154) Config: Global: /Users/myid/Library/Application Support/dvc System: /Library/Application Support/dvc Cache types: reflink, hardlink, symlink Cache directory: apfs on /dev/disk3s1s1 Caches: local Remotes: s3 Workspace directory: apfs on /dev/disk3s1s1 Repo: dvc, git Repo.site_cache_dir: /Library/Caches/dvc/repo/a463a6711ebfd4b1cff05ad93828b21b