lftp icon indicating copy to clipboard operation
lftp copied to clipboard

show better status line when parallel mirror is in progress

Open arekm opened this issue 6 years ago • 4 comments

Hello.

This is feature request about better status line in parallel (non queued) mirror.

Example:

$ lftp ftp.icm.edu.pl
lftp ftp.icm.edu.pl:~> set mirror:use-pget-n 50
lftp ftp.icm.edu.pl:~> set mirror:parallel-transfer-count 20
lftp ftp.icm.edu.pl:~> mirror -c pub

Now lftp will start data transfer and ... some output, like random file transfer status:

`harvest-1.4.pl2-docs.tar.gz' at 262144 (60%) [Receiving data]

which basically means nothing since the transfer is parallel and tons of files are being transferred at the same time.

Could lftp show summary information as "jobs" command is doing (when using queue mirror) in case when parallel transfers are executed?

For example for "queue mirror -c pub" jobs shows:

[0] queue (ftp://ftp.icm.edu.pl)  -- 20.4 KiB/s
        Now executing: [1] mirror -c pub -- 27M/122M (21%) 20.4 KiB/s

So maybe lftp in non-queue parallel mode could also be showing

mirror -c pub -- 27M/122M (21%) 20.4 KiB/s

or something similar but more meaningful that random single file transfer.

The thing that is most interesting for user is: current total speed, total progress and summary size IMO. A lot more interesting than one of files transfer status.

arekm avatar Nov 21 '17 14:11 arekm

Agree. There is a support for multi-line statuses, it can also be used.

вт, 21 нояб. 2017, 17:42 Arkadiusz Miśkiewicz [email protected]:

Hello.

This is feature request about better status line in parallel (non queued) mirror.

Example:

$ lftp ftp.icm.edu.pl lftp ftp.icm.edu.pl:~> set mirror:use-pget-n 50 lftp ftp.icm.edu.pl:~> set mirror:parallel-transfer-count 20 lftp ftp.icm.edu.pl:~> mirror -c pub

Now lftp will start data transfer and ... some output, like random file transfer status:

`harvest-1.4.pl2-docs.tar.gz' at 262144 (60%) [Receiving data]

which basically means nothing since the transfer is parallel and tons of files are being transferred at the same time.

Could lftp show summary information as "jobs" command is doing (when using queue mirror) in case when parallel transfers are executed?

For example for "queue mirror -c pub" jobs shows:

[0] queue (ftp://ftp.icm.edu.pl) -- 20.4 KiB/s Now executing: [1] mirror -c pub -- 27M/122M (21%) 20.4 KiB/s

So maybe lftp in non-queue mode could also be showing

mirror -c pub -- 27M/122M (21%) 20.4 KiB/s

or something similar but more meaningful that random single file transfer.

The thing that is most interesting is: summary speed, progress and summary size IMO. A lot more interesting than one of files transfer status.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/lavv17/lftp/issues/415, or mute the thread https://github.com/notifications/unsubscribe-auth/AA67XH0DHq4JBVT_lORhDABYH1tuYZ_vks5s4uFMgaJpZM4Ql8jf .

lavv17 avatar Nov 21 '17 19:11 lavv17

How to get mirror to output the % completed and transfer rate?

I am running lftp in Docker and would like docker logs to show the same thing as queue mirror - how to achieve this?

wicadmin avatar Jan 12 '18 19:01 wicadmin

+1

peixotorms avatar Jan 14 '20 17:01 peixotorms

+1

grenaria avatar Sep 06 '20 15:09 grenaria