dolt icon indicating copy to clipboard operation
dolt copied to clipboard

`dolt log` takes really long time.

Open coffeegoddd opened this issue 7 months ago • 2 comments

Running dolt log just hangs. Ok it actually opened the log after a long time.

dolt v1.54.2

dolt clone jon-mellon/every-cause-of-human-outcomes
cd every-cause-of-human-outcomes
dolt log

coffeegoddd avatar Jun 05 '25 20:06 coffeegoddd

This has been true for awhile. Takes like 5 minutes for media wiki.

The main reason for this is that we load the entire history before processing the log at all. need a more incremental approach.

macneale4 avatar Jun 05 '25 20:06 macneale4

This is backed by the dolt_log table function, right? That function already exposes an iterator, is there any reason why we can't stream the output as we walk the iterator?

nicktobey avatar Jun 05 '25 21:06 nicktobey