Question: cncli sync is slow when executed on local machine

[rayanebel]

Hi @AndrewWestberg

I've a small question, I need to develop a tool which needs to fetch the leaderlogs using cncli. To do that, I have to execute the cncli sync command first but, this command take a lot of time when I try to execute it on my local machine. I'd like to know if there's a way of reducing the synchronisation time during the first execution.

after ~15 min I'm still at 44%

cncli sync --host 127.0.0.1 --network-magic 764824073 --port 3001 --no-service --db $HOME/Desktop/cncli.db

[TRUNCATED]
 2024-03-20T00:49:03.954Z INFO  cncli::nodeclient::sync   > block 4520813 of 10078081:  44.85% sync'd
 2024-03-20T00:49:09.103Z INFO  cncli::nodeclient::sync   > block 4521036 of 10078081:  44.86% sync'd
 2024-03-20T00:49:14.237Z INFO  cncli::nodeclient::sync   > block 4521261 of 10078081:  44.86% sync'd
 2024-03-20T00:49:19.280Z INFO  cncli::nodeclient::sync   > block 4521480 of 10078081:  44.86% sync'd
 2024-03-20T00:49:24.315Z INFO  cncli::nodeclient::sync   > block 4521754 of 10078081:  44.86% sync'd
 2024-03-20T00:49:29.406Z INFO  cncli::nodeclient::sync   > block 4521985 of 10078081:  44.86% sync'd
 2024-03-20T00:49:34.430Z INFO  cncli::nodeclient::sync   > block 4522113 of 10078081:  44.87% sync'd
 2024-03-20T00:49:39.471Z INFO  cncli::nodeclient::sync   > block 4522247 of 10078082:  44.87% sync'd
 2024-03-20T00:49:44.531Z INFO  cncli::nodeclient::sync   > block 4522469 of 10078082:  44.87% sync'd
 2024-03-20T00:49:49.720Z INFO  cncli::nodeclient::sync   > block 4522633 of 10078082:  44.87% sync'd
 2024-03-20T00:49:54.817Z INFO  cncli::nodeclient::sync   > block 4522809 of 10078082:  44.87% sync'd
 2024-03-20T00:49:59.888Z INFO  cncli::nodeclient::sync   > block 4522985 of 10078082:  44.87% sync'd
 2024-03-20T00:50:05.463Z INFO  cncli::nodeclient::sync   > block 4523181 of 10078082:  44.88% sync'd
 2024-03-20T00:50:10.496Z INFO  cncli::nodeclient::sync   > block 4523368 of 10078082:  44.88% sync'd
 2024-03-20T00:50:15.587Z INFO  cncli::nodeclient::sync   > block 4523593 of 10078082:  44.88% sync'd
 2024-03-20T00:50:20.718Z INFO  cncli::nodeclient::sync   > block 4523805 of 10078082:  44.88% sync'd
 2024-03-20T00:50:25.753Z INFO  cncli::nodeclient::sync   > block 4523994 of 10078082:  44.88% sync'd
 2024-03-20T00:50:30.928Z INFO  cncli::nodeclient::sync   > block 4524229 of 10078082:  44.89% sync'd
 2024-03-20T00:50:36.047Z INFO  cncli::nodeclient::sync   > block 4524450 of 10078082:  44.89% sync'd
 2024-03-20T00:50:41.088Z INFO  cncli::nodeclient::sync   > block 4524682 of 10078082:  44.89% sync'd
 2024-03-20T00:50:46.127Z INFO  cncli::nodeclient::sync   > block 4524886 of 10078082:  44.89% sync'd
 2024-03-20T00:50:51.244Z INFO  cncli::nodeclient::sync   > block 4525105 of 10078082:  44.90% sync'd
 2024-03-20T00:50:56.286Z INFO  cncli::nodeclient::sync   > block 4525318 of 10078082:  44.90% sync'd
 2024-03-20T00:51:01.336Z INFO  cncli::nodeclient::sync   > block 4525552 of 10078082:  44.90% sync'd
 2024-03-20T00:51:06.424Z INFO  cncli::nodeclient::sync   > block 4525682 of 10078082:  44.90% sync'd
 2024-03-20T00:51:11.449Z INFO  cncli::nodeclient::sync   > block 4525875 of 10078082:  44.90% sync'd
 2024-03-20T00:51:16.471Z INFO  cncli::nodeclient::sync   > block 4526087 of 10078082:  44.91% sync'd

my cardano-node is hosted on a kubernetes cluster and I access it through a port-forward on my local machine.

I did not see any high CPU or RAM usage. Of course, when I execute the same command directly on the cardano-node with (3 CPU/ 16go RAM) it faster. but, when I want to develop in local it's blocking.

There is no way to bypass this local DB to get the leaderlogs ?

version: 6.1.0 OS: macos (m2)

Thanks.