private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

Faster document listing by directly loading ref docs

Open imartinez opened this issue 1 year ago • 1 comments

Improves the speed of launching PrivateGPT's UI when lots of documents are ingested. Improves the speed of the "list" API.

imartinez avatar Mar 19 '24 20:03 imartinez

Testing using Postgres 14 docstore with 2,421,062 rows

With PR 1763 elapsed time 12s

22:58:37.941 [INFO    ] llama_index.core.indices.loading - Loading all indices.
22:58:49.454 [INFO    ]         private_gpt.ui.ui - Mounting the gradio UI, at path=/

Without change - 4m 50s

23:00:13.423 [INFO    ] llama_index.core.indices.loading - Loading all indices.
23:05:03.283 [INFO    ]         private_gpt.ui.ui - Mounting the gradio UI, at path=/

This work. Good job. Ship it !

dbzoo avatar Mar 20 '24 00:03 dbzoo

Testing using Postgres 14 docstore with 2,421,062 rows

With PR 1763 elapsed time 12s

22:58:37.941 [INFO    ] llama_index.core.indices.loading - Loading all indices.
22:58:49.454 [INFO    ]         private_gpt.ui.ui - Mounting the gradio UI, at path=/

Without change - 4m 50s

23:00:13.423 [INFO    ] llama_index.core.indices.loading - Loading all indices.
23:05:03.283 [INFO    ]         private_gpt.ui.ui - Mounting the gradio UI, at path=/

This work. Good job. Ship it !

Thanks for the test and the stats!

imartinez avatar Mar 20 '24 12:03 imartinez