[Question]: what kind of LLM suits knowledge graph

Open liaoweiguo opened this issue 10 months ago • 3 comments

I use deepseek_distill 70b, it seems very very slow to generate the knowledge graph. is it possible to use a small and quick one as 32b or even 14b

Feb 27 '25 09:02 liaoweiguo

Yes, you could give it a try about 32B LLM. I believe it can.

Feb 28 '25 04:02 KevinHuSh

do we have to switch to nightly image to finish the graph generation, it running so long

Feb 28 '25 09:02 liaoweiguo

Yes, you could give it a try about 32B LLM. I believe it can.

what's the difference between 0.16 and nightly, can I modify the threshold/quality of graph, it just running too long

Feb 28 '25 09:02 liaoweiguo