llmgraph icon indicating copy to clipboard operation
llmgraph copied to clipboard

Does it work with other LLM models: Claude/anthropic

Open mahamatnoumai opened this issue 1 year ago • 1 comments

Hi there,

I found your llmgraph looks interesting, I would like to use it, just wondering if it would work with other LLM models beside current defauts one.

I am trying to test it using CLAUDE google LLM model.

Thank you

mahamatnoumai avatar Sep 24 '24 13:09 mahamatnoumai

You can specify a different LLM provider, including running with a local https://github.com/jmorganca/ollama model.

You should be able to specify (via the --llm-model argument, see docs here) anything supported by LiteLLM as described here: https://docs.litellm.ai/docs/providers

You'll find Claude models under the Anthropic provider: https://docs.litellm.ai/docs/providers/anthropic

Note that the prompts to extract related entities were tested with OpenAI and may not work as well with other models.

Thanks for your interest in the project.

dylanhogg avatar Oct 03 '24 08:10 dylanhogg