R2R icon indicating copy to clipboard operation
R2R copied to clipboard

Working Ollama Model Example

Open sanzhar-rakhimkul opened this issue 1 year ago • 4 comments
trafficstars

Did anyone find which ollama model works with knowledge graph and graphrag? When I use with GPT-4, everything works.

  • I've tried Llama 3.1:70B-q8.
  • I've tried mistral-large:123b-instruct-2407-q8_0
  • Way to run r2r - OLLAMA_API_BASE=http://10.204.54.11:11434 r2r serve --docker --config-path=./config/r2r.toml

None of them worked when I tried to ingest sample file - r2r ingest-sample-file.

When I try to get knowledge graph with sample file - r2r inspect-knowledge-graph. The output is always empty:

Output:
Time taken: 0.36 seconds {'results': '\n== Graph Statistics ==\nNumber of nodes: 0\nNumber of edges: 0\nNumber of connected components: 0\n\n== Most Central Nodes =='} Logs from docker:
WARNING:neo4j.notifications:Received notification from DBMS server: {severity: WARNING} {code: Neo.ClientNotification.Statement.UnknownPropertyKeyWarning} {category: UNRECOGNIZED} {title: The provided property key is not in the database} {description: One of the property names in your query is not available in the database, make sure you didn't misspell it or that the label is available when you run this statement in your application (the missing property name is: name)} {position: line: 3, column: 27, offset: 48} for query: '\n MATCH (n1)-[r]->(n2)\n return n1.name AS subject, n1.description AS subject_description, n2.name AS object, n2.description AS object_description, type(r) AS relation, r.description AS relation_description\n SKIP 0\n LIMIT 100\n ' WARNING:neo4j.notifications:Received notification from DBMS server: {severity: WARNING} {code: Neo.ClientNotification.Statement.UnknownPropertyKeyWarning} {category: UNRECOGNIZED} {title: The provided property key is not in the database} {description: One of the property names in your query is not available in the database, make sure you didn't misspell it or that the label is available when you run this statement in your application (the missing property name is: name)} {position: line: 3, column: 86, offset: 107} for query: '\n MATCH (n1)-[r]->(n2)\n return n1.name AS subject, n1.description AS subject_description, n2.name AS object, n2.description AS object_description, type(r) AS relation, r.description AS relation_description\n SKIP 0\n LIMIT 100\n

R2R version - 3.0.8 My R2R config: r2r.txt

sanzhar-rakhimkul avatar Sep 02 '24 10:09 sanzhar-rakhimkul