graphiti icon indicating copy to clipboard operation
graphiti copied to clipboard

Bulk embed

Open prasmussen15 opened this issue 8 months ago • 0 comments

[!IMPORTANT] Adds batch embedding support for nodes and edges, improving performance by reducing asynchronous calls.

  • Behavior:
    • Introduces create_entity_edge_embeddings() in edges.py for batch embedding of EntityEdge objects.
    • Introduces create_entity_node_embeddings() in nodes.py for batch embedding of EntityNode objects.
    • Replaces individual embedding generation with batch embedding in extract_edges() in edge_operations.py and extract_nodes() in node_operations.py.
  • Embedder Clients:
    • Adds create_batch() method to EmbedderClient in client.py.
    • Implements create_batch() in gemini.py, openai.py, and voyage.py for batch embedding support.
  • Misc:
    • Removes unused parameter in get_relevant_edges() and get_relevant_nodes() calls in edge_operations.py and node_operations.py.

This description was created by Ellipsis for 733ad6cf41cc11b6161ab546bd9b80dbd44e6b30. You can customize this summary. It will automatically update as commits are pushed.

prasmussen15 avatar Apr 27 '25 01:04 prasmussen15