chroma icon indicating copy to clipboard operation
chroma copied to clipboard

[Bug]: Error executing model: Error computing NN outputs.

Open varkeyvincentindia opened this issue 7 months ago • 6 comments

What happened?

While trying to run a basic script mentioned below I'm seeing an issue.

import chromadb chroma_client = chromadb.Client()

switch create_collection to get_or_create_collection to avoid creating a new collection every time

collection = chroma_client.get_or_create_collection(name="my_collection")

switch add to upsert to avoid adding the same documents every time

collection.upsert( documents=[ "This is a document about pineapple", "This is a document about oranges" ], ids=["id1", "id2"] )

results = collection.query( query_texts=["This is a query document about florida"], # Chroma will embed this for you n_results=2 # how many results to return )

print(results)

Issue: 2024-07-22 21:04:26.098904 [E:onnxruntime:, sequential_executor.cc:516 ExecuteKernel] Non-zero status code returned while running CoreML_2809954737722992935_1 node. Name:'CoreMLExecutionProvider_CoreML_2809954737722992935_1_1' Status Message: Error executing model: Error computing NN outputs.

Versions

chroma-hnswlib 0.7.5, chromadb 0.5.4, MAC OS MOnterey (12.7.5), Python: 3.12.4

Relevant log output

$ python chroma_db_basics.py 

2024-07-22 21:04:26.098904 [E:onnxruntime:, sequential_executor.cc:516 ExecuteKernel] Non-zero status code returned while running CoreML_2809954737722992935_1 node. Name:'CoreMLExecutionProvider_CoreML_2809954737722992935_1_1' Status Message: Error executing model: Error computing NN outputs.
Traceback (most recent call last):
  File "/Users/varkeyvincent/Desktop/LLM_learning_journey/LLM_Journey/chroma_db_basics.py", line 5, in <module>
    collection.add(
  File "/Users/varkeyvincent/Desktop/LLM_learning_journey/LLM_Journey/my_venv/lib/python3.12/site-packages/chromadb/api/models/Collection.py", line 80, in add
    ) = self._validate_and_prepare_embedding_set(
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/varkeyvincent/Desktop/LLM_learning_journey/LLM_Journey/my_venv/lib/python3.12/site-packages/chromadb/api/models/CollectionCommon.py", line 279, in _validate_and_prepare_embedding_set
    embeddings = self._embed(input=documents)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/varkeyvincent/Desktop/LLM_learning_journey/LLM_Journey/my_venv/lib/python3.12/site-packages/chromadb/api/models/CollectionCommon.py", line 568, in _embed
    return self._embedding_function(input=input)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/varkeyvincent/Desktop/LLM_learning_journey/LLM_Journey/my_venv/lib/python3.12/site-packages/chromadb/api/types.py", line 211, in __call__
    result = call(self, input)
             ^^^^^^^^^^^^^^^^^
  File "/Users/varkeyvincent/Desktop/LLM_learning_journey/LLM_Journey/my_venv/lib/python3.12/site-packages/chromadb/utils/embedding_functions/onnx_mini_lm_l6_v2.py", line 200, in __call__
    return cast(Embeddings, self._forward(input).tolist())
                            ^^^^^^^^^^^^^^^^^^^^
  File "/Users/varkeyvincent/Desktop/LLM_learning_journey/LLM_Journey/my_venv/lib/python3.12/site-packages/chromadb/utils/embedding_functions/onnx_mini_lm_l6_v2.py", line 143, in _forward
    model_output = self.model.run(None, onnx_input)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/varkeyvincent/Desktop/LLM_learning_journey/LLM_Journey/my_venv/lib/python3.12/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 220, in run
    return self._sess.run(output_names, input_feed, run_options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Non-zero status code returned while running CoreML_2809954737722992935_1 node. Name:'CoreMLExecutionProvider_CoreML_2809954737722992935_1_1' Status Message: Error executing model: Error computing NN outputs.

varkeyvincentindia avatar Jul 22 '24 17:07 varkeyvincentindia