rkatriel

Results 8 comments of rkatriel

Spacy-LLM code sample produces no output

Hi @rmitsch which model in particular do you recommend I try? It can't be bigger than a 7b otherwise it won't fit in memory (or take way too long to...

Spacy-LLM code sample produces no output

I tried Mistral with the config parameters from https://spacy.io/api/large-language-models: ``` "model": { "@llm_models": "spacy.Mistral.v1", "name": "Mistral-7B-v0.1" }, ``` But I'm getting **KeyError: 'mistral'**. Below is the traceback. File "/Users/ron/PycharmProjects/AI/OpenAI/spacy-llm-example.py", line...

Spacy-LLM code sample produces no output

The version of spacy-llm I was using was 0.6.3. I upgraded to the latest (0.6.4) but still got the same error. It looks like the problem was actually with the...

Spacy-LLM code sample produces no output

Thanks, Raphael. I modified the code accordingly ``` config={ "task": { "@llm_tasks": "spacy.NER.v1", "labels": "SAAS_PLATFORM,PROGRAMMING_LANGUAGE,OPEN_SOURCE_LIBRARY" }, "model": { "@llm_models": "spacy.Mistral.v1", "name": "Mistral-7B-v0.1", "config_init": { "offload_folder": "." } }, }, ```...

Spacy-LLM code sample produces no output

Thanks. That did the trick. Now the code runs without errors (albeit slowly, partly due to moderate memory pressure). However, once again no output is produced, perhaps related to the...

Spacy-LLM code sample produces no output

I got back {}

Spacy-LLM code sample produces no output

@rmitsch Thanks, I followed your advice but unfortunately it made no difference. I also tried replacing "spacy.Mistral.v1" with "spacy.OpenLLaMA.v1" and "spacy.StableLM.v1" but the response from the LLM is always empty...

Spacy-LLM code sample produces no output

Hi @kemalcanbora, thanks for the followup! It's been a while since this thread has seen activity. I tried your suggestion and, while it ran cleanly (except for a warning) though...