Marco Marinò
Marco Marinò
Hi @MaartenGr thanks for the reply. So, as far as I understand, `.fit_transform` is not supposed to compute the similarity scores between document and topic embeddings on zero-shot mode, right?...
> During `.fit_transform` there are two steps. The first is assigning the zero-shot topics to documents using the similarity scores between document and zero-shot topics. The second is running the...
I tried to add `--gpus all`, but I get the following error: ``` docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI...
I think @michaelfeil can help here
So, in order to have that model available in infinity, should I first compile the model so that it becomes compatible with neuron architecture?
> @marcomarinodev Many warnings, I have not used neuron in the last 4 months. > > Playbook: > > * Do not use docker > * I am not sure...
Hi @michaelfeil any thought regarding `--engine neuron` not available?
@michaelfeil I executed your commands and probably got the same error as yours (inf2.8xlarge with Amazon Linux 2): ``` [ec2-user@ip-XX-XXX-XXX-XXXinfinity_emb]$ infinity_emb v2 --engine neuron --model-id sentence-transformers/all-MiniLM-L6-v2 INFO: Started server process...