Talha Jubair Siam
Talha Jubair Siam
@zkhCreator Did you find any solution?
@StanGirard Can you please assign me to this issue ?
Or this model as well `opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill`
@michaelfeil pardon me for mentioning here but is there any possibility of this getting implemented anytime soon? Otherwise I'll have to strategize differently Thanks for the great project btw
@StanGirard A dockerfile example would be very nice :)
@StanGirard Thanks my man, you're the best
@marcomarinodev You'll need to mount your accelerator with `--gpus all` but first make sure nvidia container toolkit is installed and configured
Correction : nvidia docker toolkit if you are using nvidia GPUs, but with AWS neuron, maybe look into this link : https://awsdocs-neuron.readthedocs-hosted.com/en/latest/containers/index.html
I don't know much about AWS machines but on my nvidia T4 Azure machine I had to make sure - nvidia driver for ubuntu, nvidia cuda toolkit, nvidia dnn and...
I'm experiencing a similar issue that appears related to this bug. In my case, I'm working with a large PDF document (hundreds of pages) and processing it using Docling. ##...