Siddharth Venkatesan
Siddharth Venkatesan
The changes I made are only available in version `0.19.0-SNAPSHOT`. Try updating to that version and let me know if that works.
We have this now since DJL 0.18.0 https://github.com/deepjavalibrary/djl/pull/1720
The above PR added a POS dataset.
Can you share your training code as well? It's hard for us to debug with just the block/model definition. Can you also share the full stack trace, or at least...
Hi, thanks for bringing up this issue. I see that in the second case with the error, the reported error is `Cuda failure: 2`. This maps to an insufficient memory...
This seems like it might be an issue with PyTorch tracing itself (it seems similar to this issue https://github.com/pytorch/pytorch/issues/114035). Also, can you confirm the model you are attempting to use?...
Solution: Use PyTorch 2.0.1 like this ``` PYTORCH_VERSION=2.0.1 djl-bench -e PyTorch -w 10 -c 1000 -s "(32,32)l,(32,32)l" -g 1 -p /home/ubuntu/models/model/nlp/text_embedding/ai/djl/huggingface/pytorch/elastic/multilingual-e5-small-optimized/0.0.1/multilingual-e5-small-optimized.zip ``` --- Unfortunately, this seems like an issue with...
I've included the removal of OPTION_MODEL_ID usage in this PR now.
@mohanasudhan I think the integration test failure is not related to the changes here - I see them failing for all open PRs currently. If that's the case, can this...
Hi @prashantsolanki975 - sorry for the delay here. We had some reports of similar issues to what you are facing, and the resolution requires setting another configuration: `SERVING_CHUNKED_READ_TIMEOUT=`. Depending on...