djl

djl copied to clipboard

Memory leak at prediction time?

2

I'm using DJL 0.32.0 for tabular regression with PyTorch as engine in a multi-threaded application on Linux and I'm encountering a memory leak. Over time, more and more memory outside...

fracpete

ai.djl bom ${djl.version} pom import commons-cli commons-cli 1.6.0 ai.djl api ai.djl model-zoo ai.djl.pytorch pytorch-model-zoo ai.djl.huggingface tokenizers ai.djl.pytorch pytorch-engine runtime Criteria criteria = Criteria.builder() .setTypes(String.class, String.class) .optModelPath(modelDir) .optEngine("PyTorch") // Modern safetensors...

SidneyLann

Cannot allocate memory in static TLS block

3

## Description The deep learning engine fails to initialize due to an error loading the PyTorch native library (libgomp.so), causing the application to crash with an UnsatisfiedLinkError. This issue is...

mcgamer48ft

java.lang.UnsatisfiedLinkError: Symbol __ZNKSt3__115basic_stringbuf... not found in libc++.1.dylib when loading ONNX Runtime on macOS

1

## Description (A clear and concise description of what the bug is.) java.lang.UnsatisfiedLinkError: /private/var/folders/yk/j3pvljsx7hlf0hbnb22mm_940000gn/T/onnxruntime-java15068554294740161020/libonnxruntime.dylib: dlopen(/private/var/folders/yk/j3pvljsx7hlf0hbnb22mm_940000gn/T/onnxruntime-java15068554294740161020/libonnxruntime.dylib, 1): Symbol not found: __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv Referenced from: /private/var/folders/yk/j3pvljsx7hlf0hbnb22mm_940000gn/T/onnxruntime-java15068554294740161020/libonnxruntime.dylib (which was built for Mac OS X...

jinxingtianxia

Add WhisperJET to DJL ?

7

hi , we have made very high speed cross platform java library STT , https://github.com/eix128/WhisperJET Which is ultra speed for java and with cross platform capability. Maybe DJL can add...

eix128

Getting java.lang.IllegalStateException: Tried to specify the thread pool when creating an OrtEnvironment, but one already exists.

10

We are seeing a `Getting java.lang.IllegalStateException: Tried to specify the thread pool when creating an OrtEnvironment, but one already exists.` This is our object to create the criteria `object ModelCriteria...

AbhishekBose

hi, we need djl audio for kaldi

1

Hi kaldi is most popular speech tools for deep learning . we need kaldi to inherit with djl pytorch . could we bring kaldi to djl audio please consider to...

mullerhai

isTuple() INTERNAL ASSERT FAILED at "..\\..\\aten\\src\\ATen/core/ivalue_inl.h":1101, please report a bug to PyTorch. Expected Tuple but got String

3

ai.djl.translate.TranslateException: ai.djl.engine.EngineException: isTuple() INTERNAL ASSERT FAILED at "..\\..\\aten\\src\\ATen/core/ivalue_inl.h":1101, please report a bug to PyTorch. Expected Tuple but got String at ai.djl.inference.Predictor.batchPredict(Predictor.java:186) ~[api-0.15.0.jar:na] at ai.djl.inference.Predictor.predict(Predictor.java:123) ~[api-0.15.0.jar:na] at com.ccf.image.service.FeatureExtractor.extract(FeatureExtractor.java:69) ~[classes/:na] at com.ccf.image.controller.ImageController.extractVector(ImageController.java:31)...

Nanran1220

Trying adapt DJL for the LoongArch architecture, need some architecture-specific files

2

Hi, I'm trying to adapt DJL for the LoongArch architecture, but I encountered the following error: ``` ... > java.io.FileNotFoundException: https://publish.djl.ai/pytorch/2.5.1/jnilib/0.33.0/linux-loongarch64/cpu- precxx11/libdjl_torch.so ... ``` I think I need to adapt...

tianxu1997

I was using djl version 0.25, if I upgrade to version 0.32, do I need to change the method?

6

this is my POM ``` ai.djl api ${djl.version} ai.djl.pytorch pytorch-engine ${djl.version} ai.djl.pytorch pytorch-native-cpu win-x86_64 2.0.1 runtime ai.djl.pytorch pytorch-model-zoo ${djl.version} ``` This is my code ``` public void init() { try...

phyjar