djl
djl copied to clipboard
deepjavalibrary
An Engine-Agnostic Deep Learning Framework in Java
[W TensorBody.h:491] Warning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want...
## Description In the grab method, the normalization of 16-bit PCM samples is performed using:  `list.add(buffer.get() / (float) Short.MAX_VALUE);` However, Short.MAX_VALUE is 32767, while the actual range of 16-bit...
## Description When attempting to load **Meta-Llama-3.1-8B-Instruct-AWQ-INT4** with a **LoRA adapter** using the **DJL image** with **SageMaker fast model loader**, the model fails to load properly. ### Expected Behavior **The...
## Description Duration parse method fails when receives the Minute format from TimeFeature frequency with "T" ending char. ### Expected Behavior TimeFeature minute mapping should use the "M" char like...
## Description ai.djl.pytorch.jni.LibUtils : No matching cuda flavor for win-x86_64 found: cu126. ## References - list reference and related literature - list known implementations
public void train(NDArray logMat, NDArray qMat, int batchSize, float learningRate, int epochs) { Tools.CustomLogger customLogger = new Tools.CustomLogger("logs", "both"); Loss binaryCrossEntropy = Loss.sigmoidBinaryCrossEntropyLoss(); for (int epoch = 0; epoch <...
## Description I am serving a Qwen model via DJL container. ``` docker run --runtime nvidia --gpus all -p 8000:8000 -v /home/ubuntu/s1/ckpts/s1-20250213_094556:/opt/ml/model --ipc=host deepjavalibrary/djl-serving:0.32.0-pytorch-gpu ``` I use the openai client...
## Description The OpenAI `chat/completion` API supports the `extra_body` argument to pass model specific parameters to the model. Model hosted via vLLM support this feature, but when using DJL/vLLM, `extra_body`...
👋 looks like `serving-0.31.1.tar` is missing for 0.31.1 release? Thanks!
Metadata
Owner
Metadata
An Engine-Agnostic Deep Learning Framework in Java