djl
djl copied to clipboard
An Engine-Agnostic Deep Learning Framework in Java
测试FeatureComparison发现,任意2张图进行比对精确度都能达到0.7以上,请问是哪个地方出问题了
## Description Hello, I am currently looking into the possibility to fine-tune Hugginface transformers in DJL. I understand that now we have new hugginface tokenizer library and I tested the...
any plan to support LLMs like openai / llama ? like langchain in java
Hi All, Currently, this is my custom `model.py` for `text-generation` task, which uses `AutoModelForCausalLM`. Could you please share a sample custom `model.py` for `question-answering` task? ``` %%writefile {model_base_path}/code/model.py from djl_python...
Hello. I'm quite a seasoned Java developer and new to djl, pythorch etc. I was really happy to found djl to use for my experiments with machine learning, since I...
## Description I am trying to train bert model with Stanford question answering dataset and my training fails, because some questions don't have "answers" defined, but they have "plausible_answers" node....
## Description (A clear and concise description of what the feature is.) Will this change the current api? How? Who will benefit from this enhancement? ## References - list reference...
## Description 目前djl的Image及内置的相关Translator默认都是FP32精度,查看相关源码及API发现并未找到相关的设置用来支持FP16模型的推理,FP16精度的模型在损失一定的精度下可以提高推理速度,希望后续版本能够提供相关API或者是设置项用来快速的实现FP16模型的推理。
I previously raised an [issue](https://github.com/deepjavalibrary/djl/issues/2503) about upgrading DJL to the latest version and upgrading PyTorch to 2.0.0. At that time, the version I received from the Maven repository was 0.22.0,...
## Description When I close a model, I have the following error: `free(): invalid pointer` it also happens when the app exits and the memory is cleared. It happens on...