Václav Černý
Václav Černý
Sure. This works for me with the OWU configuration pictured at the docs: https://docs.openwebui.com/features/document-extraction/docling/#optional-step-3-configure-doclings-picture-description-features ``` docling: container_name: docling hostname: docling image: quay.io/docling-project/docling-serve-cu124:v0.16.0 environment: - DOCLING_SERVE_ENABLE_UI=true - DOCLING_SERVE_ARTIFACTS_PATH="" - DOCLING_SERVE_MAX_SYNC_WAIT=2880 -...
Could you post a screenshot of your settings in OWU -> Documents?
Yes, Docling is slow and memory hungry... but you should really complain at Docling's repo, not here.
They state Ovis2 supprt has been merged into `v0.9.0` https://github.com/vllm-project/vllm/pull/15826, but I cannot run quantized version `AIDC-AI/Ovis2-8B-GPTQ-Int4` `ValueError: There is no module or parameter named 'visual_tokenizer.backbone.trunk.blocks.0.mlp.fc1.weight' in Ovis`
Retry decorator fails to catch `LengthFinishReasonError` and other exceptions when using AzureOpenAI
Hi, I just ran into this. Is there any progress or workaround for this?