devops724

VLLM and openai api capability support

2

### Problem Description Hi is there any support to openai api capability support provide by vllm i want test some models with browser use like qwen-vl model the only way...

[New Model]: support Ovis VLM series

5

### 🚀 The feature, motivation and pitch Hi there i can't load AIDC-AI/Ovis2-34B model https://huggingface.co/AIDC-AI/Ovis2-34B this model outperform even Qwen 2.5 VL 72B in benchmarks Currently i get this ERROR...

jinja2.exceptions.TemplateError: Tool call IDs should be alphanumeric strings with length 9!

1

### Bug Description when i run local llm using vllm and run example code test of browser-use i get this error await self.middleware_stack(scope, receive, send) File "/home/user/miniconda3/lib/python3.12/site-packages/starlette/routing.py", line 735, in...

sglang or vllm api interface

3

### 🚀 The feature, motivation and pitch here is how to launch a api server using sglang for it quick start page Launch A Server from sglang.test.test_utils import is_in_ci from...

AsciiMath.js:1 Uncaught ReferenceError: global is not defined at node_modules/mathjax-full/js/input/asciimath/mathjax2/input/AsciiMath.js (AsciiMath.js:1:25) at __require2 (chunk-JJ3PYKI2.js?v=00b9f799:16:50) at node_modules/mathjax-full/js/input/asciimath.js (asciimath.ts:25:1) at __require2 (chunk-JJ3PYKI2.js?v=00b9f799:16:50) at node_modules/mathpix-markdown-it/lib/mathjax/mathjax.js (mathjax.ts:6:1) at __require2 (chunk-JJ3PYKI2.js?v=00b9f799:16:50) at node_modules/mathpix-markdown-it/lib/mathjax/index.js (index.ts:1:1) at __require2...

[New Model]: aya 32b vision support

4

### 🚀 The feature, motivation and pitch Hi Cohere just released aya vision 32b https://huggingface.co/CohereForAI/aya-vision-32b it reach to qwen vl 2.5 72B with only 32b parameters can we support this...

### Describe the bug python -m TTS.bin.train_tts --config_path finetune_config.json --restore_path /home/user/.local/share/tts/tts_models--fa--custom--glow-tts/model_file.pth --use_ddp=true --gpus="0,1,2,3" Found 24005 files in /home/user/workspace/dataset/train-tts3/dataset Using model: glow_tts Setting up Audio Processor... | sample_rate: 22050 | resample:...

update transformers, module 'jax.core' has no attribute 'NamedShape' error

3

in upgraded transformers whisper-jax 0.0.1 requires transformers=4.27.4, but you have transformers 4.48.0 which is incompatible. i get this error from whisper_jax import FlaxWhisperPipline File "/home/user/miniconda3/lib/python3.12/site-packages/whisper_jax/__init__.py", line 18, in from .modeling_flax_whisper...

support gemma 3

2

on run quantize in gemma3 i get this error Traceback (most recent call last): File "/home/user/workspace/api/document/quantize.py", line 9, in model = AutoAWQForCausalLM.from_pretrained(model_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/miniconda3/lib/python3.12/site-packages/awq/models/auto.py", line 76, in from_pretrained model_type...

on run quantize for aya vision i get this error Traceback (most recent call last): File "/home/user/workspace/api/document/quantize.py", line 9, in model = AutoAWQForCausalLM.from_pretrained(model_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/miniconda3/lib/python3.12/site-packages/awq/models/auto.py", line 76, in from_pretrained...