Salomón Mejía

Bug in faster-whisper batchinferencePipeline

4

I am using Faster-Whisper with BatchInferencePipeline as a service, but after the model (systran-large-v3) has been loaded into memory and has performed some transcriptions, I encounter the following error: [json-exception-type_error.302]...

[Bug]: I am traing to run unsloth/phi-4-bnb-4bit but I am getting always the same error Validation Error:1 validatiopn error for modelconfig Infer_schema(func): Parameter block_size has unsupported type list[int]

3

### Your current environment vllm serve "model_path" --quantization bitsandbytes \ --load-format bitsandbytes \ --dtype half \ --block-size 32 \ --max-model-len 10k ### 🐛 Describe the bug I am traing to...

Ejemplo de tendencia de compra de la población colombiana en una ecom…

1

…erce