zifeitong
zifeitong
Skip the first token in sequence as its logprob is not defined and not computed. Otherwise, this [`token_id == all_token_ids[token_position]`](https://github.com/vllm-project/vllm/blob/d7a816835ad2ec7af36229603a7d40535a9d82f0/vllm/transformers_utils/detokenizer.py#L77) check won't work properly and cause `detokenize_incrementally` to generate incorrect...
Documented in https://developer.mozilla.org/en-US/docs/Web/Security/Subresource_Integrity
## 🐛 Bug I am seeing `illegal instruction` error when running mlc-llm with H100 (Driver Version: 550.54.1 CUDA Version: 12.4). It works fine on another A100 machine (Driver Version: 535.161.08,...
It's a bit tricky for MiniCPM-V since `ModelConfig` is not passed into `MiniCPMV` but used in `_get_image_bounds()`. --- PR Checklist (Click to Expand) Thank you for your contribution to vLLM!...
Instead of hexadecimal string of checksum, The SRI value must be in the format like `sha256-{base64(checksum)}`. [mdn.io/sri#tools_for_generating_sri_hashes](https://developer.mozilla.org/en-US/docs/Web/Security/Subresource_Integrity#tools_for_generating_sri_hashes) shows a few ways to generate the SRI values.
Content type is allowed to have multiple optional parameters, e.g. `application/json; charset=UTF-8`. It's not correctly handled right now. Follow-up of #13193.
Minor quality-of-life change to provide a default value for this field.
std::experimental::simd in libc++ is incomplete: ``` In file included from :1: /app/raw.githubusercontent.com/qlibs/mph/main/mph:1144:26: error: no member named 'any_of' in namespace 'std::experimental' 1144 | std::experimental::any_of(match), | ^~~~~~ /app/raw.githubusercontent.com/qlibs/mph/main/mph:1145:53: error: no member named...