sglang
sglang copied to clipboard
[BugFix]: Add missing clamp to llavavid
Motivation
Add clamp to llavavid model so that the placeholder for video input won't casue out-of-bound error when running LLaVA-NeXT-Video-7B using srt_example_llava_v.py
. The error is shown below.
Modifications
Add input_ids.clamp
to model forward
Checklist
- [ ] Format your code according to the Code Formatting with Pre-Commit.
- [ ] Add unit tests as outlined in the Running Unit Tests.
- [ ] Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
- [ ] Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
- [ ] For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
- [ ] Please feel free to join our Slack channel at https://slack.sglang.ai to discuss your PR.