yhyang201

Regarding the Confusion about Ragged Tensors in the Documentation

1

In the "Fully Packed Layout (THD)" under Case 3 on [this page](https://docs.nvidia.com/deeplearning/cudnn/frontend/latest/operations/Attention.html#supported-tensor-layouts), I noticed the following description: ``` `Q = aabb` dimension = [B = 2, H = 1, S...

[Feature] Prevent OOM Crashes in sglang with Large Batches or Image Inputs

1

### Checklist - [x] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed. - [x]...