vllm icon indicating copy to clipboard operation
vllm copied to clipboard

Published 20 hours ago • verified publisher icon vllm-project

[Doc] Add page for `PoolingParams`

Open DarkLight1337 opened this issue 9 months ago • 1 comments

This PR builds on #4710 by adding a page for PoolingParams which was recently introduced by #3734.

DarkLight1337 avatar May 14 '24 03:05 DarkLight1337

@CatherineSue Currently, the purpose of PoolingParams is unclear since it has no required arguments. More detailed docs for PoolingParams would be greatly appreciated!

DarkLight1337 avatar May 14 '24 03:05 DarkLight1337

@CatherineSue Currently, the purpose of PoolingParams is unclear since it has no required arguments. More detailed docs for PoolingParams would be greatly appreciated!

Right now PoolingParams is a stub - will be used to support different pooling strategies.

We are about to open an RFC for further work

robertgshaw2-redhat avatar May 19 '24 15:05 robertgshaw2-redhat

Closing as superseded by #9759.

DarkLight1337 avatar Oct 29 '24 15:10 DarkLight1337