Aurelien Chartier

icon company Nvidia icon location Seattle

Results 32 comments of Aurelien Chartier

chore: upgrade transformers to 4.50.0

The new transformers requires us to upgrade modelopt. Hence, this PR is dependent on https://github.com/NVIDIA/TensorRT-LLM/pull/3252

chore: upgrade transformers to 4.50.0

Already upgraded in #3302

fix: [nvbugs/5287097] Align PP layer distribution between pytorch and TRT flow.

/bot reuse-pipeline

[None][feat] Add environment variable to force spec-dec number of accepted tokens

/bot run

[None][feat] Add environment variable to force spec-dec number of accepted tokens

/bot run

[None][feat] Add environment variable to force spec-dec number of accepted tokens

/bot run

chore: cleanup py_executor code

/bot run

chore: cleanup py_executor code

/bot run

chore: cleanup py_executor code

/bot reuse-pipeline

feat: Pytorch PP + attention DP support

/bot run