Bruno Magalhaes

Variable batch size and LR scheduler

6

# Background and rationale In many use cases, particularly LLMs, one is faced with inputs (sentences) of variable lengths. A common practice is to pack batches by token count (not...

in python 3.11 and release 0.8.0: `ValueError: mutable default <class 'datasets.utils.version.Version'> for field version is not allowed: use default_factory`

5

### System Info In python `3.11` and TensorRT-LLM release `0.8.0`, when running `import tensorrt_llm`, the following error message is displayed: ``` ValueError: mutable default for field version is not allowed:...