Alyssa Vance

Gradient checkpointing throws use_reentrant warning on PyTorch 2.1

2

### System Info - `transformers` version: 4.36.2 - Platform: Linux-5.15.0-91-generic-x86_64-with-glibc2.35 - Python version: 3.10.13 - Huggingface_hub version: 0.19.4 - Safetensors version: 0.4.0 - Accelerate version: 0.25.0 - Accelerate config: -...

run_glue_no_trainer.py script crashes on Mistral model due to tokenizer issue

3

### System Info - `transformers` version: 4.36.2 - Platform: Linux-5.15.0-91-generic-x86_64-with-glibc2.35 - Python version: 3.10.13 - Huggingface_hub version: 0.19.4 - Safetensors version: 0.4.0 - Accelerate version: 0.25.0 - Accelerate config: -...

**Is your feature request related to a problem? Please describe.** Quantization can take a while. It would be cool if there was a progress bar when quantizing, so we knew...

Optimizer compilation fails with PyTorch 2.2

2

**What's the issue, what's expected?**: I tried to compile the MS-AMP optimizer with the new Torch 2.2: ``` cd msamp/optim pip install -v . ``` but got this error: ```...

Support for Hopper H100

3

Hi! You've probably already considered this, but would you be able to add support for Hopper H100 GPUs? A100s don't have nearly as much memory bandwidth. Am happy to run...