holma

Error training GPT-2 with LoRA INT8

6

Hi! I'm trying to fine-tune a GPT2-based model with LORA in INT8 with bits_and_bytes. I followed the steps in the example notebook provided here: https://colab.research.google.com/drive/1jCkpikz0J2o20FBQmYmAGdiKmJGOMo-o?usp=sharing The following code (taken from...