Daniel Han

@mano3-1 I changed it, but it seems like it's still nans weirdly. I also tried installing the February release of Unsloth with torch==2.1.1, and it's not working. @lapp0 Do you...

@mano3-1 Wait if it works for you - weird it might be a weird paged optimizer issue. @lapp0 HMm very weird indeed - yes I only edit the forward and...

@lapp0 Apologies on the delay! Ok weird so it might be something related to batching. Weird. Do you know if generation also uses `per_device_batch_size` internally?

Thanks for the investigation - ill take a look!

Sorry on the delay! Can you copy paste ur exact installation instructions here? Also is this Windows / Linux?

Great!

@yakov-rakhlin What is your python version?

@yakov-rakhlin How about ```python pip install -U xformers --index-url https://download.pytorch.org/whl/cu121 pip install "unsloth[kaggle-new] @ git+https://github.com/unslothai/unsloth.git" ```

@yakov-rakhlin That's extremely weird - Colab works fine right? Windows / Linux?

@taghizad3h Very weird - so new pip versions don't work? @yakov-rakhlin Could you try doing `pip install --upgrade pip` then try, and if that does not work, try `pip install...