fsdp_qlora issues

ProcessExitedException: process 0 (2x 4090)

39

I'm trying what looks like the "Hello World" of this repo: Running the basic training on a Runpod community cloud `2 x RTX 4090, (128 vCPU 125 GB RAM)` configuration....

Pugio

Running into CUDA out of memory with hqq_lora

## Setup: I have 1x3090 and 1x4090 and I'm trying to follow the instructions in README.md to fine tune using HQQ but running into CUDA out of memory error ```shell...

zabirauf

Update README.md

Spelling fixes

Xorlent

NCCL issue training with two GPUs

2

I ran into this issue (https://github.com/NVIDIA/nccl/issues/1125) when trying to replicate the instructions from the README. Since the blog posts mentions that the training was done on two GPUs is there...

deepankarsharma

Drop trailing slash from last line in command prompts for easier copy…

Minor edit to README to improve copy pasting of the command prompts.

deepankarsharma

fix typo in readme

1

Small fix in Readme.

danromuald

RuntimeError: An attempt has been made to start a new process before the current process has finished its bootstrapping phase

3

Hello everyone! First, thank you for this implementation! Unfortunately I have an issue with running this, `RuntimeError: An attempt has been made to start a new process before the current...

geronimi73

Fine tuning only runs on CPU

4

Hello, I am running this on a few 2X 4090 cloud instances on Vast to test and benchmark. Most machines work without issues, however sometimes I have noticed on certain...

diabeticpilot