qlora icon indicating copy to clipboard operation
qlora copied to clipboard

Is this just the example not clear? Value of max_memory in README example.

Open linuxmagic-mp opened this issue 1 year ago • 0 comments

max_memory=max_memory,

NameError: name 'max_memory' is not defined

For testing, running on a smaller machine, 128GB, 48GB GPU ram Maybe the example could use a suggestion eg...

max_memory={0: "44GiB", "cpu": "110GiB"})

linuxmagic-mp avatar May 26 '23 17:05 linuxmagic-mp