qlora
qlora copied to clipboard
Is this just the example not clear? Value of max_memory in README example.
max_memory=max_memory,
NameError: name 'max_memory' is not defined
For testing, running on a smaller machine, 128GB, 48GB GPU ram Maybe the example could use a suggestion eg...
max_memory={0: "44GiB", "cpu": "110GiB"})