Atoli

Results 1 comments of Atoli

Is it possible to run NF4 checkpoints with LoRA on 12gb VRAM?

> ![image](https://private-user-images.githubusercontent.com/19834515/360020559-52dd6d08-4733-45fa-a36e-efe7408724dd.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQyNjU5MzgsIm5iZiI6MTcyNDI2NTYzOCwicGF0aCI6Ii8xOTgzNDUxNS8zNjAwMjA1NTktNTJkZDZkMDgtNDczMy00NWZhLWEzNmUtZWZlNzQwODcyNGRkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODIxVDE4NDAzOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTVjOWIxYTBkYTZlZWVmYTcyODM2ZTFlZDkwNWFhMTkxNWJkZWM4M2Q4NjUxZGIwYjcyZjJkNmYwZjAzMzI2NzcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.xhyWDiDXkuueKwkrmkSUpe0ouzfIPjcivl5uRC4idSo) I see. The option was already turned on in my system, but i for some reason i have more currently allocated. ![mn](https://github.com/user-attachments/assets/c68f90df-9aa8-4bbe-89e3-ff4cea382ea5) Either way, checking this option didn't...