mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

Published 20 hours ago • verified publisher icon EricLBuehler

Intermediate loading of ISQ models on CPU

Open EricLBuehler opened this issue 9 months ago • 0 comments

This will allow loading very large models onto the CPU and then applying ISQ onto the device.

EricLBuehler avatar Apr 26 '24 19:04 EricLBuehler