airllm icon indicating copy to clipboard operation
airllm copied to clipboard
verified publisher icon lyogavin

Data Parallel across multiple GPUs?

Open Codys12 opened this issue 1 year ago • 0 comments

Is it possible to initialize a model in data parallel and stream one layer to multiple GPUs for high batch sizes?

Codys12 avatar Aug 04 '24 14:08 Codys12