Anker

Results 2 issues of Anker

How would I go about running the inference script with multiple GPU's? Currently, it's maxing out my one A10 but have four, so want it to run in parallel, but...

Is there a way to set the number of layers, if not what is the default?