tf-metal-experiments icon indicating copy to clipboard operation
tf-metal-experiments copied to clipboard

High Power Mode

Open TortoiseHam opened this issue 2 years ago • 5 comments

Just out of curiosity, are you able to use the 'high power mode' to get around the apparent 40W limit?

https://www.macrumors.com/2021/10/22/high-power-mode-16-inch-macbook-pro-m1-max/

TortoiseHam avatar Oct 26 '21 20:10 TortoiseHam

Will test it soon and update. I am not expecting much of a difference however.

tlkh avatar Oct 27 '21 08:10 tlkh

Awesome, thanks for posting this info :)

TortoiseHam avatar Oct 27 '21 15:10 TortoiseHam

Update: it doesn't seem to affect the measured results, updated the README

tlkh avatar Oct 27 '21 16:10 tlkh

Huh. Bummer. Good to know though. I wonder if this gap can be closed at all by future metal driver updates... the perf/watt is pretty competitive at least

TortoiseHam avatar Oct 28 '21 01:10 TortoiseHam

Actually, this IS pretty good, considering the 3090 has Tensor Core which in theory gives it a much larger performance advantage, while the M1 seems to be using normal shader cores. I do think if we lower the 3090 power limit to a “Max-Q” setting and tune the batch size, we will see better efficient on 3090 as well.

tlkh avatar Oct 28 '21 01:10 tlkh