aphrodite-engine icon indicating copy to clipboard operation
aphrodite-engine copied to clipboard

[Usage]: native nvlink support or not agnostic to mobo

Open puppetm4st3r opened this issue 1 year ago • 1 comments

Your current environment

running isolated on docker container

How would you like to use Aphrodite?

I have the following question,

currently nvlink support on new motherboards that are not high enterprise/server grade has been discarded, but some inference artifacts like llama cpp can run p2p thru the nvlink bridge event when the mobo did not officially supported, Aphrodite engine needs a mobo/chipset with official nvlink support?, or has its own kernel/implementation for nvlink / p2p agnostic to the mobo/chipset, I have 2 3090's in a new brand asus 4 pcie 16x ports, but the mobo did not support nvlink.

regards!

puppetm4st3r avatar Jun 20 '24 05:06 puppetm4st3r

I believe our p2p detection has improved as of v0.6.0. Can you try again?

AlpinDale avatar Sep 03 '24 13:09 AlpinDale