aphrodite-engine
aphrodite-engine copied to clipboard
[Usage]: native nvlink support or not agnostic to mobo
Your current environment
running isolated on docker container
How would you like to use Aphrodite?
I have the following question,
currently nvlink support on new motherboards that are not high enterprise/server grade has been discarded, but some inference artifacts like llama cpp can run p2p thru the nvlink bridge event when the mobo did not officially supported, Aphrodite engine needs a mobo/chipset with official nvlink support?, or has its own kernel/implementation for nvlink / p2p agnostic to the mobo/chipset, I have 2 3090's in a new brand asus 4 pcie 16x ports, but the mobo did not support nvlink.
regards!
I believe our p2p detection has improved as of v0.6.0. Can you try again?