ppl.pmx icon indicating copy to clipboard operation
ppl.pmx copied to clipboard

add llama pipeline parallel

Open Vincent-syr opened this issue 10 months ago • 0 comments

add llama pipeline parallel, do not need to do extra split model. It split tp and pp while loading model

Vincent-syr avatar Apr 01 '24 14:04 Vincent-syr