TianTengya comments

Repositories
Issues
Comments

Results 3 comments of


                                            TianTengya

Exception: module 'triton' has no attribute 'set_allocator'

There seems to be an error with the Triton version. Try temporarily checking out commit f7316fc5c98c786ecc83013bba09eaa9b6e8c597.

Is Prefill-Decode disaggregation supported in AIbrix

I didn't find the description of PD disaggregation, too

Is Prefill-Decode disaggregation supported in AIbrix

https://aibrix.github.io/posts/2025-02-20-vllm-control-plane/ It seems that the Prefill & Decode (P&D) disaggregation is a future work. “Building the Future of Scalable AI with AIBrix Moving forward, we plan to continue exploring the...