lightllm icon indicating copy to clipboard operation
lightllm copied to clipboard

where can I find `lightllm_constraint_decode_kernel`?

Open Gompyn opened this issue 4 months ago • 1 comments

The $\text{Pre}^3$ branch (https://github.com/ModelTC/LightLLM/tree/pre3-integrated) requires package lightllm_constraint_decode_kernel to run. However, I cannot find this package from the repositories in this organization. Is there any open-source implementation of $\text{Pre}^3$ that is ready for anyone to reproduce the results in the paper? Thanks!

Gompyn avatar Aug 15 '25 17:08 Gompyn

Thank you for your interest in our work, and we apologize for the inconvenience. The lightllm_constraint_decode_kernel is currently part of our larger, private kernel base here at SenseTime. We're in the process of separating it and will push the update directly to the branch in next few days.

flyinglandlord avatar Aug 20 '25 06:08 flyinglandlord