lightllm
lightllm copied to clipboard
where can I find `lightllm_constraint_decode_kernel`?
The $\text{Pre}^3$ branch (https://github.com/ModelTC/LightLLM/tree/pre3-integrated) requires package lightllm_constraint_decode_kernel to run. However, I cannot find this package from the repositories in this organization. Is there any open-source implementation of $\text{Pre}^3$ that is ready for anyone to reproduce the results in the paper? Thanks!
Thank you for your interest in our work, and we apologize for the inconvenience.
The lightllm_constraint_decode_kernel is currently part of our larger, private kernel base here at SenseTime. We're in the process of separating it and will push the update directly to the branch in next few days.