Yixin Dong

icon indicating an email [email protected]

icon company Carnegie Mellon University icon location Pittsburgh icon location In the dark I hear the night birds call —

Results 3 issues of Yixin Dong

[Tracking Issue] Relax Training M0

2 comment

There has been increased interest from the community in using TVM for training. Relax, the next generation graph level IR of TVM, also faces the demand of training model. We...

feat: Support Spec V2 + Constrained Decoding

10 comment

This PR supports enabling constrained decoding and Speculative decoding v2 at the same time, resolving #13019. Signed-off-by: Ubospica cc @merrymercy @hnyls2002 @jiapingW ## Motivation ## Modifications ## Accuracy Tests ##...

[Packaging] Remove hf dependency and add py.typed

This PR removes huggingface as dependency. It also adds a py.typed file to enable type checking for callers. Signed-off-by: Ubospica