cccclai

icon indicating an email [email protected]

icon company Facebook icon location Chen Lai

Results 217 comments of cccclai

Enable padding for quantization

Close stale PR

Identify builds with kv cache

Close stale PR

Add options for embedding quantization: bitwidth, group_size on CLI

Closing stale PR

Remove padding from Linear,supported by quantization

Close stale PR

Update int 4 flow for consistency

Close stale PR

Allow bento to see the ops library

Close stale PR

op_embedding improvements

Closing stale PR

Partial embedding group support

Close stale PR

_h -> _fp16

Close stale PR

Quantization support for groupwise embedding, various fp16 support

Close stale PR