executorch

executorch copied to clipboard

Identify builds with kv cache

12

Summary: Identify builds with kv cache Differential Revision: D54300827

mikekgfb

Add warning if a seemingly fairseq2 checkpoint is passed to model constructor

8

Summary: Add warning if a seemingly fairseq2 checkpoint is passed to model constructor but --fairseq2 was not specified. (Heuristic.) Differential Revision: D54209318

mikekgfb

Resolve recurring errors where query is c10::Half and key and value float

3

Summary: Resolve recurring errors where query is c10::Half and key and value float. This should ideally work from first principles, but somehow it does not. We need to fix the...

mikekgfb

Add options for embedding quantization: bitwidth, group_size on CLI

4

Summary: Add options for embedding quantization: bitwidth, group_size on CLI Differential Revision: D54159472

mikekgfb

pow(n,2) => n*n

6

Summary: pow(n,2) => n*n Differential Revision: D54142779

mikekgfb

op_embedding improvements

5

Summary: improvements: asymmetric group size less militant checking out_dtype added Differential Revision: D53990647

mikekgfb

Add debug info to op_embedding

5

Summary: Add debug info to op_embedding Differential Revision: D54047417

mikekgfb

Add embedding op to llama build

5

Summary: Add embedding op to llama build Reviewed By: shoumikhin Differential Revision: D53985792

mikekgfb

op_embedding improvements

9

Summary: improvements: asymmetric group size less militant checking out_dtype added legacy compatibility Differential Revision: D54074895

mikekgfb

Compute size and bleu score for different quantization combinations

4

Summary: Compute size and bleu score for different quantization combinations Reviewed By: mavlyutovr Differential Revision: D53687784

mikekgfb