Fridah-nv
Fridah-nv
update support matrix and add toggle list
**Overview** 1. new transformation to unfuse `qkv_gemm` and `gate_up_proj` to standardize exported graph and apply later transformations 2. Patch Phi-3 Model init issue with HF AutoModelForCausalLM **Testing** 1. unit test...
- [X] tests for flashinfer rope op mapping to current rope implementation - [ ] pattern matching rope in graph and map to flashinfer op - [ ] late fusion...
## Description 1. An example of using torch._inductor.pattern_matcher to match RoPE with explicit cos/sin pattern 2. Wrap up in utility file ## Test Coverage ## GitHub Bot Help `/bot [-h]...
## Description Add an unit test as small build example for Llama4 MultiModal Model. Demonstrates 1. processing image and test inputs with `AutoProcessor.apply_chat_template()` 2. using `torch.cond` to accept both text+image...