pei0033 issues

Repositories
Issues
Comments

Results 2 issues of


                                            pei0033

feat: Add guided decoding support to OpenAI frontend

#### What does the PR do? This PR adds comprehensive guided decoding support to the OpenAI frontend, enabling users to constrain model outputs to specific formats through the OpenAI-compatible API....

Increasing Discrepancy Between AIMET Simulation and QNN Models with Network Depth

Hello. I've observed a systematic increase in the difference between AIMET quantization simulation results and actual QNN model outputs as the network depth increases. This discrepancy could potentially impact the...