ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

Update NPU Llama

Open rnwang04 opened this issue 5 months ago • 0 comments

Description

1. Why the change?

  • Remove some unused code
  • Simplify padded_causal_mask logic, but don't see obvious performance change

2. User API changes

No change.

3. Summary of the change

4. How to test?

  • [ ] Unit test: Please manually trigger the PR Validation here by inputting the PR number (e.g., 1234). And paste your action link here once it has been successfully finished.

rnwang04 avatar Sep 06 '24 03:09 rnwang04