mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

Published 20 hours ago • verified publisher icon EricLBuehler

Sliding window for phi3

Open EricLBuehler opened this issue 9 months ago • 1 comments

EricLBuehler avatar Apr 29 '24 01:04 EricLBuehler

Code Metrics Report 
  ───────────────────────────────────────────────────────────────────────────────
Language                 Files     Lines   Blanks  Comments     Code Complexity
───────────────────────────────────────────────────────────────────────────────
Rust                        70     23374     1555       508    21311       1289
───────────────────────────────────────────────────────────────────────────────
Total                       70     23374     1555       508    21311       1289
───────────────────────────────────────────────────────────────────────────────
Estimated Cost to Develop 70,856
Estimated Schedule Effort 11.817707 months
Estimated People Required 5.043268
───────────────────────────────────────────────────────────────────────────────
Processed 769936 bytes, 0.770 megabytes (SI)
───────────────────────────────────────────────────────────────────────────────

github-actions[bot] avatar Apr 29 '24 01:04 github-actions[bot]

It looks like this issue is because of losing precision on long context windows: https://github.com/huggingface/transformers/pull/29285

EricLBuehler avatar Apr 29 '24 10:04 EricLBuehler