FastDeploy
FastDeploy copied to clipboard
[XPU] modify speculate_verify
Motivation
modify speculate_verify
Modifications
modify speculate_verify
Usage or Command
No
Accuracy Tests
Passed.
Checklist
- [ ] Add at least a tag in the PR title.
- Tag list: [
[FDConfig],[APIServer],[Engine],[Scheduler],[PD Disaggregation],[Executor],[Graph Optimization],[Speculative Decoding],[RL],[Models],[Quantization],[Loader],[OP],[KVCache],[DataProcessor],[BugFix],[Docs],[CI],[Optimization],[Feature],[Benchmark],[Others],[XPU],[HPU],[GCU],[DCU],[Iluvatar],[Metax]] - You can add new tags based on the PR content, but the semantics must be clear.
- Tag list: [
- [ ] Format your code, run
pre-commitbefore commit. - [ ] Add unit tests. Please write the reason in this PR if no unit tests.
- [ ] Provide accuracy results.
- [ ] If the current PR is submitting to the
releasebranch, make sure the PR has been submitted to thedevelopbranch, then cherry-pick it to thereleasebranch with the[Cherry-Pick]PR tag.
Thanks for your contribution!
Codecov Report
:x: Patch coverage is 50.00000% with 2 lines in your changes missing coverage. Please review.
:warning: Please upload report for BASE (develop@4f830aa). Learn more about missing BASE report.
| Files with missing lines | Patch % | Lines |
|---|---|---|
| fastdeploy/model_executor/layers/sample/sampler.py | 50.00% | 2 Missing :warning: |
Additional details and impacted files
@@ Coverage Diff @@
## develop #5522 +/- ##
==========================================
Coverage ? 64.57%
==========================================
Files ? 329
Lines ? 41781
Branches ? 6396
==========================================
Hits ? 26978
Misses ? 12757
Partials ? 2046
| Flag | Coverage Δ | |
|---|---|---|
| GPU | 64.57% <50.00%> (?) |
Flags with carried forward coverage won't be shown. Click here to find out more.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
:rocket: New features to boost your workflow:
- :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.