Add Speculative Decoding Support for LLM under Cloud-Edge Collaborative Scenario

Open FuryMartin opened this issue 11 months ago • 1 comments

What type of PR is this?

/kind feature

What this PR does / why we need it:

Implementation for #156

Which issue(s) this PR fixes:

Fixes #156

Jan 16 '25 08:01 FuryMartin

/lgtm

Apr 17 '25 09:04 tangming1996

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: hsj576, MooreZheng

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

Apr 17 '25 14:04 kubeedge-bot