inference icon indicating copy to clipboard operation
inference copied to clipboard
Published 1 month ago • verified publisher icon xorbitsai

support MInference in feature

Open shabooboo86 opened this issue 1 year ago • 4 comments

Feature request / 功能建议

Million-Tokens Prompt Inference for Long-context LLMs，MInference is fast

Motivation / 动机

MInference long-context

Your contribution / 您的贡献

none

shabooboo86 avatar Jul 15 '24 14:07 shabooboo86

Thanks, we will support it ASAP.

qinxuye avatar Jul 16 '24 04:07 qinxuye

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Jul 23 '24 19:07 github-actions[bot]

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Aug 06 '24 06:08 github-actions[bot]

请问，这个有支持了吗现在

linqingxu avatar Sep 29 '24 07:09 linqingxu