Yuxi-Know icon indicating copy to clipboard operation
Yuxi-Know copied to clipboard

Feat: docker部署没有问题,但回答问题非常慢

Open HOTHOTCOOLCOOL opened this issue 4 months ago • 2 comments

#️⃣ 您的功能请求是否与某个问题相关?请描述。

#️⃣ 描述您期望的解决方案

#️⃣ 附加背景信息

HOTHOTCOOLCOOL avatar Oct 21 '25 09:10 HOTHOTCOOLCOOL

具体描述一下呢?

xerrors avatar Oct 21 '25 15:10 xerrors

整个集成没有问题,Linux上挂docker安装顺利。inference 我用lmstudio,缺点没有ranker ,我后面会外挂。LLM是Q3-30B,每秒token做到65个,所以理论上不是太大问题。我用lightrag挂了11个整理好的Json,大致在3m以内。我用查询功能,如果针对一个JSON文件提问大致是5分钟返回,跨JSON文档在10分钟左右。看lmstudio后台有很多请求排队,因为lmstudio是单线程,不晓得你们在其他环境是否有类似情况。

获取Outlook for Androidhttps://aka.ms/AAb9ysg


From: Wenjie Zhang @.> Sent: Tuesday, October 21, 2025 11:56:02 PM To: xerrors/Yuxi-Know @.> Cc: HOTHOTCOOLCOOL @.>; Author @.> Subject: Re: [xerrors/Yuxi-Know] Feat: docker部署没有问题,但回答问题非常慢 (Issue #305)

[https://avatars.githubusercontent.com/u/35524243?s=20&v=4]xerrors left a comment (xerrors/Yuxi-Know#305)https://github.com/xerrors/Yuxi-Know/issues/305#issuecomment-3427384539

具体描述一下呢?

― Reply to this email directly, view it on GitHubhttps://github.com/xerrors/Yuxi-Know/issues/305#issuecomment-3427384539, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A525ONXSPIMWAEJBXJ3RLF33YZJRFAVCNFSM6AAAAACJYRBD46VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTIMRXGM4DINJTHE. You are receiving this because you authored the thread.Message ID: @.***>

HOTHOTCOOLCOOL avatar Oct 22 '25 01:10 HOTHOTCOOLCOOL