lwinhong
lwinhong
sess_megatron.py 这个类中,如果要改成可多并发而且是流式输出的应该怎么写 看到def run_infer()函数有一个while True: 循环收集数据
  我现在是4.0的项目,准备升4.8,用Npdinfo来检查环境 我的环境是win10 2021 21H1 版本。默认自带4.8 
``` Python #流式输出事件生成器 async def chat_stream_event_generator(request: Request, chatStream): for chunck in chatStream: try: if await request.is_disconnected(): print("连接已中断") break start_time = time.time() print(f"{start_time}->{chunck[0]}") yield chunck[0] print(f"{start_time}->写入完成") except (BrokenPipeError, ConnectionResetError) as e:...
本地服务。代码补全、代码注释、代码解析等的prompt要怎么写
# Summary web\app\components\workflow\nodes\llm\panel.tsx , The workflow page cannot be opened due to the failure to introduce useCallback > [!Tip] > Close issue syntax: `Fixes #` or `Resolves #`, see [documentation](https://docs.github.com/en/issues/tracking-your-work-with-issues/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword)...