lwinhong

Results 5 issues of lwinhong

sess_megatron.py 这个类中,如果要改成可多并发而且是流式输出的应该怎么写 看到def run_infer()函数有一个while True: 循环收集数据

![image](https://user-images.githubusercontent.com/31954501/127837050-1853d0b5-6ff6-444b-81b1-44a0ccd93ca9.png) ![image](https://user-images.githubusercontent.com/31954501/127837221-8f6a65ca-359f-4be3-b536-f78d65de106f.png) 我现在是4.0的项目,准备升4.8,用Npdinfo来检查环境 我的环境是win10 2021 21H1 版本。默认自带4.8 ![image](https://user-images.githubusercontent.com/31954501/127837484-41723750-e239-4633-892a-09c28e0f5140.png)

``` Python #流式输出事件生成器 async def chat_stream_event_generator(request: Request, chatStream): for chunck in chatStream: try: if await request.is_disconnected(): print("连接已中断") break start_time = time.time() print(f"{start_time}->{chunck[0]}") yield chunck[0] print(f"{start_time}->写入完成") except (BrokenPipeError, ConnectionResetError) as e:...

本地服务。代码补全、代码注释、代码解析等的prompt要怎么写

# Summary web\app\components\workflow\nodes\llm\panel.tsx , The workflow page cannot be opened due to the failure to introduce useCallback > [!Tip] > Close issue syntax: `Fixes #` or `Resolves #`, see [documentation](https://docs.github.com/en/issues/tracking-your-work-with-issues/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword)...

size:XS
☕️ typescript