jan icon indicating copy to clipboard operation
jan copied to clipboard

Published 20 hours ago • verified publisher icon janhq

bug: [API] chat completions

Open LeGitHubDeTai opened this issue 1 year ago • 2 comments

Steps to reproduce Make an API request with the stream mode set to true.

Expected behavior When I make a request to v1/chat/completions with the stream mode set to true, everything works correctly. However, when it is set to false, the computer becomes overloaded, and no response is received from the API (worked in 0.4.4).

Environment details Operating System: Windows 11 Jan Version: 0.4.5 Processor: Intel Core i9 RAM: 64GB Any additional relevant hardware specifics: RTX 3090

LeGitHubDeTai avatar Jan 29 '24 10:01 LeGitHubDeTai

hi @LeGitHubDeTai, sorry for the inconvenience. The issue may be related to this https://github.com/janhq/nitro/issues/391. which we are still working on it.

Van-QA avatar Jan 30 '24 08:01 Van-QA

ow my bad sorry

LeGitHubDeTai avatar Jan 30 '24 10:01 LeGitHubDeTai

hi @LeGitHubDeTai, we resolved the issue, and I tested both UI and the curl with Stream = false ✅ Jan v0.4.5-215 image Feel free to reopen this if the issue persists.

Van-QA avatar Feb 01 '24 02:02 Van-QA

thanks !

LeGitHubDeTai avatar Feb 01 '24 16:02 LeGitHubDeTai