Damian Kalinowski
Damian Kalinowski
### ๐ Summary CVS-149701 ### ๐งช Checklist - [x] Unit tests added. - [x] The documentation updated. - [x] Change follows security best practices.
### ๐ Summary CVS-146231 ### ๐งช Checklist - [x] Unit tests added. - not needed - [x] The documentation updated. - not needed - [x] Change follows security best practices.
### ๐ Summary Build with custom tokenizer ### ๐งช Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security best practices.
### ๐ Summary Fixed issue with make-s3-upload target which deleted the repo after pushing artefacts. No priviliged user had no access to out directory (created by docker user) which caused...
### ๐ Summary CVS-148009 ### ๐งช Checklist - [x] Change follows security best practices.
As requested in https://github.com/openvinotoolkit/openvino.genai/pull/2113#issuecomment-2859299077
Increased number of infer requests for each model Added a way to select infer request by `request_idx` Added GenerationRequest class to manage assignment of `request_idx`
**Describe the bug** In our project we use Drogon for HTTP response streaming. However, when client includes `connection` header that is not `keep-alive`, response stream is immediaitely closed. Source code:...
**Describe the bug** There is segfault when the server is closed using `::quit()` and then restarted using `::run()`. GDB: ``` [New Thread 0x7fffda5d7640 (LWP 210860)] [New Thread 0x7fffd9dd6640 (LWP 210861)]...