intel-extension-for-transformers icon indicating copy to clipboard operation
intel-extension-for-transformers copied to clipboard

Published 20 hours ago • verified publisher icon intel

[NeuralChat] Support user management in backend server

Open lvliang-intel opened this issue 1 year ago • 2 comments
trafficstars

Type of Change

feature API not changed

Description

Support user management in backend server

Expected Behavior & Potential Risk

Support user management in backend server

How has this PR been tested?

Local test and pre-CI test.

Dependency Change?

None

lvliang-intel avatar Dec 17 '23 14:12 lvliang-intel

Let's take a look how vLLM and TGI supports. we can leverage them and add what we need if missing.

hshen14 avatar Dec 25 '23 23:12 hshen14

Let's take a look how vLLM and TGI supports. we can leverage them and add what we need if missing.

They are serving framework, so they don't support user management.

lvliang-intel avatar Jan 25 '24 08:01 lvliang-intel