jan icon indicating copy to clipboard operation
jan copied to clipboard

Published 20 hours ago • verified publisher icon janhq

feat: Get local API server mode to also work for Nitro-TRT-LLM

Open freelerobot opened this issue 1 year ago • 1 comments

freelerobot avatar Mar 15 '24 05:03 freelerobot

As of now, due to our local API server is not functioning with Nitro-TRT-LLM, we are planning to:

  • Temporally disable the local API server x Nitro-TRT-LLM until this feature is implemented.

  • cc: @louis-jan
  • No. 8 in https://github.com/janhq/jan/issues/2323#issuecomment-1997421409

Van-QA avatar Mar 18 '24 04:03 Van-QA