jan icon indicating copy to clipboard operation
jan copied to clipboard

Published 20 hours ago • verified publisher icon janhq

idea: connect to another self hosted model with the same JAN ui

Open Steven0706 opened this issue 3 months ago • 1 comments

Problem Statement

I am hosting some model endpoint on one server with good gpu and I want to use it from another laptop/pc, mixed with cloud provider. So I think it will be great if we can easily use the JAN hosted model in another JAN UI with just the ip and port.

Feature Idea

I am hosting some model endpoint on one server with good gpu and I want to use it from another laptop/pc, mixed with cloud provider. So I think it will be great if we can easily use the JAN hosted model in another JAN UI with just the ip and port. I tried use the openai config but the model name cannot be changed easily.

Steven0706 avatar Oct 30 '24 21:10 Steven0706