DHughesEquinox comments

Repositories
Issues
Comments

Results 2 comments of


                                            DHughesEquinox

[Question]: what base URL should be used when using Xinference to deploy local models

derppp. this is dead in the water if we cant connect to local LLMs, i have had no luck with Olama or LM Studio tried everything under the sun.

[Question]: what base URL should be used when using Xinference to deploy local models

None from me, I looked hard atthe code. Doesn't seems to exist in the back end for connecting to LM Studio. And no luck with olama. It's a shame. Had...