Yaliang Wu

Seems model input `text_inputs` could be array of string or just a string. My test is using array of string. @tiagoshin Since you are using string , you can follow...

> Please also consider the use-case of asymmetric embedding models (e.g. https://huggingface.co/intfloat/multilingual-e5-small). These models require the content to be embedded to be prefixed by "signal strings" that give the model...

@asfoorial Thanks for cutting this issue. We are thinking about similar thing to support more models. For your use case, do you seem any concern for deploying model outside of...

> OpenSearch seems to be limited to only OpenAI and Amazon LLM services. Actually that's not the case, the connector framework can support any external hosted models if they support...

> @ylwu-amzn , how can I connect my self-hosted LLMs to OpenSearch? glad to hear from you asap. thx. One possible solution is you create some load balancer in front...

@whittssg It's this code which limits we can't use private IP https://github.com/opensearch-project/ml-commons/blob/main/ml-algorithms/src/main/java/org/opensearch/ml/engine/httpclient/MLHttpClientFactory.java#L76 This is mainly for security concern. For example, if you have OpenSearch service and your other private internal...

@whittssg , I haven't verified this idea, but it should theoretically work if you have a DNS or a load balancer set up in front of your model service. Don't...

We had a discussion with security guys, they are ok to add a setting for allowing private IP. So user can control whether enable it or not. The setting should...

@MonkeyKing-KK , It will be in 2.15. https://opensearch.org/releases.html

> @ylwu-amzn haven't seen changes and 2.15. is planned to be released this week. any update? The PR is out https://github.com/opensearch-project/ml-commons/pull/2534