Adding SambaNova models for blazing fast inference speeds

[snova-varunkrishna]

Hi, I would like to request that SambaNova models be added to the model catalog so users can run the best open source models at the highest speeds with AI Toolkit. It is possible using a custom url, but we would like to include them in the catalog to make it easier. Please let me know what's needed to add them to the catalog.

[microsoft-github-policy-service[bot]]

Thank you for contacting us! Any issue or feedback from you is quite important to us. We will do our best to fully respond to your issue as soon as possible. Sometimes additional investigations may be needed, we will usually get back to you within 2 days by adding comments to this issue. Please stay tuned.

[MuyangAmigo]

Hi, I would like to request that SambaNova models be added to the model catalog so users can run the best open source models at the highest speeds with AI Toolkit. It is possible using a custom url, but we would like to include them in the catalog to make it easier. Please let me know what's needed to add them to the catalog.

Hi @snova-varunkrishna Thank you for reaching out. We will track this request in our backlog.

Meanwhile do you have alternative models you can use for now in AI Toolkit?