semantic-kernel icon indicating copy to clipboard operation
semantic-kernel copied to clipboard

Introducing Connectors.AI.HuggingFace Package

Open shawncal opened this issue 1 year ago • 1 comments

Description

In an effort to slim down SemanticKernel.Core and standardize around the Connectors.AI packaging pattern, we're moving the Connectors.HuggingFace calls into their own Connectors.AI.HuggingFace nuget package, which will be an optional reference.

This is a code move and repackaging only -- no new functionality.

Contribution Checklist

  • [X] The code builds clean without any errors or warnings
  • [X] The PR follows SK Contribution Guidelines (https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
  • [X] The code follows the .NET coding conventions (https://learn.microsoft.com/dotnet/csharp/fundamentals/coding-style/coding-conventions) verified with dotnet format
  • [X] All unit tests pass, and I have added new tests where possible
  • [X] I didn't break anyone :smile:

shawncal avatar May 09 '23 19:05 shawncal

This connector currently only connects to models running on the local Hugging Face python server. With some minor updates, it will be able to point to Hugging Face hosted models.

Actually, text completion works with HF hosted models as well, in case you don't pass endpoint to your local endpoint in constructor, it will use endpoint of hosted model by default (https://api-inference.huggingface.co/models) 😃 image

Awesome! Description updated.

dmytrostruk avatar May 09 '23 23:05 dmytrostruk