autogen icon indicating copy to clipboard operation
autogen copied to clipboard
verified publisher icon microsoft

Aiinference

Open Josephrp opened this issue 1 year ago • 1 comments

Why are these changes needed?

This PR introduces a new GithubLLM class to autogen, allowing users to leverage GitHub's inference endpoint with automatic fallback to Azure. It provides a seamless way to use GitHub's LLM capabilities within the autogen ecosystem, handling rate limits and ensuring high availability through Azure fallback.

Related Issues

Contributes to #3300

  • [x] align githubllm with https://github.com/microsoft/autogen/issues/3323#event-13813948342 AzureEndpoint naming and conventions

Checks

  • [ ] I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally.
  • [ ] I've added tests (if relevant) corresponding to the changes introduced in this PR.
  • [ ] I've made sure all auto checks have passed.

Tasks

  • [x] Inference

Josephrp avatar Sep 23 '24 13:09 Josephrp

CHECKLIST (WiP / Help Wanted) :

  • [ ] improve / rename tests
  • [ ] add json / chat completions client

Josephrp avatar Sep 23 '24 13:09 Josephrp

This PR is against AutoGen 0.2. AutoGen 0.2 has been moved to the 0.2 branch. Please rebase your PR on the 0.2 branch or update it to work with the new AutoGen 0.4 that is now in main.

rysweet avatar Oct 10 '24 21:10 rysweet

thanks !

Josephrp avatar Oct 20 '24 10:10 Josephrp

Thanks for the PR, closing as it looks stale and we have this feature in 0.4

jackgerrits avatar Feb 03 '25 18:02 jackgerrits