agents icon indicating copy to clipboard operation
agents copied to clipboard
Published 1 week ago • verified publisher icon livekit

[WIP] Add response_format to OpenAI based LLMs

Open martin-purplefish opened this issue 1 year ago • 3 comments

Fixes #689

  • [ ] Support tool calls

martin-purplefish avatar Oct 18 '24 13:10 martin-purplefish

🦋 Changeset detected

Latest commit: 15feab78278e9597c7d5b9c40be7cdbe82288665

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
livekit-plugins-openai Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

changeset-bot[bot] avatar Oct 18 '24 13:10 changeset-bot[bot]

@martin-purplefish Streaming will not be supported if we provide response formant

jayeshp19 avatar Oct 18 '24 13:10 jayeshp19

@jayeshp19 nice call - updated. This works now, but it's quite slow (a few seconds for the response)

martin-purplefish avatar Oct 18 '24 14:10 martin-purplefish