agents

agents copied to clipboard

feat(Azure STT): add an option to use the lexical form of the transcription

1

This PR introduces optional support for returning Azure Speech-to-Text results in lexical format. ✨ **What’s new** - A new flag has been added to STTOptions to control whether the Azure...

tarekasishm

- Update the user speech start time to include the VAD speech duration; - Audio capture in output is now synced with the audio source capture, based on @longcw's PR...

chenghao-mou

theomonnom

Properly handle Gemini thought summaries and export them via OpenTelemetry in Google LLM plugin

4

### Bug Description Gemini’s API provides thought summaries when include_thoughts=true is enabled. These appear in content.parts with the part.thought flag set and must be handled separately from normal answer text....

giovaborgogno

chenghao-mou

### Bug Description ## Description When using the `livekit-plugins-noise-cancellation` plugin with LiveKit Cloud, the audio filter fails to initialize with the following error: livekit_ffi::server::audio_stream:123:livekit_ffi::server::audio_stream - failed to initialize the audio...

rafallezanko

Getting so many `opentelemetry.attributes` warning in logs

3

### Bug Description Getting so many logs regarding the below message. What could be the reason? ``` 2025-12-23T02:17:17.816157521Z stdout F {"level": "WARNING", "name": "opentelemetry.attributes", "message": "Attribute websocket: Invalid type ClientConnection...

sagorbrur

Google Realtime API fails with MCP tools due to $schema field in parameters

2

### Bug Description The `to_fnc_ctx` function in `livekit/plugins/google/utils.py` only uses `_GeminiJsonSchema.simplify()` for regular `FunctionTool` definitions, but not for `RawFunctionTool` definitions (which MCP tools use). For context, I have an MCP...

muhammadkhalid-03

Add google stt voice activity timeout

1

# Add VoiceActivityTimeout support to Google STT V2 Adds timeout controls for speech detection in Google STT. ## What's new Two new parameters to control turn detection timing: - `speech_start_timeout`...

AhmadIbrahiim

PREFLIGHT_TRANSCRIPT STT support to SpeechMatics plugin

1

### Feature Type Would make my life easier ### Feature Description The current LiveKit Speechmatics plugin does not emit `PREFLIGHT_TRANSCRIPT` events, which prevents preemptive generation feature from working & Adaptive...

deanihansen