pipecat icon indicating copy to clipboard operation
pipecat copied to clipboard
verified publisher icon pipecat-ai

Lagging latency in Aws Nova sonic exmaple

Open JINO-ROHIT opened this issue 7 months ago • 1 comments

pipecat version

0.0.67

Python version

3.12

Operating System

Ubuntu 24

Issue description

Im running the example file here - https://github.com/pipecat-ai/pipecat/blob/main/examples/foundational/40-aws-nova-sonic.py

Im facing very lagging audio from the webrtc example.

Reproduction steps

NA

Expected behavior

NA

Actual behavior

NA

Logs

JINO-ROHIT avatar May 23 '25 08:05 JINO-ROHIT

Tagging @kompfner to take a look.

markbackman avatar May 24 '25 11:05 markbackman

Sorry to hear that! I'm not able to repro this issue on my machine. I can test with 3.12 in a little bit (I'm using 3.13), but in the meantime, a few clarifying questions:

  • By "very lagging audio" do you mean that the bot seems to take a long time to answer after you speak?
  • Does this issue happen consistently or only on occasion?
  • Do you see Assistant response started in your logs well before you hear any audio?
  • What region of the world are testing from? Today us-east-1 is the only AWS region where the Nova Sonic model is supported; I happen to be quite nearby, so I'm wondering if that could account for the difference in response times we're seeing. If that turns out to be the issue then sadly there might not be too much we can do until AWS makes Nova Sonic more widely available.

kompfner avatar May 27 '25 19:05 kompfner

I can test with 3.12 in a little bit

I'm not seeing that 3.12 v 3.13 makes much of a difference.

kompfner avatar May 27 '25 19:05 kompfner