wit icon indicating copy to clipboard operation
wit copied to clipboard

Increase rate limit?

Open bfavero opened this issue 4 years ago • 5 comments

Do you want to request a feature, report a bug, or ask a question about wit? Hi, is there a way to apply for a higher rate limit?

bfavero avatar Dec 07 '21 15:12 bfavero

Can you share the Wit app ID? And what is the higher rate limit that you are looking for?

ChrisyShine avatar Dec 08 '21 21:12 ChrisyShine

Sure, the id is 1405971863131969. I'm developing an app for journalists that includes an asynchronous transcription tool (that uses Wit.ai's engine), so it makes quite a lot of requests. I'd say that ideally, we'd need around 4800 requests per minute to be able to have some scale.

On Wed, Dec 8, 2021 at 6:00 PM Christina Zheng @.***> wrote:

Can you share the Wit app ID? And what is the higher rate limit that you are looking for?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/wit-ai/wit/issues/2271#issuecomment-989191392, or unsubscribe https://github.com/notifications/unsubscribe-auth/APJOO4RKJBVXAE757UAQNNDUP7BQDANCNFSM5JRQEDBA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

bfavero avatar Dec 08 '21 22:12 bfavero

Hi @bfavero, this is quite a lot of requests. It looks like you're only using ASR, not NLU. Let's see if we can carve out a better endpoint for this. In the meantime, let's scale up gradually - can you ramp up traffic to 60 requests per minute to start with?

patapizza avatar Dec 09 '21 17:12 patapizza

Hi @patapizza, thanks for your reply! Yes, that's right, I'm only using ASR.

To be clear, the use of the API would be intermittent, I wouldn't be such a high number of requests often.

The problem I have is that I'm using Wit to transcribe long-ish audio files and I'd like for my app to transcribe at a 10:1 speed (10 minutes of speech in one minute). I split the audio files into 20s chunks and send them through Wit's API. So for a 1-hour-long audio file, for example, I use at least 180 requests.

I haven't launched the app yet, so the API limit hasn't been a problem. My fear is that, once I launch it, transcription will get really slow very quickly. For example, if I receive 1-hour-long files from ten different users to process at the same time, the app would take at least 30 minutes to finish transcribing them.

Anyway, sorry for the long reply, and thanks for your help, I'm happy to scale up gradually.

bfavero avatar Dec 09 '21 18:12 bfavero

Thanks for the added context. It indeed looks like a new endpoint would better support your use case.

patapizza avatar Dec 14 '21 22:12 patapizza

Please use the our /dictation endpoint. Thanks.

ramh avatar May 18 '23 18:05 ramh