assistant-sdk-python icon indicating copy to clipboard operation
assistant-sdk-python copied to clipboard

Published 20 hours ago • verified publisher icon googlesamples

Support of Media Responses

Open hyzhak opened this issue 6 years ago • 15 comments

I'm working right now on action which uses Media Responses (https://github.com/internetarchive/internet-archive-google-action) and would like to use my AIY Voice kit here. But AIY responses that it doesn't support Media Response. Is there any plan to support Media Response in this SDK? https://developers.google.com/actions/assistant/responses#media_responses Could I expect it in near future?

hyzhak avatar Mar 12 '18 14:03 hyzhak

Yeah the APIs in the SDK don't support media right now. Thanks for the feedback.

Fleker avatar Mar 12 '18 18:03 Fleker

You are welcomed! Could I expect it on DIY device soon or give up all hope?

hyzhak avatar Mar 12 '18 22:03 hyzhak

It's something I'd like to support, although I don't have a specific date for when it'd be ready.

Fleker avatar Mar 12 '18 23:03 Fleker

Great! Thanks :)

hyzhak avatar Mar 12 '18 23:03 hyzhak

Hi there! What's news? Is there any chance to see this feature soon?

hyzhak avatar Apr 08 '18 06:04 hyzhak

I do not have an update today.

Fleker avatar Apr 09 '18 19:04 Fleker

Hi, I have the same feature request too, thanks

fdambrosio avatar Apr 10 '18 12:04 fdambrosio

The library now supports playback of news & podcasts.

Fleker avatar May 08 '18 21:05 Fleker

@Fleker Cool! Does it mean that we can use Media Response for playing random audio files?

hyzhak avatar May 08 '18 22:05 hyzhak

You'll be able to say something like "Hey Google, play This American Life" and get the podcast.

For playing random audio files, it would be better to use a custom device action so that "Play random audio files" would get received and you would then handle that by playing a random audio file.

Fleker avatar May 08 '18 22:05 Fleker

@Fleker sure, we are developing custom device action for Internet Archvie but recently I couldn't send Media Response, because Assistant SDK (and AIY Voice in particular) didn't support Media Responses. In other words:

conv.surface.capabilities.has('actions.capability.MEDIA_OUTPUT') === false

Can I use them after the last update?

hyzhak avatar May 09 '18 07:05 hyzhak

Honestly I have not tried AoG with the library yet. If you set up the Conversation Components sample, you may be able to run it, ask for media, and see what happens.

Fleker avatar May 09 '18 20:05 Fleker

Did you ever see if this works?

Fleker avatar Sep 15 '18 22:09 Fleker

@Fleker I have asked Google AIY team to update their software to fetch new version of Assistant SDK https://github.com/google/aiyprojects-raspbian/issues/304. so let see, will it help or not.

hyzhak avatar Oct 16 '18 14:10 hyzhak

hi @Fleker I'm also interested in getting media responses within the assistant sdk. Are there any news related to that?

dmarvp avatar Dec 26 '19 22:12 dmarvp