planetary-ios icon indicating copy to clipboard operation
planetary-ios copied to clipboard

Add support for playing audio and video blobs

Open rabble opened this issue 1 year ago • 5 comments

Scuttlebutt clients post audio and video files as blob attachments and can view them. Right now planetary says it's an unsupported format. Adding the ability to post and listen to both would feel like a big enhancement but probably isn't that much work.

The main thing is figuring out where to display those in relation to the post and image gallery. Then picking some existing player / viewer code for displaying the media types.

One option would be just to open a webkit browser window displaying blobs that aren't images. That'd be very simple.

rabble avatar Jul 12 '22 18:07 rabble

@rabble to chat w/ @martindsq

danlatorre avatar Nov 21 '22 21:11 danlatorre

@martindsq what is the status of this? We talked about using an image viewer that also supported audio / video

rabble avatar Nov 21 '22 21:11 rabble

We need UX outcomes consideration about how ongoing storage of video will affect UX: does video need to be down rez'd to a be more disk space efficient? do we set a limit on duration of video? replication rules? replication impacts to users? cloud hosted only inline display of videos? 3rd party white label integration of video processing and hosting?

danlatorre avatar Dec 16 '22 15:12 danlatorre

Current status on this: there is some WIP code to display video blobs pushed up to the branch Add_support_for_playing_audio_video_blobs_2. It is proving difficult to get the AVFoundation library to guess video format and codecs, but there are several solutions to try going forward. Also all our blob-related code assumes that all blobs are images, so there is some significant refactoring left to do there as well.

Probably this should be split into two tickets: one for displaying audio and video and one for posting it, as they are very separate and each challenging in its own way.

mplorentz avatar Dec 23 '22 20:12 mplorentz

We are repurposing this ticket to be just for displaying audio and video blobs.

mplorentz avatar Jan 02 '23 20:01 mplorentz