Implement audio/video streaming

[cabal-club]

Implement audio/video streaming

[okdistribute]

Awesome idea!

I think there are a couple different user affordances here...

1. persistent audio and/or video chats... this is great for accessibility! We could limit the size if we wanted to, also, similar to WhatsApp/Signal voice messages. This would be well implemented in the same feed as images, for example as a separate content hypercore, how hyperdrive works.
2. live audio/video chats... this is could be implemented as a webrtc hook for ephemeral audio/video without needing a separate hypercore, but the chat message could still be in the chat feed as chat/live, and with the metadata necessary to join the live chatroom.

[garbados]

Per #15 (comment) I suggest the use of two new message types: chat/video and chat/audio. Each links to a hypercore into which is being streamed a media feed, such as someone's webcam or microphone. When the writer of this feed is online, the feed is considered online -- that is, if I am peering a hypercore of my mic, a cabal client might display a mic or headset next to my name, indicating that I am listening to the channel's aggregate audio feeds.

I am not well-versed enough in audio and video streaming to outline a robust message schema with appropriate annotation for the involved media. At this point I can only say, confidently, that it is possible.

[hackergrrl]

This would be very cool.

I think it could make sense to split this off from core cabal: a peer-to-peer video & audio chat platform would be very useful in a variety of contexts, even outside of cabal. From there, the question would be how cabal wants to integrate with it, which could be very simple chat/meeting messages that indicate an AV room's existence, or even the beginning & end of a time-specific call.

[garbados]

Fair point. I'll see what I can do @noffle

[okdistribute]

Yeah @noffle this is what I was thinking too for #2 -- webrtc seems like a good first start for the Desktop app -- is it available in Electron already?

I do think #1 would be super useful as well (but could be accomplished with filesharing in cabal, so perhaps is not related to live meetings)

[hackergrrl]

Oh sorry @okdistribute I somehow missed your comments where you basically said the same stuff. >__<