Audio tracks/audio mixer - planned?

[bbc]

Audio tracks/audio mixer - planned?

[jesperstarkar]

Thank you so much for the work and this great library.

Since our upcoming project won't have much need to audio mixing, I don't think I'll tap into this issue at the moment. But I hope to find other areas to contribute on.

[MatthewShotton]

Hi @jesperstarkar great question. This is something that's come up previously and we don't have a really nice solution to it yet.

You can currently use the WebAudio API with the VideoContext but the integration between the two is a bit awkward. The following is an example of creating a MediaElementAudioSourceNode from a video node:

var canvas = document.getElementById("canvas");
var ctx = new VideoContext(canvas);
var audioContext = new AudioContext();

var videoNode = ctx.video("./video.mp4", 1600);
videoNode.start(0);
videoNode.stop(5);
videoNode.connect(ctx.destination);
videoNode.registerCallback("loaded", ()=>{
    //Wait till the node has loaded so a video element exists.
    var a1 = audioContext.createMediaElementSource(videoNode.element);
    a1.connect(audioContext.destination);
})

ctx.play();

Doing things this way also means you have to create and manage your own cross-fades that follow the transitions of a transition node, which isn't very nice!

I'll have a look at adding in some experimental convenience functions in a future release that hide away some of the complexities. I'll keep this issue up to date with the progress.

[byronmejia]

@MatthewShotton - Do you have any suggestions with where to start researching? I'll be needing to look into audio soon, so might as well see how to commit back to the project rather than doing in house hacks.

[PTaylour]

This is back on our radar now. We'd either like to ease combining videocontext and audiocontext or provide some functionality within the library.

I'm closing this particular issue for now.