Comments (3)
Based on our experience implementing VideoDecoder in Chromium, @chcunningham and I reviewed these options and we are implementing option D.
- A (replacing streams every time): Replumbing is less elegant than in-band signaling in the cases we considered. Consider a potential app implementation of seeking:
demuxer.readFrom(time).then((config, readable) => {
decoder.configure(config).then(writable => readable.pipeTo(writable));
});
- B (out-of-band with same stream): Buffering is inherent in WritableStream, we cannot reliably synchronize in- and out-of-band signals without replacing streams.
- C (out-of-band with new stream): Basically the same as A.
- D (in-band): Using
preventCancel
andpreventAbort
, the whole pipeline does not need to be torn down on failure. Main downside is that streams contain multiple types of messages. Here the app implementation is much simpler because the configuration does not need to be separately plumbed:
demuxer.seek(time)
- E (in-band with implicit configuration): Same as D with more complexity.
It still remains to be seen if preventAbort
/preventCancel
/signal
solutions are intuitive enough to be required for first-time use of WebCodecs. It would be a bad outcome if apps always wrap decoders to provide a different interface.
from webcodecs.
After thinking on this over the weekend, I think option A/C is worth considering further. If we provide a configure()
that replaces the streams (and aborts the old ones), then clients can use preventAbort
/preventCancel
to polyfill any of the other options. This may be the safest path while we wait to see what happens with flush in streams.
from webcodecs.
Obsolete. See explainer updates (decouple from streams).
from webcodecs.
Related Issues (20)
- `ImageDecoder` is `[SecureContext]` but related interfaces aren't HOT 2
- `ImageBufferSource` should be `[AllowShared]` HOT 1
- Announcement: Background Segmentation metadata entry to WebCodecs VideoFrame Metadata Registry HOT 2
- Why is the audio encoder output timestamp different from the input timestamp
- Video encoder bitrate control in case frame rate is not provided
- Video frames on demand HOT 1
- Error code: SIGSEGV HOT 3
- VideoFrame.timestamp and EncodedVideoChunk.timestamp HOT 6
- video encoder memory leaks HOT 1
- Include some frame info with `VideoDecoder` Errors? HOT 2
- VideoFrameMetadata is defined in WebCodecs and videoFrameCallback HOT 2
- Wrong chroma values in videoFrame.copyTo() on Intel MacOS HOT 1
- Attempting to configure an encoder with a bitrate of 0 should fail HOT 1
- display size is not set in Convert to RGB frame algorithm
- copyTo from planar to interleave should copy / convert all channels HOT 2
- Do Linear PCM AudioDecoders not work? HOT 8
- decode an EncodedVideoChunk to produce multiple frames HOT 1
- Video-Decode-Display errors when playing back video with 'avc1.640032' codec HOT 1
- Add optional framerate or max_framerate to VideoDecoderConfig
- Require `AudioDecoderConfig.description` for channels > 2 with Opus? HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from webcodecs.