⏩ Fast-forwards long pauses between sentences — watch lectures ~1.5x faster (browser extension)
Home Page: https://chrome.google.com/webstore/detail/jump-cutter/lmppdpldfpfdlipofacekcfleacbbncp
License: GNU Affero General Public License v3.0
The extension helped me a lot. So i want to request you a nodejs version of this, that can run on terminal with local vídeos. Thank you WofWca.
Margins are already on the list.
jumpcutter/src/settings/defaultSettings.ts
Lines 60 to 68 in 6f82c44
Also maybe silenceSpeed also needs to be added there, although it's not used in the cloning algorithm yet.
The reason I think we need this is because with the cloning algorithm you don't really need to set volumeThreshold as low as possible because marginBefore actually works properly there without any stretching.
I was hoping I could easily find/see time saved (eg minutes/seconds) when watching a video. Perhaps I'm not reading the UI properly?
It would be even cooler if it had long-term stats, like total time saved since installation of the addon (ublock has this).
Thanks, really loving this addon!
It gets initialized, but the audio does not get output.
The developer console says.
MediaElementAudioSource outputs zeroes due to CORS access restrictions for file:///<video file path>
A workaround would be to serve files from a local HTTP server (e.g. with python -m SimpleHTTPServer).
I remember the Video Speed Controller extension had this.
For Mozilla Add-ons store see web-ext, maybe it can help.
I don't think it should be fully automated though, better to keep it local, I think.
Since we now have localization, publishing more often is more desirable.
Using a shared one causes problems. See
Maybe there are other problems related to this.
It should also prepare us for potentially attaching to several elements on the same document simultaneously.
IIRC the only benefit of using a shared one is performance. Not sure how bad creating several AudioContexts is, but I'm sure not super bad. But currently we only use one Controller at a time anyway, so it's not that we're gonna have a bunch of AudioContexts at simultaneously.
It used to be the case before fa678bf.
So I think we need to create a new one on each controller initialization.
First off, thanks for the awesome extension! Works like a charm!
I mostly use it to watch Lecture recordings, which are hosted on google drive (currently unsupported). For jumpcutter to work, I need to use the "open link directly" option - Do you think you could add a setting to make this a default option? Something like - always open links directly if possible.
Happy to help add this feature as well!
Thanks!
Vimal
Here's the idea: #2 (comment)
Roughly where to start looking:
jumpcutter/src/entry-points/content/CloningController/Lookahead.ts
Lines 79 to 89 in 9374464
I found this extension on the Chrome Webstore -- I've absolutely fallen in love with how customisable it is, as well as the superb and powerful functionality.
Would it be possible to add a domain blacklist to control whether the extension should be disabled on certain pages? This would be very useful for e.g. speeding up lectures but keeping YouTube videos at normal speed.
I use this extension in combination with Video Speed Controller (with some overlapping features disabled), and they have what is shown in the following screenshot:
Something like uBlock/AdBlock's "Trusted Sites" would also be similar (disable with a checkbox in extension popup, as well as multiline textbox in options).
Thanks!
I've just installed and tested this extension. It works great!
The only thing I don't like about it is that green badge which is very green.
Maybe changing the color scheme to match the one seen on the uBlock Origin icon?
Or maybe also hide the badge entirely if there is no video element on the page?
Maybe even both things?
jumpcutter/src/background/initIconAndBadgeUpdater.ts
Lines 15 to 26 in ce5ac8e
I see that there's a TODO there. What does DRY mean in that context?
Actually there is the "Picture in picture" feature that kind of allows this, but it makes it overlay other windows. Idk if it's that important then
Also you can resize and move the entire browser window.
We have a link to Discord, and we have GitHub, but they require an account. Would be cool if people could share their feedback more easily.
I heard of IRC.
And Matrix. Does Matrix require creating an account?
Zulip (lol)?
To the right of "open a local file" would be a good place. Maybe also make it optional, as well as "open a local file"
Can be helpful if we didn't properly recognize if the media source is cross-origin.
Related to #36
Like #83
Maybe.
Using dynamic imports makes us have to add web_accessible_resources:
Lines 26 to 30 in 81b4e50
web-ext warns about this).
runtime.getURL(,
But then, it sounds a little stupid that there's virtually no native support for dynamic importing in extensions. Or am I missing something?
Another big thing is with .audioWorklet.addModule:
executeScript(). Maybe the spec needs to be changed. I don't know what's the best practice.
This may also help with #26
At least some basic, smoke-test level stuff. This should make things a little easier for new contributors.
Unit tests would be easier to implements, but I think end-to-end / Selenium are more valuable. Both are good, of course. Not sure if Selenium can work with extensions.
Hi. Would it be possible to allow a setting to mute the silence parts? I hear a clicking/buzzing sound when those are sped up.
There's another extension that implements this (https://github.com/vantezzen/skip-silence) but I prefer yours because it has more granular settings and allows to play local files. However, this other extension has both the advantage of muting the silence and doesn't cause as much desynchronization for me
Thank you!
As a solution to #1, we could create another video element that plays the same video, hide it, and shift its playback for just a moment before the original video's .currentTime. That way we can effectively read the audio data that is yet to be played by the "main" video.
The problem is – I don't know how to clone a YouTube video element so it can play the same track.
This wouldn't work:
v = document.querySelector('video');
v2 = v.cloneNode(true);Because
GET blob:https://www.youtube.com/79c3944d-0c45-412a-b5b2-c3d166d5c962 net::ERR_FILE_NOT_FOUND
So, how do I do it?
See
Affects: msn.com.
Where to fix:
jumpcutter/src/entry-points/content/init.ts
Lines 86 to 119 in fcda2b0
Right now we're mostly performing seeks for this algorithm:
But also sometimes we speed up, this can be taken as a basis:
jumpcutter/src/entry-points/content/CloningController/CloningController.ts
Lines 530 to 535 in fcda2b0
My idea: we can make it work roughly the same way as seeking works right now. It's inefficient, but should work:
On every 'timeupdate' event, check if we're on a silent or on a sounded part, set speed accordingly, check when the current silence (loudness) period ends and setTimeout to switch speed at that time.
We also need to think how it's gonna be on the UI. Do we just set speed to infinite when the "silence speed" slider is at max value? Or do we make a separate checkbox?
Related #48
The functionality is as described here: https://github.com/carykh/jumpcutter/blob/136df102fe9f94a83abf6825f798adf313ce4178/jumpcutter.py#L62
some silent frames adjacent to sounded frames are included to provide context.
Hey, I'm really impressed with how well this extension works.
It would be really useful if the user could create named presets for settings (threshold, speed, margin ...) and select them easily.
Imagine watching lectures of different lecturers. Each professor speaks at their own pace. By using presets, the user could simply switch to the settings that fit a certain lecturer.
Lecture Speedrun has something similar, but your jumpcutter is more handy as it is packed as an extension (so videos don't need to be downloaded).
Currently, browsers don't offer us API that lets us simply get decoded audio samples of a video before actually playing them.
But we would like it since it would allow us to:
Looking for a way to achieve this.
IDK maybe it's hard to understand how different Controllers and other things work just by reading the code.
For some reason when sounded speed is below 2x (e.g. 1x, 1.5x), video speed is being capped at 2x during 0dB audio even with a very high silence speed (e.g. 3x, 5x, 10x). Works fine when sounded speed is 2x or higher.
E.g. https://www.twitch.tv/videos/1124147193 at 3:57:30
(I'm using https://chrome.google.com/webstore/detail/video-speed-controller/nffaoalbilbmmfgbnbgppjihopabppdk to see the video speed, not the inaccurate one at bottom right of video player.)
In the latest Firefox Beta 97.0b9 the cutoff speed for video with audio can be set in about:config and has as a default been increased to 8x
I use that version but the plugin currently does not support silent speed >4 and there is no config option for it!
Do we implement it? Can't we support both? Chrome says they're deprecating V2 at the end of 2022.
Recently, jumpcutter stopped working on Vimeo videos.
We can't directly analyze audio from video elements whose source is cross-origin, although they can be played back just fine. And this applies to many websites (Zoom call recordings, Invidious, Google Drive videos, many others).
Currently what we're doing is suggest opening the source directly in a new tab:
But would be cool if it just worked somehow. Preferably without violating what's cross-origin restriction is made for -
Somewhat of an option is to contact the website owners and ask them to apply the required cross-origin headers to the source (I think it's Access-Control-Allow-Origin?) but you can't contact them all.
More info:
HTMLMediaElement's spec, search for "cross": https://html.spec.whatwg.org/multipage/media.html#security-and-privacy-considerationsAdvice or thoughts are appreciated (as always).
For some reason it started failing for Svelte >=3.48.
ERROR in .../tsconfig.json
.../tsconfig.json
[tsl] ERROR
TS2688: Cannot find type definition file for 'shared'.
The file is in the program because:
Entry point for implicit type library 'shared'
FYI we don't exactly follow the guide https://svelte.dev/blog/svelte-and-typescript, specifically we don't have "extends": "@tsconfig/svelte/tsconfig.json", in tsconfig.json
Like in 70e68a8
There are 291 TODOs right now, damn.
Currently we're simply calculating the loudness of incoming audio and if it's below a certain value, we say it's silence. Would be cool to find a specialized algorithm that does this better, like what voice communication apps do.
FYI in theory we can use an implementation written in a different language, such as C, C++, Rust, Go - we could compile it to WASM.
And it's not necessary to replace the current implementation, we can make an option to switch between different silence detection algorithms.
➕ Advantages:
➖ Disadvantages:
Where to start:
Also see #164, there is a good collection of various VAD algorithms
I would appreciate your advice (as always).
I also found this: https://developer.mozilla.org/en-US/docs/Web/API/MediaTrackConstraints/noiseSuppression
Idk what it is, but may help.
Also this: w3c/webrtc-extensions#76
I haven't really tested it much on mobile. I remember at least that in Kiwi browser the popup doesn't connect to the content script because it queries the current tab, but the popup itself is the current tab. See https://github.com/WofWca/jumpcutter/compare/popup-separate-tab
Also UX may suck. Not sure if there is a good way to improve it.
Edit: Working okay so far today. Apparently you can't easily delete issues so I'll leave this for a day or two and close if I can't repro again today.
Edit 2: I was running into #25 repeatedly last night and maybe it was confusing everything.
This is a vague not-particularly-useful issue report, but on Chrome I've been comparing Jump Cutter to Skip Silence, and I much prefer the UI of Jump Cutter. It's the one I want to work.
However, even after adjusting every setting, e.g. setting a 0.5s "margin before" (the distortion & delay don't bother me much), and a decent "margin after" of 0.25s, there is some sort of audio error that still occurs repeatedly. Essentially every 1-3 minutes I won't be able to make sense of what I just heard due to choppiness in their voice. I will jump back and re-play it, and it will play perfectly the second time.
Perhaps it is switching too fast? Too many times in a short period? Seems to happen no matter my margin settings, large or 0.
I thought I was stuck with this until I tried Skip Silence, and it doesn't have this issue, seems to playback perfectly. Perhaps because of its "Sample Threshold" setting? It seems like "margin" is perhaps the equivalent of that in Jump Cutter, but as mentioned something doesn't quite work.
Anyway, love the extension, I much prefer your volume graph and threshold setting - the way the graph scales, it's awesome. But currently have to use Skip Silence instead because of this issue. (After testing each on a few hours of video last night.)
Will see if I can gather more useful information, switching back to Jump Cutter to try to find some helpful repro's.
I don't know too much about accessibility, but I tried to follow practices I head are good for it. Not sure if there are any problems.
https://extensionworkshop.com/documentation/develop/build-an-accessible-extension/
https://hosted.weblate.org/engage/jump-cutter/
Also see https://github.com/WofWca/jumpcutter/tree/translations#readme
Don't hesitate to ask questions.
If you've made a translation but the extension doesn't appear to display in that language, please reach out to me. I might have messed up language codes.
Side note: If you want translation activity to be displayed on your GitHub profile, you also have to star or fork WofWca/jumpcutter-translations. It's because translations are used as a submodule in the current (main) repo. See GitHub docs.
Currently it requires host permissions for all URLs. Would be cool if it had no access to any pages at all (if people are only using it for local files), then ask for more (or all websites).
This could also solve #26.
Maybe also need to add a way to open non-local files in the local-file-player, with a link to the video file.
How it's done: https://extensionworkshop.com/documentation/develop/request-the-right-permissions/#request_permissions_at_runtime
I accidentally saw the gear icon for the first time today - actually, that's not true. I actually found the options from "Extension options" from my chrome://extensions/?id=lmppdpldfpfdlipofacekcfleacbbncp page first. I was shocked when I saw all the extra configurations!
I then opened Jump Cutter specifically looking for a direct link to the options and spotted the gear at the top right. I've opened Jump Cutter a lot and never saw that, I think because an ultrawide (3440x) resolution makes the "teeth" of the gear almost invisible, just a pixel or two: 
.
I'm actually a lot more impressed with Jump Cutter than before even! Though I still can't use it on Twitch except for very slow speakers because of #25 😁, it's pretty great!
Feel free to close this suggestion as won't fix btw, not every suggestion is a good one 😅.
jumpcutter/src/settings/defaultSettings.ts
Lines 153 to 170 in 9374464
It's supposed to be like a quick extension toggle (without de(re)initialization). I personally set it to toggle both sounded speed and volume threshold, but the problem is if you decide to "switch off" the extension while the sounded speed is 1 alredy, it will toggle it to the previous value.
Best solution I can think of is to create a separate HotkeyAction for this instead of binding two actions (HotkeyAction.SET_SOUNDED_SPEED and HotkeyAction.TOGGLE_VOLUME_THRESHOLD) to the key.
Chromium now apparently uses black color for the text, so may need to brighten up the colors. Maybe choose the same as on the chart.
Idk if we need one since the extension kind of just works. Or does it? If anyone has ideas, please share.
https://extensionworkshop.com/documentation/develop/onboard-upboard-offboard-users/
After 1c82c22 I thought that for some people it would be better if we did not attempt to change the default playback rate of media elements at all. For example, on one website they watch videos at 2.5x speed, on another it's 1.5x, but they want silence skipping to work on both of them. But currently our extension always sets sounded speed to the value stored in its settings, so if they visited the first website (where they watch at 2.5x), and then went to the second one (where they prefer to watch at 1.5x) – tough luck – our extension will set it to 2.5x.
I guess we could make the "sounded speed" setting not global but per-element. Also, maybe this should apply to "silence speed" as well? And other settings?
Also, how about instead of having such setting stored somewhere in the extension's code, we simply use el.defaultPlaybackRate is the value for it?
For this we can look up how the Video Speed Controller extension works.
For example on YouTube (without this extension) there is a way to change playback rate. But if a user does this, the new playback rate will be overridden by the value of "sounded speed". So we need to update it.
I'd say it's of big confusion and annoyance to new users.
Also it's a step towards compatibility with other playback rate changing extensions (like "Video Speed Controller").
I guess we need to element.addEventListener('ratechange' and inside the the listener we need to check whether this playback rate change was caused by the extension or by something else. If it's something else, update "soundedSpeed".
Playback rate changes are performed inside controllers:
https://github.com/WofWca/jumpcutter/tree/dev/src/entry-points/content
e.g.
So I guess every time a controller does this, it should call a callback or something like this.
There is no license here or on Weblate.
This seems to be in error(?)
Hi, there should be a whitelist/blacklist for webs because can be bugged in some of them, like twitch
Like this, for example:
jumpcutter/src/hotkeys/eventTargetIsInput.ts
Lines 21 to 39 in 81b4e50
As stated in the comment, the criteria is already taken from another library.
This is also helpful for people who are afraid (or other reasons) to install the extension (see #57).
Also need to consider making it an installable PWA, to play local (or non-local?) files.
Maybe also need to add a way to open non-local files in the local-file-player, with a link to the video file.
The biggest obstacle here is the usage of Web Extension API (e.g. browser.tabs.query(...).
Maybe we can add some ifs like (if (BUILD_DEFINITIONS.STANDALONE_DEMO_PAGE), so that Web Extension API is never used when the condition is true. So basically search for all the occurrences of browser..
I think we could utilize local-file-player and put popup in an <iframe>.
For popup, this may also help: https://github.com/WofWca/jumpcutter/compare/popup-separate-tab
When watching a video with Jump Cutter enabled, dragging the Sounded speed slider to 0.00 causes the video to stop playing and the extension popup to stop responding (dragging the sliders has no effect; values stay unchanged).
Noting happens. All values stay the same. Video playback does not continue.
Jump Cutter should not hang; video should start playing again after dragging the slider (and other sliders and checkboxes should continue working)
Version: 1.18.1
Firefox 92.0
Notice how the value of Sounded speed is still 0.00, although the slider has been dragged to a different value.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.