osmanovv/auxmic

open-source audio synchronization software

auxmic

auxmic is an open source audio synchronization software.

The only purpose is to help you synchronize audio files from different sources. Assume you filming any event with DSLR or camcorder while recording audio to an external microphone. You do not need a clapperboard anymore - using auxmic you can easily cut audio from your master record. Just drag and drop your records and get right timecodes or even export synced files.

Since version 0.8.1.115 you can export synced files with FFmpeg without using any NLE software.

Supported Formats

Format	File Extensions	Windows 7	Windows 8/10+
AVI	.avi	+	+
MPEG-4	.m4a, .m4v, .mov, .mp4	+	+
MP3	.mp3	+	+
WAVE	.wav	+	+
3GP	.3g2, .3gp, .3gp2, .3gpp	+	+
Advanced Streaming Format (ASF)	.asf, .wma, .wmv	+	+
Audio Data Transport Stream (ADTS)	.aac, .adts	+	+
MPEG-2	.mpg, .mpeg	-	+
MPEG transport stream	.m2t, .m2ts, .mp2v, .mts, .ts	-	+
MPEG program stream	.vob, .mod	-	+

Supported Media Formats in Media Foundation

Screenshots

auxmic's Issues

Matching progress probably does not match actual process

Progress ends earlier than actual matching task. Check progress maximum value for matching step.

publish new release

Application hangs while exporting synched audio

Fails to save synchronised audio file if master record ends earlier than video.

Setup GitHub Actions

Audio is not synced

Hi.
I can't get this app work properly.
I downloaded sources to check where is the problem with wav files.
Application doesn't display any error, but generate empty video file.
The problem is with wav, it can't be combined with mp4 container, this is normal but user doesn't know that without error message.
The biggest problem is that this app doesn't sync audio at all.
I have made short 30s long video clip and I had offset different for each audio format (wav, mp3 stereo, mp3 mono).
None of generated file was synced correctly.
My test clip contains 3 claps at the beginning and normal speaking.

ffmpeg exports fail when LQ clips span the start or end of the master clip.

eg:

A master track that is 30 minutes long
Clip 1 that begins 5 minutes before the master track, and is 10 minutes long
Clip 2 that begins 15 minutes into the master track, and is 8 minutes long
Clip 3 that begins 7 minutes before the end of the master track, and is 14 minutes long

      ------------------------------              master
 ----------                                       clip 1
                --------                          clip 2
                             --------------       clip 3

The resulting mp4 file for clip1 and clip 3 have messed up audio.

The fix is to get FFMpegTool.cs to export with arguments more like this:

string exportArgs = $"-y 
        -ss {queryStart} -i \"{videoFilePath}\"
        -ss {trackStart} -i \"{audioFilePath}\" 
        -c copy -map 0:v:0 -map 1:a:0 -t {duration} \"{targetFilePath}\"";

Add ability to export synchronized file with `FFmpeg`

In a simple scenario it's possible to replace corrupted audio with synced without using any non-linear editing system (NLE):

ffmpeg -i video.mp4 -ss 00:02.728 -i audio.m4a -c:v copy -map 0:v:0 -map 1:a:0 -shortest fixed_audio.avi

ArgumentOutOfRangeException while exporting synced file with negative offset

If external mic records starts later than video, it could leads to negative offset:

Trying to export such file will throw ArgumentOutOfRangeException.

Crash on processing files with the same names (but different extensions)

Auxmic cannot process a video file with the same name as the master audio. It saves extracted audio WAV files to a temp folder with original filename except the extension. E.g., it crashes trying processing file.avi and file.wav.

Does not cope with multiple instances well.

"One or errors occurred"

To reproduce:

• Start auxmic.ui.exe, and use file01.mp4 as the "master" and file02.mp4 as the "other" file.
• Wait for file02.mp4 to load
• Start auxmic.ui.exe, and use file02.mp4 as the "master". Notice that it loads it more-or-less instantly.
• Load file01.mp4 as the "other" file.

Notice the error dialog that says "One or errors occurred".

I got into this situation simply because after processing the files the first time I realised I had them the wrong way around, so just ran it again with them the "correct" way around. In truth I don't know what "master" means. Should "master" be renamed to "audio"?

I'd guess it's a problem with name clashes in the temp folder -- maybe add a unique instance identifier to the file names, or just disallow multiple instances of the app :-)

Improve usability/UI

• Media file names clarified.
• Hide Save button on hiqh quality source (as there is nothing to export).
• Repalce Save button to dropdown button with options to export synchronized audio & export media with synchronized audio (FFmpeg).

Add settings form

For storing synchronization settings and path to FFmpeg (#7).

Better error handling for ffmpeg failure

Currently when ffmpeg fails it is very difficult to know what the problem is. I had to use a screen recorder to get the attached errors.

I am using ffmpeg 4.4 for Windows, downloaded from this page and auxmic 0.8.1.115.

The input files are an h264 video and an uncompressed .wav file that Audacity made for me. Codec is "PCM 16 LE (s16l)" according to VLC. Apparently I'm not allowed to put a .wav file into an h264 video (which is fine), but some kind of error message would be nice. It worked successfully with an mp3 file instead.

Great to see you are still working on it!