I have two video where two person having conversation. They begin recording different times. I want to match these two videos' frame numbers, i.e. By matching audio.
How can I do that?
Signal Processing Stack Exchange is a question and answer site for practitioners of the art and science of signal, image and video processing. It only takes a minute to sign up.Sign up to join this community
The problem you want to solve is called automatic audio alignment, or auto-synchronization of audio. Common algorithms are phase correlation, cross correlation on the raw audio waveform. People also use more "cooked" audio features like MFCCs, say each 10ms frame, and measure frame-wise similarity between the audio segments to be compared.
There are many threads on Stack overflow that show how to do this. For example: find-short-clip-of-audio-within-longer-clip-of-audio, cross-correlation-vs-fft-for-finding-phase-between-2-signals. Also some interesting repos on github, audiosync, videosync