Speech Processing applications: stereo data for features

Question

I am working on speech databases that have a stereo format. I want to extract spectral information (Mel-filterbanks, MFCC, LPCC) and also some other prosody features like the fundamental Frequency F0.

Is there a standard way to handle the computations of speech features for Stereo data?

This is for speech recognition but also spotting some irregular speech audio events, so it is different from MIR.

The maximum amplitude difference between the two channels is 7% and the mean is 0.3%. Does not tell much about the spectral features, will investigate the difference in the frequency domain now.

Answer 1

Is there a standard way to handle the computations of speech features for Stereo data?

Not really. It really depends on why your recording is stereo in the first place and how exactly the recordings are made.

The preferred method would be to have a single close up microphone recording. Two or more channel can be helpful, if it's far field recording. Google uses two channels, Amazon uses seven. If it's stereo from produced media (movie, song, etc.) then the best extraction method would depend on the way its produced, but typically summing the two channels would be the best.