0
$\begingroup$

Regarding extraction of MFCC from speech signal...

I have checked for the detailed procedure of extraction of MFCC from http://practicalcryptography.com/miscellaneous/machine-learning/guide-mel-frequency-cepstral-coefficients-mfccs/

For each frame they have extracted the features.. If the signal consists of 100 frames.. then each frame will give 39 values as such.. there by we will get a 39 X 100 matrix for a single speech signal

My question is how to get 39 MFCC coefficients for the whole single signal? People are saying that they have used 39 MFCCs for a signal, How?

$\endgroup$

1 Answer 1

4
$\begingroup$

You get a vector of 39 coefficients for each short frame of the signal; not for the entire signal. A speech signal contains segments of voice and silence, and of course when voice is present, there are different phonemes spoken in sequence - so the signal is not stationary and the MFCCs will fluctuate. Extracting the coefficients on a single frame spanning the entire signal would blur all this.

You might also be tempted to compute the average of the MFCC vectors. There are indeed a handful of applications in which this might work (for example categorizing sounds, or very coarse music genre classification), but I don't advise you to do this for speaker verification.

In speaker verification or recognition applications, you perform the classification or model scoring for each frame. For example, let us say you have trained a GMM for a speaker, and then are given another signal and want to know if this was spoken by the same person. Extracting the MFCC on the signal will give you a sequence of 100 MFCC vectors. You score each vector with the GMM and make a yes/no decision for each vector. Finally, you use voting to aggregate the decisions over the 100 frames. Or alternatively, you average the GMM scores for the 100 frames and use the result to make the yes/no classification.

When people report that they have used 39 coefficients, they mean "per frame".

$\endgroup$
1
  • 1
    $\begingroup$ There are some additional tricks. In the pauses between words, the MFCC's are not really relevant. This can be achieved by weighted voting using dB level $\endgroup$
    – MSalters
    Commented Jul 17, 2014 at 11:58

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.