Questions tagged [speech-processing]

Speech processing is the study of speech signals and the processing methods of these signals.

Filter by
Sorted by
Tagged with
0
votes
0answers
23 views

How to use cross-correlation to verify speech data and determine delay

I have been experimenting with cross-correlation function to verify the presence of speech in a recorded file wrt a source file. I tried the following in Matlab: <...
0
votes
1answer
27 views

LPC Formant Estimation: Why resample?

The Burg algorithm implemented in PRAAT for formant estimation also works via LPC. First the sound is resampled to a sampling frequency of twice the value of maximum formant. Then a pre-emphasis is ...
0
votes
1answer
42 views

What do different Cepstral or MFCC coefficients represent intuitively?

I understand the explanation for separating slow and rapid changing log spectral components but i need to understand: Why lower coefficients have higher and mostly positive magnitudes? Why Higher ...
0
votes
0answers
9 views

Help in LBG Vector Quantization - Splitting Factor

I'm currently making a program for speech recognition. In the step of codebook generation using the LBG (Linde-Buzo-Gray) algorithm, I've read that the splitting factor $\varepsilon = 0.01$ (generally)...
0
votes
1answer
28 views

How to use MFCC (or any other tool/method/algorithm) for speech verification

I have an original speech .wav file and a few recorded samples of the same file. Each recorded version has some differences wrt the original file. For example, The ...
0
votes
0answers
14 views

How do I extract n-dimensional cepstral coefficients with a sliding Hamming window in PyTorch?

I am trying to replicate the features from this paper, described as follows: MFCCs of speech frames are computed using a mel-scale filterbank. We extract 20-dimensional cepstral coefficients with a ...
3
votes
0answers
62 views

Frame lookup using audio

I'm an animator trying to get a program that will use machine learning to automate the lip syncing process. The program I need made will have two files given to it: a seed, and an audio file. The seed ...
1
vote
0answers
29 views

Understanding MFCC

I am not from electrical or electronic background so my knowledge will be lacking. MFCC is represented by 39 values for each window frame. 12 values are the mel filter-bank and we get 13th value by ...
0
votes
0answers
24 views

Compare two spoken words with MFCC and DTW

Processing of the speech signal is done using Matlab. I want to use MFCC (Mel-frequency cepstral coefficients) is implemented using HTK and DTW (dynamic time warping v2.1) algorithms to make a speech ...
0
votes
2answers
50 views

Conceptually confused by LPC for speech: Do we synthesize by the inverse filter (FIR)?

I've been following the process of using LPC to analyse the speech and then synthesize the speech by swapping out coefficients over time. I'm purely concerned with pitched vowels at this point. ...
0
votes
0answers
14 views

how to implement Bark filter bank on the power spectrum for PLP feature extraction?

So the implementations for PLP feature extraction I have seen in python and Matlab, are as follows: suppose the FFT features of an audio signal are of the size 257 (512 point FFT). if we have one ...
0
votes
0answers
48 views

STFT of ISTFT in the Griffin Lim Algorithm

The Griffin-Lim algorithm for phase recovery (based on the magnitude of an STFT) involves a step that is: STFT(Inverse STFT(...)). This seems to be the key iteration in the algorithm. This Quora ...
0
votes
2answers
68 views

Speech SNR estimation

I'm trying to estimate SNR level in db to use it as a switch for an speech enhancement method that i'm working on. The noise level is not known and can be estimated using a posterior SNR algorithm. ...
0
votes
1answer
67 views

Removing background noise algorithm

What is the algorithm for removing background noise from an audio clip of human speech? Say I have a 10 second audio clip of somebody talking, and there is background noise of them tapping on their ...
0
votes
1answer
43 views

Is zero-padding necessary for speech processing to satisfy linear convolution property?

In the FFT domain, for example, if I multiply a noise reduction gain to the noisy signal, $ Y(w)H(w) $, this translates to a circular convolution in the time domain of the same length $ y(t) \...
0
votes
0answers
28 views

Techniques for removing noise aside from Spectral Subtraction/Statistical Method?

I am studying how to remove noise from speech audio and I figured the most common error in spectral processing comes in the form of musical noise. Now what are the techniques on reducing this ...
0
votes
0answers
24 views

Capture the ambient sound

I sit in a cafe and start recording my voice, reading a poem. Then I sit at my room, at complete isolation, and I read the same exact poem once again and record it. Now, Considering I have these two ...
0
votes
0answers
10 views

Using MFCCs for acoustic machine failure prediction

MFCCs are ubiquitously extracted for speech processing tasks, but I would like to know how suitable they are for non-speech processing tasks. Intuitively, it is my understanding that MFCCs are ...
0
votes
0answers
18 views

Is audio normalisation required for a speaker recognition/speech classification task? How to do it?

Not entirely sure if this Stack or a ML-related stack would be a fit for this question, but I focus on the signal processing here on this question, so I decided this one I'm developing a speech ...
0
votes
2answers
89 views

log base in log-power spectral features

Is the log in log-power spectral features natural logarithm, or common log of base 10? does it even matter? I found sources for how to calculate it, but they all call it 'log'. no one mentions the ...
0
votes
0answers
32 views

Why do we use the term “cepstral” in MFCCs, and how does it related to the cepstral domain?

As I know, we can get the cepstrum by taking the Inverse Discrete Fourier Transform (IDFT) of the log of the power spectrum. And we can get the Mel-frequency cepstral coefficients (MFCCs) by taking ...
0
votes
0answers
37 views

Difference between Cepstrum and Spectral Envelope

I have no background in Signal processing and i don't understand the difference between cepstrum and spectral envelope. IDFT of the log magnitude of the DFT of a signal is cepstrum then what is ...
3
votes
1answer
50 views

Given 1 recording of my voice, how can I process it to sound like 2 independent recordings of my voice played in unison?

I have one recording of my voice $x[n]$ singing a song. One thing I could do is independently record me singing the song again to obtain $y[n]$. Then, $z[n] = \frac{1}{2}\left(x[n] + y[n]\right)$ ...
0
votes
0answers
23 views

Stereo echo cancellation for stationary source locations: why does adaption stagnate?

In a stereo echo cancellation system, the echo path for the far-end-signal in the near-end room is estimated by an adaptive filter. Since the same signal is transmitted by two similar far-end paths, ...
0
votes
1answer
112 views

python3: speech recognition - calculating features of a WAV file

I am supposed to do this as a school project, but I am kind of lost when it comes to signals and would appreciate your help. Also, English is not my first language, and I will be translating the ...
0
votes
1answer
27 views

Removing vocal but retaining all background ambient noises

I have one audio file containing human speeches, a lot of ambient noises like audience laughter, birds chirping, sounds of natures etc.. Now I want to separate it into two audio files where one ...
-1
votes
1answer
54 views

audio classification based only on first few seconds

I record audio notes on my recorder, and each belongs to a certain category ("work", "parenting", "miscellaneous", etc.). At the beginning of each recording, I say the name of the category, then stay ...
0
votes
0answers
8 views

Detecting disinfluencies in speech

Can someone tell how to find disinfluencies (like ah, umm etc.) in speech using Kaldi or any other open source tool (preferably in Python)
1
vote
0answers
32 views

Is fundamental frequency information present in speech-shaped white noise?

I am using a so-called speech-shaped stationary white noise, which means so much as a white noise that has been filtered to match the long-term spectrum of a female speaker. The way it was generated ...
2
votes
1answer
262 views

Problem using pitch shifting with TD-PSOLA and formant preservation

I tried out this implementation of TD-PSOLA (https://github.com/sannawag/TD-PSOLA) and even though I know how the algorithm works, I can't understand why I get NO audible differences in the output ...
0
votes
0answers
27 views

Stack features in wakeword model

I'm not clear how is the input features are stacked in wakeword applications. Taking https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/43969.pdf as an example, the author ...
0
votes
1answer
51 views

Cone of Confusion

In sound perception, humans adapt by tilting the head or relying on other location cues such as visual input when the source of the sound lies on the cone of confusion. On this cone, no time and level ...
0
votes
1answer
34 views

Objective Noise Classification for speech enhancement

I'm working on my thesis and it is about an speech enhancement system to use proper noise reduction method/algorithm for different types of noise. I want to test and compare some filters/algorithms ...
0
votes
2answers
41 views

Distinguishing Spoken Speech from Played-back Recording of Speech

Do any general-purpose techniques exist to distinguish live spoken speech from played-back speech samples? For example, if I were to deploy a speaker verification system to authenticate users by voice,...
3
votes
1answer
679 views

Why is the Hamming and Hanning window the most widely used for speech spectograms?

When taking the Short-Time Fourier Transform of the speech signal, windowing is applied to taper away the signal frame at both ends and mitigate introduced artifact at expense of the maximum ...
0
votes
1answer
34 views

Need some references on sound quality evaluation and syncing

I have to do a project where I'm receiving the same sound signal from different channels (with different offsets), but they may not be consistent all the time. At any given time, I should decide which ...
1
vote
1answer
52 views

Audio Processing Glossary

I'm new to audio processing and I hope here be a good place to ask about the definition of terms in this context. My question is what is difference between sound, audio, voice, speech and tone, from ...
1
vote
1answer
34 views

Are delta and double delta features needed when classifying with LSTM

I understand that the combination of MFCCs, deltas and double deltas is a good feature to be used with HMMs for keyword detection problems. HMMs are limited by Markov Property and this limitation is ...
3
votes
1answer
5k views

What are i-vectors and x-vectors in the context of Speech Recognition?

I have read that i-vectors and x-vectors are widely used in speaker recognition tasks but I don't get the difference between them and how exactly they work. Can someone explain it starting from the ...
0
votes
1answer
80 views

how does the Frequency spectrum of a signal change in the logarithmic space?

I am trying to implement basic homomorphic filtering but I can't seem to understand what happens in the frequency domain when you take the natural logarithm of the function. In Matlab I'm getting not ...
2
votes
1answer
89 views

Is there any way that we can perform speech recognition without using Fourier transforms?

I am trying to research about speech recognition and why everyone uses Fourier transforms in going about the topic. I know that we get information related to the frequency of each sound uttered which ...
1
vote
1answer
112 views

Silence removal from the audio

Suppose i've a mp3 file. I performed FFT of that mp3 file. Then is it good to state the following: 1. Silence occurs by that particular DFT point whose magnitude is lesser than some threshold. 2. ...
0
votes
1answer
36 views

MATLAB & Power Spectral Density - Error - Getting the same range of values regardless of sound type?

I wrote code [attached at end of question] to take .wav files of child vocalizations and tried to see if there are valid ranges for the formants F1:F2:F3 for the 5 ...
0
votes
1answer
122 views

Relationship between Frequency response, magnitude spectrum and gain

I have been reading quite a lot of DSP related materials online and offline (books etc.) lately. I come across the terms frequency response and ...
4
votes
2answers
2k views

Mel Cepstral Distortion

I am working on a speech synthesis model and I am looking to evaluate my synthesized speech. I found that most people use the Mel Cepstral Distortion (MCD) which can be calculated by the formula: $$\...
1
vote
1answer
202 views

Split audio file into audio phrases

I have couple of audio recordings of length 5 -7 min. I also have corresponding text to each audio file. I am not subject matter expert on speech to text but I am vaguely aware that much smaller ...
1
vote
2answers
66 views

MATLAB - How do I get the Filter Function to get the output Energy Spectrum?

The image was from a question I posted on reddit, so ignore the title. I'm trying to write a program that plots these graphs I know that the first plot is just a plot of the source-signal so the "...
2
votes
4answers
123 views

Cleaning telephone audio

I have telephone audio at 16kHz and I am trying to use it with a speech transcription engine that converts spoken letters to text. However, the engine has some difficulty transcribing certain letters ...
3
votes
1answer
415 views

How to reduce synthesis artifacts produced by phase vocoder?

I implemented the phase vocoder algorithm in Python to time-stretch speech signals by following this paper and referring to this MATLAB tutorial. I can distinguish words in the original signal from ...
0
votes
1answer
765 views

Audio/speech detection, verification

I would like to write a program to compare two '.wav' files, one of which is the original played file with human speech and the other is a recorded '.wav' file. The program I wish to write in python ...

1
2 3 4 5