Through this platform, I want to ask that how can I remove unwanted noise from the signal when you do not have much information regarding the frequency at which they appear? Data is collected from an inductive sensor and sampling frequency is 30000 Hz. There are a lot of electrical noises in the signal, the easily distinguishible have already been removed using a Notch Filter. However, there are some electrical noises which are not easily distinguishible from the other parts of the signal. I tested the following approaches:
- Removing easily visible electrical noises using Notch Filter
- Taking FFT and applying binning to visualize other noisy parts
- Using find_peaks() function to detect and remove noisy parts
However, when I appled ifft I could not get the filtered original time series data.
This is the Original Time Series Signal:
This is the complex Fourier Transform before binning and find_peaks():
And this is the fourier transform after binning:
And this is the result obtained after find_peaks():
And this is the inverse FFT result that I have obtained after so called processing (FFT, binnig, find_peaks() technique)
Can anyone please help me understand where I went wrong?
This is the reference data obtained usinf Eddy Current Sensor. I suppose my data should also look likr this after denoising.