6
$\begingroup$

I have a synthesized signal (the bottom of the following figure), which is the convolution of the input signal (at the top) and the objective function (in the middle). The intention is to retrieve the objective function from the convoluted signal, when the input signal is known. From practical point of view, it seems to be an ill-conditioned problem, but I'm curious to know the expert opinions on how far one can get, and with what SP toolset. Specifically, I would like to know: 1). comparing the first wave packet and second, how to tell whether the first square in the objective function is one with shorter time span but the same amplitude, or with the same time span but smaller-amp; 2). for the 4th square, how to tell it's not two separate short squares rather than a single long one. I've also attached the Matlab codes I used to generate the figures. Thank you very much.

enter image description here

clear; close all;

%% 10MHz incident signal;
fs = 1000e6;
f = 10e6;
wavelength = fs/f;
sig = wavemaker(3.5, f, fs);
figure; subplot(3,1,1);
plot(sig, 'LineWidth', 1); title(strcat('input signal, wavelength =',num2str(wavelength),' data pts'));
axis([0,3300,-2,2])

%% Sparse signal;
N = 3000;                    % N : length of signal
s = zeros(N,1);
k = [50:(50+wavelength*0.1) 500:(500+wavelength*0.6) 1200:(1200+wavelength*1.6) 2200:(2200+wavelength*4.6)];
s(k) = 1;
subplot(3,1,2);
plot(s, 'LineWidth', 1); title('distribution: objective function');
axis([0,3300,0,2])


%% convoluted signal
y = conv(sig,s);
subplot(3,1,3);plot(y, 'LineWidth', 1);hold on;
plot(abs(hilbert(y)), 'LineWidth', 1);
title('convoluted signal between input and districution');
xlim([0,3300])


function x = wavemaker(nCycles, fc, fs)
% function to generate wave packet;
nSample = round(fs / fc * nCycles);
ts      = 1 / fs;
T       = ts * nSample;
t_max   = ts * (nSample-1);
t       = 0: ts: t_max;
 
x       = sin( 2 * pi * fc .* t);
  
x = x.*hanning(nSample)';
end
$\endgroup$
7
  • $\begingroup$ In case the input signal is known it is possible to have a good estimation. The question is, is there more information? Like the model of the objective signal, is it steps? What about the noise? $\endgroup$
    – Royi
    Commented Dec 5, 2020 at 16:05
  • $\begingroup$ @Royi thank you for your comments. Yes I think we can think of the objective signal as steps, but with various widths and amplitudes (could be minus). We are only aiming to recover from durations with high signal amplitudes, so the SNR should be at least 20dB. I've now added an example experimental data in the original question, please have a look. $\endgroup$
    – Lampard
    Commented Dec 5, 2020 at 16:38
  • $\begingroup$ What about the input signal, is it known with no noise? $\endgroup$
    – Royi
    Commented Dec 6, 2020 at 5:35
  • $\begingroup$ @Royi yes that's right about the input signal. Thanks. $\endgroup$
    – Lampard
    Commented Dec 6, 2020 at 9:51
  • $\begingroup$ OK. This is nice. I think there could be a general solution I will add but maybe even something more specific to take into account the properties of the objective function (Series of rects). $\endgroup$
    – Royi
    Commented Dec 6, 2020 at 10:00

3 Answers 3

5
$\begingroup$

Solving a deconvolution isn't easy even in simulated environment not to mention in practice.

The main trick to solve it is using the proper model / prior for the problem and very good measurements (High SNR).

So basically, for deconvolution we're after:

$$ \hat{\boldsymbol{x}} = \arg \min_{\boldsymbol{x}} \frac{1}{2} {\left\| H \boldsymbol{x} - \boldsymbol{y} \right\|}_{2}^{2} $$

Where $ H $ is the matrix form of the convolution operator of the known signal and $ \boldsymbol{y} $ is our measurement samples.

Now, we need to talk about the Convolution form. The convolution has to deal with boundary conditions which might be crucial for good results.
We have few approaches (Basically extrapolation):

  1. Extrapolate with Zeros - Assuming data outside the samples of the signals is zero.
  2. Extrapolate by Nearest Neighbor (Also called Replicate) - The unknown value is extrapolated by the nearest known value.
  3. Extrapolate by Periodic continuation - The data is assumed to be periodic. Hence any missing value is based on that.

The building of $ H $ must match that. Since you used, in your code conv() with no explicit mode it means you basically chose zeros and since your convolution output is full (The default) it means we see the transients as well in the output.

The solution to the above is given by:

$$ \hat{\boldsymbol{x}} = \arg \min_{\boldsymbol{x}} \frac{1}{2} {\left\| H \boldsymbol{x} - \boldsymbol{y} \right\|}_{2}^{2} = {\left( {H}^{T} H \right)}^{-1} {H}^{T} y $$

The stability of this solution depends on the Condition Number of $ {H}^{T} H $.
Remark - One could solve this in Frequency Domain as well. Though it will require some touches as in Frequency Domain the model is the periodic model.

Let's have a look on the results:

enter image description here

First we can see the Condition Number is huge! You may think about the condition number as the amplification of the error. It means even the slightest noise will make things unstable. As can be seen, indeed even a white noise with a standard deviation of 1e-8 caused errors!

In practice, to deal with this instability we use some regularization.

$$ \hat{\boldsymbol{x}} = \arg \min_{\boldsymbol{x}} \frac{1}{2} {\left\| H \boldsymbol{x} - \boldsymbol{y} \right\|}_{2}^{2} + \lambda R \left( x \right) $$

Where $ R \left( \cdot \right) $ is the regularization function and $ \lambda $ is the regularization factor which balances between listening to the naïve deconvolution model or to the regularization model.

The regularization function must be chosen with respect to the prior knowledge we have about the signal of interest.
In your case, something clear about your signal is its piece wise smooth property. Its gradient is very sparse. Hence it is a perfect match to the Total Variation model:

$$ \hat{\boldsymbol{x}} = \arg \min_{\boldsymbol{x}} \frac{1}{2} {\left\| H \boldsymbol{x} - \boldsymbol{y} \right\|}_{2}^{2} + \lambda TV \left( x \right) = \arg \min_{\boldsymbol{x}} \frac{1}{2} {\left\| H \boldsymbol{x} - \boldsymbol{y} \right\|}_{2}^{2} + \lambda {\left\| D x \right\|}_{1} $$

Where $ D $ is the finite differences operator (Discrete Derivative).
This is a relatively easy task to solve. In my project Total Variation (TV) Regularized Least Squares - Solvers Analysis I implemented and compared few solvers.
For this example I used the ADMM based solver.

Here is the result for the TV regularization:

enter image description here

As can be seen, it totally overcome the (Very Low!) noise from above.
In real world (And higher noise levels) one needs to tweak the $ \lambda $ parameter. You will hardly recover perfect results, but they will be much better than doing the naive approach.

MATLAB Implementation

The full code is available on my StackExchange Signal Processing Q71822 GitHub Repository (Look at the SignalProcessing\Q71822 folder).
It includes the functions to build the convolution matrix from the samples and solve the TV problem.

$\endgroup$
3
  • 3
    $\begingroup$ Your answers are absolute quality. $\endgroup$ Commented Dec 16, 2020 at 19:55
  • $\begingroup$ @Royi Thank you so much for the time and efforts you put into this, and my apologies in my late response - I'm travelling atm. I agree with the comment above - your answers are absolute quality. I'll spend some time absorbing the info you included, which is a lot. Thanks a lot again! $\endgroup$
    – Lampard
    Commented Dec 17, 2020 at 7:12
  • $\begingroup$ @AnonSubmitter85, Thank you for your feedback. I'm happy to see people can use the answers. I'd be happy for +1 for the questioned you liked as appreciation of the effort. $\endgroup$
    – Royi
    Commented Dec 17, 2020 at 12:04
3
$\begingroup$

Actually I have a similar problem like yours. But in mine, the objective function is not like rectangular pulse but just spikes as shown below. I work in ultrasoinc testing field. So, this example is kind of like an ultrasoinc signal.

enter image description here

But, first I tried with the code from Royi using the ADMM solver from the: answer. For me, I find his solution was painfully slow to find the objective function and sometimes there are random spikes atleast for the real data. Since I have large number of signals to deconvolve, I went with L1-MM algorithm. Royi once explained here the time taken between L1-MM vs ADMM solver where L1-MM converges faster.

For our problem where we know the input and output signal, Royi's ADMM solver code provided here worked. But to be honest, I had a hard time to understand the code to be able to relate with the theory. So, I stood no chance in modifying his L1-MM code (provided here) for my problem.

I had used the L1-MM code provided here by Ivan Selesnick. There the author had given explanation with examples and the derivation of the L1-MM solver equations. The code had variables named after the equations so it was easy to follow. The result of using L1-MM for the ultrasoinc signal is given below:

enter image description here

Here the spikes had not been identified like the real objective function but the location of these spikes was determined. For me atleast that is what I would like to achieve for now.Still, you can see that the convolved signal from the recovered objective function matched the original signal.

If your data was spikes instead of rectangles, here is the result from the L1-MM algorithm. (p.s., with rectangle objective function, the recovered objective function from L1-MM does not look correct. But you can give it a go.)

enter image description here enter image description here enter image description here

All the codes and data are available here: In my github

For my ultrasoinc guided wave data:

The measured data that I want to deconvolve: enter image description here

The deconvolution performed with ADMM solver of Royi enter image description here

The deconvolution performed with L1-MM solver from Ivan Selesnick: enter image description here

L1-MM solver even with 10dB SNR showed good results: So, it can be used for denoising for my data: enter image description here enter image description here enter image description here

$\endgroup$
3
  • 1
    $\begingroup$ My apologies for the late reply - did not check back on the question. Your answer is amazingly comprehensive. My problem originated from ultrasound study as well, so your answer is absolutely spot on. I'll try to digest and learn, thank you so much! $\endgroup$
    – Lampard
    Commented Jun 10, 2022 at 22:55
  • $\begingroup$ First, pay attention to the license of my code. Just to add, the problem is convex yet not strongly. So it it can be that both methods generate different results. It is interesting that you find Majorization Minimization to work better for you. I'm glad I could help. $\endgroup$
    – Royi
    Commented Jul 6, 2023 at 17:47
  • $\begingroup$ @Royi, Working in the sense, I am not a professional. I am a student doing research in signal processing. I do not use the code for commercial purpose :) $\endgroup$
    – ADDY
    Commented Jul 28, 2023 at 14:22
-1
$\begingroup$

This is relatively straight forward if you have decent signal to noise ratio at all frequencies. Since you have simulated this in double precision this can be easily done with something like

objectiveFunction  = real(ifft(fft(y,8192)./fft(sig',8192))); 
sDiff = s-objectiveFunction(1:length(s));
fprintf('Recovery error= %6.2fdB\n',10*log10(mean(sDiff.^2)./mean(s.^2)));

In practice that doesn't work that well since any real world measurement will have bad signal to noise ratio at some frequency and you need ALL frequencies to properly reconstruct the time domain signal.

In that case you may have to do bandpass reconstruction or try to fill in, interpolate or repair the bad frequency points.

If that's not good enough, you can set it up as a least square error problem in the time domain: Convolution can be expressed as a matrix multiplication and you just need to invert this equation.

I'm guessing that nothing will work particularly well with a wavelet input signal since they are very narrow band. Your input signal must have sufficient energy at all frequencies that are relevant to the signal you want to recover. The information at frequencies with insufficient energy is lost in the output signal.

$\endgroup$
2
  • $\begingroup$ Many thanks for your valuable comments. I've now editted the original post adding a sample of experimental data - please could you have a look. I will look at the codes and least square methods you mentioned. And we are not concerned with frequency losses such as the Gibbs phenomenon - the objective function is not perfect step function anyway. $\endgroup$
    – Lampard
    Commented Dec 5, 2020 at 16:52
  • $\begingroup$ This is like doing the 1960's method. It is not relevant. $\endgroup$
    – Mark
    Commented Dec 21, 2021 at 18:43

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.