Questions tagged [sparse-model]
The sparse-model tag has no usage guidance.
29 questions
0
votes
1
answer
127
views
Is there a formal definition of what it means for a signal to be sparse?
Up to now I've never found a rigorous or a formal definition of what it means for a signal to be sparse other than it means that it has a relatively low number of non-zero entries or that the ...
- 139
1
vote
0
answers
28
views
What are the modes of a transform basis?
So, I'm reading Steven Brunton's book, "Data Driven Science & Engineering", and I'm trying to understand what he means by mode in this following excerpt:
Most natural signals, such as ...
- 139
0
votes
0
answers
39
views
deconvolution in frequncy vs in time for sparse \ smooth signals
I have a noisy signal $f(t)$ that is measured in time, and I am interested in estimating it's power spectrum, or frequency content. The signal has an impulse response so it can be described as a sum ...
- 123
1
vote
0
answers
63
views
Parameter choice rules for L1 regularization?
I am solving an L1 regularized least squares of the form like:
$$ \arg \min_{\boldsymbol{x}} \frac{1}{2} {\left\| A \boldsymbol{x} - \boldsymbol{y} \right\|}_{2}^{2} + \lambda {\left\| \boldsymbol{x} \...
- 123
1
vote
0
answers
60
views
Sparse Fourier Transform for Sparse Pulse Trains
So I have signals for the form:
$$x_{k}(t) = \sum_{n=0}^{N} a_{k,n} \cdot \delta(t - nT_k)$$
that I receive as a superposition:
$$x(t) = \sum_{k=0}^{K} \sum_{n=0}^{N} a_{k,n} \cdot \delta(t - nT_k)$$
...
- 632
4
votes
1
answer
76
views
custom raw compression
I'm planning to acquire between 50k and 200k image per day with a 50MPixels (or 68MPixels or 130MPixels) sensor; I'll be acquiring the raw data (10 or 12 or 14 bits) from the sensor through SLVS-EC ...
- 139
5
votes
1
answer
303
views
Solving a Weighted Basis Pursuit Denoising Problem (BPDN) with MATLAB / CVX
Following up from an answer by @Royi on adding weights to BPDN problem , I would like to use CVX to test this approach. How can we formulate in CVX the regularized LS L1 norm with weights given by a ...
- 588
4
votes
1
answer
109
views
Adding Variance \ Weights Information When Solving a Basis Pursuit Denoising Problem (BPDN)
Having a "measured" vector $\mathbf{y}$ with its statistics (counts or variance per element), one can use weighted least squares approach to solve the linear system $$\mathbf{A}\mathbf{x} = \...
- 588
0
votes
1
answer
71
views
how do you know if your matrix is sparse after sparsifying transform?
To successfully compress the data using Compressive Sensing method, I need to have sparse vector, theoretically a vector is sparse if the entries of the vector has many zero or nearly zero. My ...
0
votes
1
answer
76
views
Sparse FFT of ramp using zero padding
I would like to sparsely represent a linear function/ramp in the Fourier domain. In an attempt to improve the sparsity, I have zero padded it. With this padding, it is possible in the example I tried ...
- 111
5
votes
1
answer
143
views
Differences Between Two $ {L}_{1} $ Norm Minimization Schemes
I was reading and working with L1 regularized least squares, where:
$$ \arg \min_{\boldsymbol{x}} \frac{1}{2} {\left\| A \boldsymbol{x} - \boldsymbol{y} \right\|}_{2}^{2} + \lambda {\left\| \...
- 123
3
votes
3
answers
663
views
Improving Main Lobe Width of FFT
It is common knowledge that the duration time samples are collected is inversely proportional to the width of the main lobe in the Fourier domain. The simple example is the rectangular pulse in time ...
- 31
0
votes
1
answer
50
views
Is it common to impose the sparsity on the Fourier coefficient itself?
In compressive sensing, I see many works to impose the sparsity on the wavelet coefficients (e.g., by minimizing the L1 norm of such coefficients.) Another example in MRI is to impose sparsity on the ...
- 457
1
vote
0
answers
132
views
A hypercomplex encoding to preserve spatial/temporal information? [closed]
I have recently come across the idea of encoding a 1D signal (i.e. a mono audio) as a complex vector instead of as a vector of reals, where the imaginary part is used to encode the cells' positions. ...
- 11
5
votes
1
answer
309
views
Solving LASSO (Basis Pursuit Denoising Form) with LARS
I'm now working on using LARS (Least Angle Regression) algorithm to solve a LASSO problem in Basis Pursuit Denoising form like:
\begin{align*}
\quad && \arg \min_{\beta}{\left\| y - X\beta \...
- 53
2
votes
0
answers
30
views
Solving Sparse Model with given Dictionary Using LASSO
I was trying to solve a problem where the basis matrix contains the components of $\sin(nx)$, $\cos(nx)$, $\sinh(nx)$ and $\cosh(nx)$.
Say the $n$ varies from 1 to 100. While solving the lasso linear ...
- 311
4
votes
1
answer
138
views
Implementation of Block Orthogonal Matching Pursuit (BOMP) Algorithm - Fix Given Code [closed]
This is my implementation which doesn't work:
...
- 85
2
votes
2
answers
721
views
Implementation of Block Orthogonal Matching Pursuit (BOMP) Algorithm [closed]
How would one implement the Block Orthogonal Matching Pursuit (BOMP) Algorithm in MATLAB?
- 85
5
votes
1
answer
141
views
Convex Optimization with $ {L}_{1, 2} $ Regularization Term
I have an optimization problem such as follow:
$$\underset{X}{\operatorname{argmin}}\sum _s \left \| T_sX_{:,s} - Y_{:,s} \right \|^2_2 +\lambda\left \| GX \right \|_{2,1} \tag{1}$$
I have introduced ...
- 169
4
votes
2
answers
341
views
Constrained LASSO Problem - $ {L}_{1} $ Regularized Least Squares with Linear Equality Constraints
I have an optimization question.
I want to solve the following problem:
$$
\arg\min_S\frac{1}{2}\|s-c\|_2^2 +\lambda\|\Phi s\|_1 \mbox{ s.t. } As = 0
$$
in which $\Phi$ is the wavelet transform ...
- 45
0
votes
0
answers
41
views
Implementation of PCA for hyper-spectral Image Processing
I have been studying the concept of PCA and its implementation for dimensionality reduction for more than 1 month. My goal is to classify a hyperspectral image using sparse representation by the ...
- 113
3
votes
4
answers
483
views
Estimate peak width from a vector that is a superposition of unknown number of identical Gaussian peaks with different heights?
If you have a vector that is a superposition of an unknown number of identical Gaussian shaped peaks/impulses of unknown width (but all the same width) and different amplitudes (with Poisson or ...
- 151
6
votes
2
answers
339
views
Is There a Sparse Representation for Noise?
Is there sparse representation for stationary noise and nonstationary noise?
How can I learn dictionary for each noise class?
(my mean of noise is noises with which speech signals are often ...
- 61
2
votes
2
answers
173
views
Compressive Sensing and Sparsity
We apply compressive sensing to reconstruct a signal if it is sparse in the original domain or has a sparse represetation in some basis.
How we may know a if a signal is sparse or has a sparse ...
- 127
2
votes
2
answers
2k
views
Ifft through Matrix multiplication
I am still new to MATLAB, so apologies if I sound lazy to you. I am attempting to model a transformation as a set of matrix operations. I start with a vector, up-sample it by $U$ (up-sampling rate), ...
- 163
0
votes
2
answers
348
views
How to make the impulse response sparse? How does one know that the channel is sparse?
I am new to sparse channel estimation algorithms and reading research articles. One such paper is blind sparse channel estimation using a modification of the BOMP technique titled, "Blind Acoustic ...
- 869
1
vote
2
answers
1k
views
When can the impulse response become zero?
The article Efficient Use Of Sparse Adaptive Filters (Proc. Asilomar Conference, Khong et al., 2006) introduces adaptive filters for the estimation of channels or systems having a sparse impulse ...
- 869
5
votes
1
answer
429
views
Why Sparse Priors Like Total Variation Opts to Concentrate Derivatives at a Small Number of Pixels?
When performing image deconvolution (deblurring), people often make use of priors to get rid of the illness of the problem. One very common prior is total variation, a sparse prior. Compared to ...
- 497
10
votes
3
answers
2k
views
Denoising by DCT and hard thresholding
If I have an image and I find the DCT and then apply hard thresholding on the coefficients and then IDCT then I have attenuated the noise.
Can someone please explain in detail or point me to the ...
- 101