Questions tagged [linear-algebra]

is a branch of algebra, concerning linear nature of objects: vector or vector spaces, linear transformations, systems of linear equations, quadratic and bi-linear forms, among the main tools used in linear algebra is the determinants of the matrix pair. The theory of invariants and tensor calculus is usually considered as integral parts of linear algebra.

Filter by
Sorted by
Tagged with
1
vote
2answers
137 views

Decomposing Sobel Filter

I am trying to decompose a Sobel filter into two vectors (column and a row) using Matlab. If our Sobel filter is A = [1 0 -1; 2 0 -2; 1 0 -1] we can get the U, S, V ...
3
votes
1answer
58 views

Converting Hadamard Product into Matrix Multiplication in Image Deconvolution with Total Variation (TV) Using ADMM

I would like to solve the following Image Deconvolution equation by ADMM. $$\mathbf { \min\frac{1}{2}\Vert{Cx-b}\Vert_2^2+\Vert w\circ (D x)\Vert_1 \tag 1}$$ Where, $x$ is a vector of unknown pixel ...
3
votes
2answers
458 views

Generate the Matrix Form of 1D Convolution Kernel

As a follow up to Generate the Matrix Form of 2D Convolution Kernel, could someone explain how to generate the matrix form of a 1D convolution kernel? How different convolutions shapes are handled? ...
0
votes
0answers
33 views

Matrix multiplication computational complexity based on radix 2

I am wondering, can we use Radix 2 based computational-complexity calculation for any matrix multiplication whose size is $N$ x $N$ ?? where $N$ = $2^K$ and $K > 1$ is an integer ?? Or it can only ...
4
votes
1answer
107 views

Tikhonov Regularization for Complex Matrices

Tikhonov regularization is used to regularize ill-posed inverse problems if the matrix $A \in \mathbb{R}^{n,m}$ to be inversed has a high condition number. For example $$ A=\begin{bmatrix}1&1\\ 1&...
4
votes
1answer
123 views

How to Solve the Image Dehazing Problem Using ADMM?

I want to solve the image dehazing problem using ADMM. I want to use the proximal algorithm to optimize each element. I refer to this treatise: Efficient image dehazing with boundary constraint and ...
1
vote
2answers
92 views

Optimization of square matrix multiplied with another matrix to have the final result a unitary matrix

I have a square matrix $D$ whose size is $m \times m$ multiplied with another $m \times m$ square matrix $C$, I need to optimize the matrix $C$ to have a unitary matrix $DC$. I mean optimize the ...
2
votes
1answer
55 views

Why is incoherence important for compressive sensing?

The literature on compressive sensing (CS) frequently notes that CS relies on two principles: sparsity and incoherence. While I understand why the signal of interest should be sparse in some domain ...
0
votes
0answers
29 views

Equation of line in the Homogeneous coordinate system

Given two points P and Q we can convert them to the homogeneous coordinate system, compute their cross product and thus get the ...
1
vote
1answer
52 views

What is the relation between eigenvalues and state-space response in control systems?

I understand the mathematics behind it but I want to know what happens physically in a real-life system. How do the eigenvalues come into the picture from a non-mathematical (physical) point of view? ...
4
votes
1answer
198 views

Super Resolution in Frequency Domain Using Compressed Sensing

To be noted that I'm very new to this topic, I would like to understand the fundamentals of how to get Super Resolution in Frequency Domain estimation using the Compressed Sensing Model. I am also ...
1
vote
1answer
112 views

Linear correlation of two vectors?

We had a lecture on digital watermark detection using linear correlation. Here it was explained that the linear correlation of two vectors is equal to their scalar product divided by the dimension. So,...
6
votes
1answer
156 views

Circular Convolution as Cyclic Shift Operator

Given the following signal vectors: $$ γ=[ψ_0,0,ψ_1,0,ψ_2,0,…,ψ_{N-1},0]^T\in \mathbb{R}^{2N}, ϕ=[1,\frac{1}{2},0,…,0,\frac{1}{2}]^T \in \mathbb{R}^{2N}$$ I want to show that the convolution of $γ$ ...
0
votes
0answers
34 views

Normalizing directed graphs from image space to compute joint differences

My question is how to transform a 'skeleton' (directed graph) from image space so that I can compare it joint-wise against another 'template' or reference skeleton that may be differently sized/...
0
votes
1answer
61 views

Relation between the matrix trace and the amplitude of each element

Assume a diagonal matrix $\mathbf X$ whose size $N\times N$ and its diagonal elements are $0.5 + 0.5i$, and the vector $\mathbf p$ of size $N\times 1$ whose elements have similar amplitude. I have ...
2
votes
0answers
59 views

Taylor series approximation in Harris corner detection

While watching through the computer vision lecture on interest point detection, computing $E(u,v)$ requires computing the quantity $$E(u,v) = \sum_{x,y}(I(x+u,y+v) - I(x,y))^2$$ In the lecture, $I(x+u,...
0
votes
1answer
38 views

Harris corner detection shape of $E(u,v)$

I am taking a computer vision class and I have just learnt about the Harris corner detection concept. A corner is detected when a small shift in a window function defined around the corner results in ...
0
votes
1answer
45 views

Transform a data set by exploting the vectorfield

I am somewhat new in the field of Digital Signal Processing / Image processing. As shown in the figure, I have 4 straight lines $f_i(x)$ with $i = 1,\dots, 4$ that pass through $g(x)$. Similiarly ...
4
votes
2answers
48 views

Image Matrix Vector Representation for the Degradation Model

I am trying to understand the the degradation model equation but I have doubt that how come y^t.x.h will be equal to x^t.h^t.y . Aren't they transpose of each other.
2
votes
1answer
63 views

Minimize the Cost Function of Values of Vectors Based on Their Amplitude

I have two vectors $X = [x_1,x_2,x_3,x_4]$; and $Y = [y_1,y_2,y_3,y_4]$; I know that $|x_1|$ = $|y_1|$, and $|x_2|$ = $|y_2|$,... so on. it means the difference is only in the sign. it might be ...
1
vote
0answers
93 views

A hypercomplex encoding to preserve spatial/temporal information? [closed]

I have recently come across the idea of encoding a 1D signal (i.e. a mono audio) as a complex vector instead of as a vector of reals, where the imaginary part is used to encode the cells' positions. ...
-2
votes
1answer
31 views

What do coeffcients mean from Matlab?

I ask for a brief explanation of each coefficient and their sources of related information. Thank you very much in advance. The coefficients comes from this code below: I've got a robust linear ...
0
votes
4answers
68 views

On the simplification using trigonometric functions

Assume I have a matrix $D$ whose its entries are as below : Where $A$ and $B$ can be written using using the trigonometric functions for (1) as: My question, Is it possible to simplify (1) more? ...
0
votes
0answers
72 views

unitary matrix complexity multiplication

Having a unitary matrix $X$ whose size is $n \times n$ and a vector $z$ whose length is $n$, and let's have: $$y = X^H {\rm diag}(z)X$$ where $X^H$ is the conjugate transpose of $X$. My question,...
1
vote
1answer
58 views

Calculate the Derivative of Gradient Field of an Image

I meet a confusing thing in image processing recently.... Assume the image $x \in \mathbb{R}^n$, with its derivative (difference) matrix: $D^+ = \begin{bmatrix} D_h \\ Dv \end{bmatrix} \in \mathbb{R}...
0
votes
1answer
94 views

Sparse recovery, Restricted Isometry Property for ILL-POSED problems

if $\mathbf x$ is $N\times 1$ sparse vector, and $\mathbf A$ is an $M\times N$ matrix with $M<<N$, and we measure $\mathbf y=\mathbf{Ax}$, then compressed sensing theory tells us that we can ...
0
votes
0answers
41 views

Expectation of a constant diagonal matrix

Is the expected value of a diagonal matrix with constant entries equal to the mean value of the entries? My question stems from the following observation in a paper. Given a real diagonal matrix $\...
0
votes
1answer
81 views

On the use of Permutation matrix to perform iFFT

I have a question about using the permutation matrix for performing $iFFT$ for such matrix and then reshape it row-wise and column-wise way. Let's say that we have a random matrix $x$ whose size is (...
3
votes
2answers
87 views

Proving that a product of matrices invertible

Given $R_x$ a Positive Definite (PD) covariance matrix of size $M\times M$ and $C$ a full rank $M \times N$ matrix, I want to prove that $C^* R_x^{-1} C$ is invertible to derive the Linearly ...
0
votes
2answers
314 views

Solve Undetermined Linear System Using NumPy's `lstsq()` Function

I would like to understand what I am doing wrong here. I am trying to perform polynomial regression by minimizing the least squares, $||Au-y||^2$, where $y$ is the given data and $A$ is the matrix ...
3
votes
1answer
203 views

Orthogonal Basis for a 2D Signals (Compressive Sensing)

I have a 2-D signal that is (1536x128) and that is sparse in the Fourier domain (after applying fft2). I want to apply compressive sensing to recover the signal using fewer random elements, but I am ...
1
vote
0answers
54 views

Does this system of equations have a solution?

My heuristic approaches to find a solution for the following system of equations have failed so far. Does a solution exist? $$ \left[ {\begin{array}{cc} a_k & 0 \\ a_{k-1} & a_k \\ ...
3
votes
1answer
76 views
0
votes
1answer
70 views

Linear interpolation formula

In the following lecture: http://www.ece.mcmaster.ca/~xwu/interp_1.pdf the model (formula) for solving the linear interpolation problem (1D) given at p.5 is: $f(x)= a_1x_1 + a_0x_0$ solve for $a1,...
1
vote
2answers
269 views

Implementation of Block Orthogonal Matching Pursuit (BOMP) Algorithm [closed]

How would one implement the Block Orthogonal Matching Pursuit (BOMP) Algorithm in MATLAB?
0
votes
1answer
64 views

Graph Fourier transform: the adjoint notation for the eigenbasis matrix

I already asked this question here but there is no response. I'd like to ask this question in signal processing domain. It is well-known that for a real symmetric matrix $L$ (here, graph ...
1
vote
2answers
1k views

Using Linear Algebra for DSP

I am new to DSP in general, but can one use linear algebra by itself to characterize a signal? My first idea was to transform the signal into a matrix and then use the determinate to characteristic ...
2
votes
0answers
30 views

A good reference for matrix completion [closed]

Does anyone know a complete reference or book on matrix completion?
3
votes
1answer
89 views

Resources on Solving Convex Optimization Problems in the Compressed Sensing Field

When I read papers of compressed sensing, sparse representation and whatever requiring optimization of a cost function, I just find the final results as an iterative equation or so which will converge ...
4
votes
2answers
248 views

The Gradient of Least Squares of 2D Image Convolution

Given the objective function: $$ \frac{1}{2} {\left\| h \ast x - y \right\|}_{2}^{2} $$ Where $ h $ is the 2D convolution kernel and $ x $ is the 2D convolution image and $ y $ is a given 2D image. ...
0
votes
1answer
53 views

STBC Rank Criteria Explanation

I am learning about space-time block coding and I am trying to understand why the rank criteria is a good measure of diversity gain. I know that we want to maximize the distance between codewords $X_i,...
5
votes
4answers
1k views

Sequential Form of the Least Squares Estimator for Linear Least Squares Model

I'm currently working on a project in which I need to find the tilt of a surface. Let's assume I'm only concerned with a single dimension tilt (i.e. slope) to begin. I currently have the ability to ...
-1
votes
1answer
214 views

How to implement discrete extended kalman filter in matlab

I have a nonlinear system, and I need to use the extended kalman filter to estimate it. I know I need the jacobian, but once I get that, is everything else the same as the normal kalman filter? I ...
1
vote
2answers
133 views

Check whether a given equation is linear

$ a = (x, y) \in \mathbb{Z}^2 $ is given as a pixel. My equation in which $g$ is image(matrix) is defined as, $f(x, y) = 56g(x,y)+93g(x−1,y)+92g(x+1, y)−57g(x, y−1)+555g(x, y+1) $ How can we know ...
1
vote
1answer
91 views

DFT as an Orthogonal Basis Change

In one of the homeworks that I am dealing with for Linear Systems course, I have encountered with such a statement: Consider $\mathbb{C}^N$ the vector space of N dimensional complex vectors. We can ...
1
vote
2answers
209 views

Conversion from stationarity to non-stationarity

Is there any way to convert a non-stationary signal to a stationary one, perform operations on it meant for a stationary signal and then convert it back to the non-stationary one?
6
votes
1answer
1k views

How to Check Separability of 2D Filter / Signal / Matrix

Given: x(n1,n2) = {1 ,n1=0,n2=0 ; 2 ,n1=1,n2=0 ; 3 ,n1=0,n2=1 ; 6 ,n1=1,n2=1 } How could one prove it is ...
0
votes
1answer
1k views

How do I apply a binary mask and STFT to produce an audio file?

So here's the idea: you can generate a spectrogram from an audio file using shorttime Fourier transform (stft). Then some people have generated something called a "binary mask" to generate different ...
3
votes
1answer
709 views

How Does Mean Centering Affect the Result of Using SVD to Compress Images?

I have been learning about using the Singular Value Decomposition to find low rank approximations to matrices. I had an image which I converted to a matrix. I regarded each row of the matrix as a '...
3
votes
2answers
629 views

What is the relation between kernel functions, kernels used in convolution and null spaces of a matrix?

I have recently started learning about machine learning and have come across kernels and null spaces. I understand that null space is the set of all vectors that satisfy the equation A.v = 0 (Where A ...