Questions tagged [linear-algebra]

is a branch of algebra, concerning linear nature of objects: vector or vector spaces, linear transformations, systems of linear equations, quadratic and bi-linear forms, among the main tools used in linear algebra is the determinants of the matrix pair. The theory of invariants and tensor calculus is usually considered as integral parts of linear algebra.

Filter by
Sorted by
Tagged with
0 votes
1 answer
32 views

How can I express the flipped output of multiplication in function of original inputs?

I have the vector $y = Dx$ where $D$ is a complex matrix with dimension $N \times N$, and $x$ is a complex vector of dimension $N \times 1$. If the vector $y_2 = [y'_N, y'_{N-1}, y'_{N-2},.... , y'_{...
user avatar
  • 589
0 votes
0 answers
18 views

Covariance fitting and Procrustes

I have seen this trick to simplify an optimization problem. I would like to understand the logic behind it. Take two matrices $A$ and $B$ of dimension $N \times N$ and suppose that matrix $B$ is ...
user avatar
  • 103
1 vote
0 answers
49 views

Convolution between a vector and another symmetric vector

Let's have the vector $y = h * x$ where $*$ is the convolution operation, $h$ is the channel with length $N$ and $x$ is a symmetry vector which means $x = [x_M, x_{M-1}, ....,x_0, 0 , x_0, x_1, .... ...
user avatar
  • 589
5 votes
1 answer
235 views

The Matrix Form of a 2D Circular Convolution

I have 3 closely related questions regarding 2d convolutions and how they are represented in matrix form. 1. Miming what happens in 1d, I assume the product of a doubly block circulant matrix $A$ by a ...
user avatar
  • 53
0 votes
0 answers
30 views

Coherence in compresive sensing

I am starting to write my master thesis, and it's in field of compressive sensing. I have some problems with math behind it. I don't understand the concept of matrix coherence. I know how it is ...
user avatar
0 votes
1 answer
53 views

Can we recover a vector from one element of resulted vector after multiplication?

I have a matrix $X = \begin{bmatrix} 0.5000 + 0.5000i & 0.5000 - 0.5000i\\ 0.5000 - 0.5000i & 0.5000 + 0.5000i \end{bmatrix}$ multiplied with a column containing a complex number and its ...
user avatar
  • 61
0 votes
0 answers
29 views

Signal Processing on non-Euclidean domains

I have a very simple yet fundamental question. Suppose I have a vector of data $x \in \mathbb{R}^N$. Without additional information, I guess the majority of people think this vector as defined over ...
user avatar
  • 103
1 vote
1 answer
82 views

Spectral Interpolation vs Linear Interpolation

What is the main edge of using a spectral method (Spectral Intp/Trigonometric Intp) for upsampling or downsampling a signal in comparison to using a linear (Trilinear Intp) method to do the same? I ...
user avatar
1 vote
0 answers
44 views

Reuse channel decoder for a smaller code dimension of linear block codes

I am working with the 5G NR polar code and have implemented the CRC-Aided Successive Cancellation List decoder based on this paper (Tal et al. 2012). As my decoder is only used to decode a limited ...
user avatar
  • 53
2 votes
2 answers
171 views

Decomposing Sobel Filter

I am trying to decompose a Sobel filter into two vectors (column and a row) using Matlab. If our Sobel filter is A = [1 0 -1; 2 0 -2; 1 0 -1] we can get the U, S, V ...
user avatar
5 votes
1 answer
86 views

Converting Hadamard Product into Matrix Multiplication in Image Deconvolution with Total Variation (TV) Using ADMM

I would like to solve the following Image Deconvolution equation by ADMM. $$\mathbf { \min\frac{1}{2}\Vert{Cx-b}\Vert_2^2+\Vert w\circ (D x)\Vert_1 \tag 1}$$ Where, $x$ is a vector of unknown pixel ...
user avatar
5 votes
2 answers
1k views

Generate the Matrix Form of 1D Convolution Kernel

As a follow up to Generate the Matrix Form of 2D Convolution Kernel, could someone explain how to generate the matrix form of a 1D convolution kernel? How different convolutions shapes are handled? ...
user avatar
  • 740
0 votes
0 answers
40 views

Matrix multiplication computational complexity based on radix 2

I am wondering, can we use Radix 2 based computational-complexity calculation for any matrix multiplication whose size is $N$ x $N$ ?? where $N$ = $2^K$ and $K > 1$ is an integer ?? Or it can only ...
user avatar
5 votes
1 answer
175 views

Tikhonov Regularization for Complex Matrices

Tikhonov regularization is used to regularize ill-posed inverse problems if the matrix $A \in \mathbb{R}^{n,m}$ to be inversed has a high condition number. For example $$ A=\begin{bmatrix}1&1\\ 1&...
user avatar
  • 107
5 votes
1 answer
149 views

How to Solve the Image Dehazing Problem Using ADMM?

I want to solve the image dehazing problem using ADMM. I want to use the proximal algorithm to optimize each element. I refer to this treatise: Efficient image dehazing with boundary constraint and ...
user avatar
1 vote
2 answers
104 views

Optimization of square matrix multiplied with another matrix to have the final result a unitary matrix

I have a square matrix $D$ whose size is $m \times m$ multiplied with another $m \times m$ square matrix $C$, I need to optimize the matrix $C$ to have a unitary matrix $DC$. I mean optimize the ...
user avatar
3 votes
1 answer
122 views

Why is incoherence important for compressive sensing?

The literature on compressive sensing (CS) frequently notes that CS relies on two principles: sparsity and incoherence. While I understand why the signal of interest should be sparse in some domain ...
user avatar
  • 31
0 votes
0 answers
34 views

Equation of line in the Homogeneous coordinate system

Given two points P and Q we can convert them to the homogeneous coordinate system, compute their cross product and thus get the ...
user avatar
1 vote
1 answer
114 views

What is the relation between eigenvalues and state-space response in control systems?

I understand the mathematics behind it but I want to know what happens physically in a real-life system. How do the eigenvalues come into the picture from a non-mathematical (physical) point of view? ...
user avatar
  • 11
6 votes
1 answer
240 views

Super Resolution in Frequency Domain Using Compressed Sensing

To be noted that I'm very new to this topic, I would like to understand the fundamentals of how to get Super Resolution in Frequency Domain estimation using the Compressed Sensing Model. I am also ...
user avatar
  • 125
1 vote
1 answer
180 views

Linear correlation of two vectors?

We had a lecture on digital watermark detection using linear correlation. Here it was explained that the linear correlation of two vectors is equal to their scalar product divided by the dimension. So,...
user avatar
8 votes
1 answer
212 views

Circular Convolution as Cyclic Shift Operator

Given the following signal vectors: $$ γ=[ψ_0,0,ψ_1,0,ψ_2,0,…,ψ_{N-1},0]^T\in \mathbb{R}^{2N}, ϕ=[1,\frac{1}{2},0,…,0,\frac{1}{2}]^T \in \mathbb{R}^{2N}$$ I want to show that the convolution of $γ$ ...
user avatar
0 votes
1 answer
78 views

Relation between the matrix trace and the amplitude of each element

Assume a diagonal matrix $\mathbf X$ whose size $N\times N$ and its diagonal elements are $0.5 + 0.5i$, and the vector $\mathbf p$ of size $N\times 1$ whose elements have similar amplitude. I have ...
user avatar
2 votes
0 answers
95 views

Taylor series approximation in Harris corner detection

While watching through the computer vision lecture on interest point detection, computing $E(u,v)$ requires computing the quantity $$E(u,v) = \sum_{x,y}(I(x+u,y+v) - I(x,y))^2$$ In the lecture, $I(x+u,...
user avatar
  • 273
-1 votes
1 answer
75 views

Harris corner detection shape of $E(u,v)$

I am taking a computer vision class and I have just learnt about the Harris corner detection concept. A corner is detected when a small shift in a window function defined around the corner results in ...
user avatar
  • 273
0 votes
1 answer
49 views

Transform a data set by exploting the vectorfield

I am somewhat new in the field of Digital Signal Processing / Image processing. As shown in the figure, I have 4 straight lines $f_i(x)$ with $i = 1,\dots, 4$ that pass through $g(x)$. Similiarly ...
user avatar
6 votes
2 answers
66 views

Image Matrix Vector Representation for the Degradation Model

I am trying to understand the the degradation model equation but I have doubt that how come y^t.x.h will be equal to x^t.h^t.y . Aren't they transpose of each other.
user avatar
4 votes
1 answer
76 views

Minimize the Cost Function of Values of Vectors Based on Their Amplitude

I have two vectors $X = [x_1,x_2,x_3,x_4]$; and $Y = [y_1,y_2,y_3,y_4]$; I know that $|x_1|$ = $|y_1|$, and $|x_2|$ = $|y_2|$,... so on. it means the difference is only in the sign. it might be ...
user avatar
  • 589
1 vote
0 answers
104 views

A hypercomplex encoding to preserve spatial/temporal information? [closed]

I have recently come across the idea of encoding a 1D signal (i.e. a mono audio) as a complex vector instead of as a vector of reals, where the imaginary part is used to encode the cells' positions. ...
user avatar
  • 11
-2 votes
1 answer
31 views

What do coeffcients mean from Matlab?

I ask for a brief explanation of each coefficient and their sources of related information. Thank you very much in advance. The coefficients comes from this code below: I've got a robust linear ...
user avatar
0 votes
4 answers
75 views

On the simplification using trigonometric functions

Assume I have a matrix $D$ whose its entries are as below : Where $A$ and $B$ can be written using using the trigonometric functions for (1) as: My question, Is it possible to simplify (1) more? ...
user avatar
  • 589
0 votes
0 answers
78 views

unitary matrix complexity multiplication

Having a unitary matrix $X$ whose size is $n \times n$ and a vector $z$ whose length is $n$, and let's have: $$y = X^H {\rm diag}(z)X$$ where $X^H$ is the conjugate transpose of $X$. My question,...
user avatar
1 vote
1 answer
67 views

Calculate the Derivative of Gradient Field of an Image

I meet a confusing thing in image processing recently.... Assume the image $x \in \mathbb{R}^n$, with its derivative (difference) matrix: $D^+ = \begin{bmatrix} D_h \\ Dv \end{bmatrix} \in \mathbb{R}...
user avatar
0 votes
1 answer
117 views

Sparse recovery, Restricted Isometry Property for ILL-POSED problems

if $\mathbf x$ is $N\times 1$ sparse vector, and $\mathbf A$ is an $M\times N$ matrix with $M<<N$, and we measure $\mathbf y=\mathbf{Ax}$, then compressed sensing theory tells us that we can ...
user avatar
0 votes
0 answers
43 views

Expectation of a constant diagonal matrix

Is the expected value of a diagonal matrix with constant entries equal to the mean value of the entries? My question stems from the following observation in a paper. Given a real diagonal matrix $\...
user avatar
  • 137
0 votes
1 answer
88 views

On the use of Permutation matrix to perform iFFT

I have a question about using the permutation matrix for performing $iFFT$ for such matrix and then reshape it row-wise and column-wise way. Let's say that we have a random matrix $x$ whose size is (...
user avatar
  • 589
3 votes
2 answers
92 views

Proving that a product of matrices invertible

Given $R_x$ a Positive Definite (PD) covariance matrix of size $M\times M$ and $C$ a full rank $M \times N$ matrix, I want to prove that $C^* R_x^{-1} C$ is invertible to derive the Linearly ...
user avatar
  • 198
2 votes
2 answers
488 views

Solve Undetermined Linear System Using NumPy's `lstsq()` Function

I would like to understand what I am doing wrong here. I am trying to perform polynomial regression by minimizing the least squares, $||Au-y||^2$, where $y$ is the given data and $A$ is the matrix ...
user avatar
5 votes
1 answer
298 views

Orthogonal Basis for a 2D Signals (Compressive Sensing)

I have a 2-D signal that is (1536x128) and that is sparse in the Fourier domain (after applying fft2). I want to apply compressive sensing to recover the signal using fewer random elements, but I am ...
user avatar
  • 73
1 vote
0 answers
54 views

Does this system of equations have a solution?

My heuristic approaches to find a solution for the following system of equations have failed so far. Does a solution exist? $$ \left[ {\begin{array}{cc} a_k & 0 \\ a_{k-1} & a_k \\ ...
user avatar
  • 243
5 votes
1 answer
90 views

Implementation of Block Orthogonal Matching Pursuit (BOMP) Algorithm - Fix Given Code [closed]

This is my implementation which doesn't work: ...
user avatar
  • 105
0 votes
1 answer
106 views

Linear interpolation formula

In the following lecture: http://www.ece.mcmaster.ca/~xwu/interp_1.pdf the model (formula) for solving the linear interpolation problem (1D) given at p.5 is: $f(x)= a_1x_1 + a_0x_0$ solve for $a1,...
user avatar
3 votes
2 answers
381 views

Implementation of Block Orthogonal Matching Pursuit (BOMP) Algorithm [closed]

How would one implement the Block Orthogonal Matching Pursuit (BOMP) Algorithm in MATLAB?
user avatar
  • 105
-1 votes
1 answer
84 views

Graph Fourier transform: the adjoint notation for the eigenbasis matrix

I already asked this question here but there is no response. I'd like to ask this question in signal processing domain. It is well-known that for a real symmetric matrix $L$ (here, graph ...
user avatar
  • 201
1 vote
2 answers
2k views

Using Linear Algebra for DSP

I am new to DSP in general, but can one use linear algebra by itself to characterize a signal? My first idea was to transform the signal into a matrix and then use the determinate to characteristic ...
user avatar
2 votes
0 answers
35 views

A good reference for matrix completion [closed]

Does anyone know a complete reference or book on matrix completion?
user avatar
  • 477
5 votes
1 answer
110 views

Resources on Solving Convex Optimization Problems in the Compressed Sensing Field

When I read papers of compressed sensing, sparse representation and whatever requiring optimization of a cost function, I just find the final results as an iterative equation or so which will converge ...
user avatar
  • 477
5 votes
2 answers
386 views

The Gradient / Derivative of Least Squares of 2D Image Convolution

Given the objective function: $$ \frac{1}{2} {\left\| h \ast x - y \right\|}_{2}^{2} $$ Where $ h $ is the 2D convolution kernel and $ x $ is the 2D convolution image and $ y $ is a given 2D image. ...
user avatar
  • 40.5k
-1 votes
1 answer
63 views

STBC Rank Criteria Explanation

I am learning about space-time block coding and I am trying to understand why the rank criteria is a good measure of diversity gain. I know that we want to maximize the distance between codewords $X_i,...
user avatar
  • 1
7 votes
4 answers
1k views

Sequential Form of the Least Squares Estimator for Linear Least Squares Model

I'm currently working on a project in which I need to find the tilt of a surface. Let's assume I'm only concerned with a single dimension tilt (i.e. slope) to begin. I currently have the ability to ...
user avatar
  • 737