Questions tagged [linear-algebra]

is a branch of algebra, concerning linear nature of objects: vector or vector spaces, linear transformations, systems of linear equations, quadratic and bi-linear forms, among the main tools used in linear algebra is the determinants of the matrix pair. The theory of invariants and tensor calculus is usually considered as integral parts of linear algebra.

Filter by
Sorted by
Tagged with
1
vote
0answers
65 views

A hypercomplex encoding to preserve spatial/temporal information? [closed]

I have recently come across the idea of encoding a 1D signal (i.e. a mono audio) as a complex vector instead of as a vector of reals, where the imaginary part is used to encode the cells' positions. ...
-2
votes
1answer
26 views

What do coeffcients mean from Matlab?

I ask for a brief explanation of each coefficient and their sources of related information. Thank you very much in advance. The coefficients comes from this code below: I've got a robust linear ...
0
votes
4answers
61 views

On the simplification using trigonometric functions

Assume I have a matrix $D$ whose its entries are as below : Where $A$ and $B$ can be written using using the trigonometric functions for (1) as: My question, Is it possible to simplify (1) more? ...
0
votes
0answers
58 views

unitary matrix complexity multiplication

Having a unitary matrix $X$ whose size is $n \times n$ and a vector $z$ whose length is $n$, and let's have: $$y = X^H {\rm diag}(z)X$$ where $X^H$ is the conjugate transpose of $X$. My question,...
1
vote
1answer
41 views

Calculate the Derivative of Gradient Field of an Image

I meet a confusing thing in image processing recently.... Assume the image $x \in \mathbb{R}^n$, with its derivative (difference) matrix: $D^+ = \begin{bmatrix} D_h \\ Dv \end{bmatrix} \in \mathbb{R}...
0
votes
1answer
44 views

Sparse recovery, Restricted Isometry Property for ILL-POSED problems

if $\mathbf x$ is $N\times 1$ sparse vector, and $\mathbf A$ is an $M\times N$ matrix with $M<<N$, and we measure $\mathbf y=\mathbf{Ax}$, then compressed sensing theory tells us that we can ...
0
votes
0answers
38 views

Expectation of a constant diagonal matrix

Is the expected value of a diagonal matrix with constant entries equal to the mean value of the entries? My question stems from the following observation in a paper. Given a real diagonal matrix $\...
0
votes
0answers
21 views

The reconstruction of probabilistically sparse signals

Consider we have a vector $\boldsymbol{x}_1^n$ which has a sparse structure in the sense that \begin{equation} \mathbb{P}(x_i=0)=\alpha>0. \end{equation} Further, assume that we have a sampled ...
0
votes
1answer
64 views

On the use of Permutation matrix to perform iFFT

I have a question about using the permutation matrix for performing $iFFT$ for such matrix and then reshape it row-wise and column-wise way. Let's say that we have a random matrix $x$ whose size is (...
0
votes
0answers
23 views

Stereo echo cancellation for stationary source locations: why does adaption stagnate?

In a stereo echo cancellation system, the echo path for the far-end-signal in the near-end room is estimated by an adaptive filter. Since the same signal is transmitted by two similar far-end paths, ...
3
votes
2answers
84 views

Proving that a product of matrices invertible

Given $R_x$ a Positive Definite (PD) covariance matrix of size $M\times M$ and $C$ a full rank $M \times N$ matrix, I want to prove that $C^* R_x^{-1} C$ is invertible to derive the Linearly ...
0
votes
1answer
87 views

Orthogonal Basis for a 2D Signals (Compressive Sensing)

I have a 2-D signal that is (1536x128) and that is sparse in the Fourier domain (after applying fft2). I want to apply compressive sensing to recover the signal using fewer random elements, but I am ...
1
vote
0answers
52 views

Does this system of equations have a solution?

My heuristic approaches to find a solution for the following system of equations have failed so far. Does a solution exist? $$ \left[ {\begin{array}{cc} a_k & 0 \\ a_{k-1} & a_k \\ ...
0
votes
0answers
89 views

Intuition behind using basis functions to optimize discretization of a 2D image obtained via projections

If I am not mistaken, the technique used to avoid a pixelated appearance of CAT scan images described as basis functions on page 4032 of this paper is not unique to CAT scan, and probably applied to ...
2
votes
1answer
53 views
0
votes
1answer
48 views

Linear interpolation formula

In the following lecture: http://www.ece.mcmaster.ca/~xwu/interp_1.pdf the model (formula) for solving the linear interpolation problem (1D) given at p.5 is: $f(x)= a_1x_1 + a_0x_0$ solve for $a1,...
0
votes
2answers
151 views

Implementation of Block Orthogonal Matching Pursuit (BOMP) Algorithm [closed]

How would one implement the Block Orthogonal Matching Pursuit (BOMP) Algorithm in MATLAB?
0
votes
1answer
42 views

Graph Fourier transform: the adjoint notation for the eigenbasis matrix

I already asked this question here but there is no response. I'd like to ask this question in signal processing domain. It is well-known that for a real symmetric matrix $L$ (here, graph ...
1
vote
2answers
555 views

Using Linear Algebra for DSP

I am new to DSP in general, but can one use linear algebra by itself to characterize a signal? My first idea was to transform the signal into a matrix and then use the determinate to characteristic ...
2
votes
0answers
25 views

A good reference for matrix completion [closed]

Does anyone know a complete reference or book on matrix completion?
0
votes
1answer
48 views

Resources on Solving Convex Optimization Problems in the Compress Sensing Field

When I read papers of compressed sensing, sparse representation and whatever requiring optimization of a cost function, I just find the final results as an iterative equation or so which will converge ...
2
votes
2answers
105 views

The Gradient of Least Squares of 2D Image Convolution

Given the objective function: $$ \frac{1}{2} {\left\| h \ast x - y \right\|}_{2}^{2} $$ Where $ h $ is the 2D convolution kernel and $ x $ is the 2D convolution image and $ y $ is a given 2D image. ...
0
votes
1answer
44 views

STBC Rank Criteria Explanation

I am learning about space-time block coding and I am trying to understand why the rank criteria is a good measure of diversity gain. I know that we want to maximize the distance between codewords $X_i,...
4
votes
4answers
675 views

Sequential Form of the Least Squares Estimator for Linear Least Squares Model

I'm currently working on a project in which I need to find the tilt of a surface. Let's assume I'm only concerned with a single dimension tilt (i.e. slope) to begin. I currently have the ability to ...
-1
votes
1answer
182 views

How to implement discrete extended kalman filter in matlab

I have a nonlinear system, and I need to use the extended kalman filter to estimate it. I know I need the jacobian, but once I get that, is everything else the same as the normal kalman filter? I ...
1
vote
2answers
112 views

Check whether a given equation is linear

$ a = (x, y) \in \mathbb{Z}^2 $ is given as a pixel. My equation in which $g$ is image(matrix) is defined as, $f(x, y) = 56g(x,y)+93g(x−1,y)+92g(x+1, y)−57g(x, y−1)+555g(x, y+1) $ How can we know ...
1
vote
1answer
51 views

DFT as an Orthogonal Basis Change

In one of the homeworks that I am dealing with for Linear Systems course, I have encountered with such a statement: Consider $\mathbb{C}^N$ the vector space of N dimensional complex vectors. We can ...
1
vote
2answers
144 views

Conversion from stationarity to non-stationarity

Is there any way to convert a non-stationary signal to a stationary one, perform operations on it meant for a stationary signal and then convert it back to the non-stationary one?
4
votes
1answer
805 views

How to Check Separability of 2D Signal / Matrix

suppose x(n1,n2) = {1 ,n1=0,n2=0 ; 2 ,n1=1,n2=0 ; 3 ,n1=0,n2=1 ; 6 ,n1=1,n2=1 } then, how do i prove it is separable.
0
votes
1answer
1k views

How do I apply a binary mask and STFT to produce an audio file?

So here's the idea: you can generate a spectrogram from an audio file using shorttime Fourier transform (stft). Then some people have generated something called a "binary mask" to generate different ...
2
votes
1answer
205 views

How Does Mean Centering Affect the Result of Using SVD to Compress Images?

I have been learning about using the Singular Value Decomposition to find low rank approximations to matrices. I had an image which I converted to a matrix. I regarded each row of the matrix as a '...
3
votes
2answers
381 views

What is the relation between kernel functions, kernels used in convolution and null spaces of a matrix?

I have recently started learning about machine learning and have come across kernels and null spaces. I understand that null space is the set of all vectors that satisfy the equation A.v = 0 (Where A ...
1
vote
1answer
370 views

How Can PCA Be Used in Image Analysis [closed]

I am still a not how PCA can be used in image analysis and where is it is mostly used. For example how can PCA be used in order to differentiate between different faces? Can you please mention other ...
3
votes
0answers
145 views

Multilateration of Sound in 3D Space

TL:DR - How can you find the 3D coordinates of a emitter than transmits an impulse signal? STORY: I'm working on something to improve my bird-watching. I've got a camera that can take pictures of ...
0
votes
3answers
128 views

Least Squares with Blocks / Updates

I have a continuous-time system that I want to fit via least squares. I just send $N$ digital samples $x[n]$ through the system and receive (via analog signal chain, ADC etc) $N$ digital samples $y[n]$...
1
vote
0answers
43 views

Required number of measrments for signal recovery in a compressed sensing MMV problem?

For multiple measurement vector (MMV) problem $Y=AX$ where $A$ is $m \times n$ sensing matrix and $X$ is $n \times L$ matrix haveing K non zero rows. What are the necessary conditions on the ...
2
votes
1answer
398 views

Signals and systems book with linear algebra approach

I am currently taking a course on discrete-time signals and systems. I am using B. P. Lathi's Signal Processing and Linear Systems, which I don't like at all, as it doesn't draw any paralells to ...
0
votes
1answer
144 views

Tikhonov Regularization Alternate Formulation

2.2 Tikhonov Reqularization Tikhonov regularization, named for Russian mathematician Andrey Tikhonov, attempts to fix the issue that arises when the least squares method is used with an ill-posed ...
0
votes
1answer
1k views

3D world homography matrix calculation

I have a matrix in (x,y,z) coordinates and also i have a transformed version like (x_new,y_new,z_new). I need to calculate a transformation matrix that can transform (x,y,z) to (x_new,y_new,z_new). ...
0
votes
1answer
29 views

Are there analogues to orthogonal transformations in non-orientable surfaces?

I am working on extremely large, symmetric matrices of counts, and attempting to identify patterns/shapes within them. Wavelets are a popular tool in image processing, and have some nice statistical ...
4
votes
1answer
167 views

Time domain basis

I have some troubles with understanding time domain, not on the intuitive level, but in math terms. For example I have a vector signal $$ x = [x_0,x_1,x_2,...,x_{N-1}]$$ I understand that generally ...
4
votes
1answer
174 views

Underdetermined deconvolution of windowed output

Consider a discrete 'blurred' output $h[t]$ given by the convolution of filter $f[t]$ and signal $g[t]$. This question considers recovering $g[t]$ from a window (subset) of $h[t]$. This causes the ...
2
votes
1answer
78 views

Can linear transforms of vector space be seen as LTI systems? [duplicate]

Linear transforms of vector spaces has the linearity (i.e., homogeneity and superimposability), which is shared by LTI system. There are also shared concepts such as eigenvectors/eigenvalue... I am ...
2
votes
0answers
176 views

Deterministic method to compute “Process noise covariance matrix, Q” for a Kalman filter when parameter variations of the model is known apriori

I am implementing a Kalman filter (for a linear ODE system for now). My model represents a physical device that has 6 "parameters", i.e. those values of the device do not evolve over time (within a ...
5
votes
3answers
319 views

Group delay of $H(\omega)= 1- re^{j \theta}e^{ - j \omega} $

I'm studying chapter 5 of Discrete-Time Signal Processing 3rd edition by Alan Oppenheim and I'm having serious difficulties understanding how he obtained equation 5.57. For those who don't have this ...
6
votes
6answers
439 views

The Least Norm Solution of Under Determined Linear System

Suppose I have a matrix $$A= \begin{pmatrix} 1 & 0 & 1 & 0\\ 0 & 1 & 1& 0\\ \end{pmatrix} $$ where the variables are channel information like assume $X_1$, $X_2$, $X_3$ ...
1
vote
0answers
63 views

Linear Systems, Sparse Solutions, and $4 \times 4$ Sudoku Algorithm [closed]

I am unable to understand the paper Linear Systems, Sparse Solutions, and Sudoku. I have to form a $4 \times 4$ Sudoku using the algorithm in this paper. Can somebody please provide me the algorithm ...
0
votes
1answer
36 views

Help with Determinants [closed]

Okay so i understand the first det, which is why i got the correct solution. However for the second det, im not sure how to solve it since because of the different coefficents (0,2,4) and i tried of ...
0
votes
2answers
503 views

Deriving Frequency Response for 2-pole Zero-Delay Feedback State Variable Filter

I have an existing zero-delay feedback (ZDF) 2-pole state variable filter implementation (along the lines of the theory presented in VA Filter Design by V. Zavalishin), and I wish to determine the ...
3
votes
1answer
104 views

Restriction of Fourier Transform

I am currently reading Candes et. al.'s 2006 paper[1] on recovery of sparse signals from incomplete frequency samples. I am having trouble figuring out what is the form of the Fourier transform ...