Questions tagged [least-squares]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
4
votes
6answers
353 views

The Least Norm Solution of Under Determined Linear System

Suppose I have a matrix $$A= \begin{pmatrix} 1 & 0 & 1 & 0\\ 0 & 1 & 1& 0\\ \end{pmatrix} $$ where the variables are channel information like assume $X_1$, $X_2$, $X_3$ ...
1
vote
0answers
23 views

Difference Between a 1st Order SG Filter And a Least Squares Moving Average

I have been studying SG filters and i recently found another filter which seem to be commonly used in financial data smoothing which is the least-squares moving average, this filter is also called ...
0
votes
0answers
25 views

How to find Coefficients of Autoregressive (AR) model using least means square (LMS) Algorithm without having future signal?

I want to do two things. Estimating Coefficients of AR model using LMS Using Coefficients found in step 1 and predict future samples of a signal using AR equation. I don't have a desired signal so I ...
0
votes
1answer
101 views

Range Estimation Based on Distance Differences

It is a range estimation problem, as shown in the figure. The blue circles are the anchor node' positions, which are produced by one moving anchor (the moving direction is shown with black arrow). ...
0
votes
1answer
43 views

Why Would Pre Filtering Measurement Data Affect the Least Squares Estimate?

In estimating parameters in a discrete time model I've often seen the use of filters applied to the input data, before its applied to least squares processing. I've been told that the filters are ...
0
votes
1answer
79 views

Equalizers with low data rate systems

In case of using equalizers with ZigBee systems, what type of fading does the channel show, flat or frequency selective, fast or slow? Is the inter-symbol interference (ISI) problem encountered in ...
1
vote
3answers
612 views

Least Squares and Auto and Cross Correlation

I am trying to understand why auto and cross correlation helps find the best fit line in least squares. I have an equation as stated here: $Ax=b$ -- I have not exact solution, so I use the least ...
1
vote
1answer
90 views

Equivalence of Maximum Likelihood (ML) and Discrete Fourier Transfrom (DFT) Peak Finding for Single Tone Estimation

My understanding is Maximum Likelihood and DFT Peak Finding for a single tone produce the same results assuming the ML is restricted to the same frequencies as the DFT. I was wondering if there was ...
1
vote
1answer
74 views

Deriving the Matrix Inversion Lemma for RLS Equations vs the Woodbury Derivation

Can any one help me in deriving the matrix inversion lemma rule for RLS algorithm? I don't know how to start with. Many books have just stated but they haven't derived it.
2
votes
4answers
291 views

Sequential Form of the Least Squares Estimator for Linear Least Squares Model

I'm currently working on a project in which I need to find the tilt of a surface. Let's assume I'm only concerned with a single dimension tilt (i.e. slope) to begin. I currently have the ability to ...
0
votes
1answer
42 views

Linear Difference Equation and Method of Least Squares

I'm reading the book "Fault-Diagnosis Systems" by Isermann in the par. 9.2.1a. The author explains how to estimate the parameter of a linear difference equation using Least Squares. We start with a ...
1
vote
1answer
98 views

Using MATLAB Function `mpiir_l2()`: Results Are Not IIR but FIR Filters - Why and How to Avoid This?

I'm using mpiir_l2() from user Matt L's PhD thesis to design IIR filters. I set the number of numerator and denominator coefficients both to the same value (between ...
0
votes
1answer
262 views

Design of FIR Filters with Arbitrary Magnitude and Phase Responses

I found many information in this thesis "Algorithms for the Constrained Design of Digital Filters with Arbitrary Magnitude and Phase Responses",i want to understand it. This question is a ...
1
vote
2answers
62 views

What Is the Definition of Linear Predictive Coefficients When the Optimal Value Aren't Unique?

Linear predictive coefficients of signal y are defined as the best $k$ coefficients $a_i, i = 1, \ldots, k$, that will approximate $y_n$ by $-\sum_{i=1}^k{a_iy_{n-i}}$. (Best approximation is that ...
0
votes
1answer
103 views

Received Signal Error vs. BER

It is my understanding that the least squares algorithm (e.g., in equalization) minimizes the received signal error. However, minimizing the received signal error does not necessarily equate to ...
4
votes
1answer
251 views

Direct Correlation (DC) Time Delay Estimation: Variance Keeps Decreasing for Increasing SNR?

I'm trying to reproduce the results from this paper "Discrete time techniques for Time Delay Estimation" doi:10.1109/78.193195, for both the correlation and Least Squares. I've generated a random (...
1
vote
0answers
70 views

Solve for Transfer Function Coefficients Embedded in a Non Linear System

Given a complex input signal $x$ and real input signal $v$, a 4th order (for simplicity) transfer function $H(z)$ is first applied to $v$ to obtain $w$, which in the time domain is represented by the ...
0
votes
1answer
269 views

Estimate a Transfer Function from ARX Models vs. ARIMAX?

There is diffrent models which can be used to create a dynamical model by using least squares. Those models are following: ARX ARMAX ARIMAX OE BJ But if my goal with creating a dynamical model is to ...
0
votes
1answer
296 views

Difference between Leaking Factor and Forgetting Factor

I am using a Recursive least square adaptive filter to process electromyography signals and it is working decently so far. I decided to implement an LMS adaptive filter as a noise cancellation, so ...
0
votes
1answer
67 views

$ \frac{1}{f^2} $ Weighting for Least Squares FIR

I am currently modifying the firls.m from Octave to allow all types of FIRs, differentiators, and Hilbert transformers, while taking a peak at Matlab's. I see there ...
0
votes
1answer
120 views

Least Squares FIR for Type II

Following this paper (see the Matlab example at the end), I am trying to make a least-squares algorithm in Octave, but for type II (I know about firls). For type I ...
0
votes
2answers
320 views

How to Add Group Delay?

I was confused about the value of group delay, I am not sure whether my opinion is correct. For example, if I want to add a group delay of $0.25$ time units to a zero-phase signal, does it mean that I ...
1
vote
2answers
104 views

MATLAB: Implementing Least Squares Estimator for a Given Model

The formula to estimate $\mathbf{h}$ is then $$\hat{\mathbf{h}} = (X^T X)^{-1} X^T \vec{y}\tag{2}$$ I think this can be implemented in Matlab using ...
0
votes
1answer
127 views

How to Apply Least Squares Estimation for Sparse Coefficient Estimation?

The model is expressed as, $$y(n) = \sum_{i=0}^{p-1} r(i) x(n-i) + v(n) \tag{1}$$ where $\mathbf{r} = [r_1,r_2,\ldots,r_p]^T$ is the sparse channel coefficients of length $p$, $\mathbf{x} = [x_1,x_2,....
2
votes
1answer
491 views

What Is the Difference between RLS, LMS and Wiener Filter? When Is One Preferred Over Another?

I'm dealing with a channel equalization problem where the channel is modeled as a WSS process. I understand LMS utilities a Wiener-like approach, ie it converges to the optimal (wiener) solution. I ...
21
votes
3answers
4k views

FIR Filter Design: Window vs Parks McClellan and Least Squares

Are there any advantages to use a window approach over Parks-McClellan (further abbreviated here as PMcC) or Least Squares algorithms for FIR filter design of a low pass filter? Assume with today's ...
0
votes
1answer
64 views

Estimating Damping Factor (Q) from Noisy Measurements

I have a damped, tuned circuit and want to measure its Q factor. The hardware sends an impulse 'ping' and samples the output as it rings down. Is there an efficient way to fit an equation of the form ...
1
vote
0answers
122 views

Instability Problem in Normalized Least Mean Squares (NLMS) Adaptive Algorithm

I have been used NLMS algorithm to equalize 4x4 MIMO signals, but the bit-error-rate (BER) after equalization is unstable with iterations. I don't know if it is the normal behavior of the adaptive ...
2
votes
3answers
248 views

Least Mean Squares (LMS) Filter Weight Update

I have a general question regarding Least mean squares adaptive filters. Using the example of noise cancellation, I understand that if you have a set of reference signals (S) and corrupted signals (S+...
2
votes
1answer
104 views

What is the Technique to Find Variance of Estimation Error

Given an $n$-vector $y$ (responses) and a design matrix $X$, I wish to fit them with a simple linear regression model $$y=X\beta+e,$$ or, $y_t = x_t'\beta_0 + e_t$ where $e\sim\mathcal{N}(0, \sigma^...
4
votes
1answer
1k views

Constant Modulus Algorithm and the Gradient Operation

CMA is a blind channel equalization algorithm with the details presented above. I am facing 3 difficulties and shall appreciate help Q1: Does $H$ and the bar over $\bar{y_k}$ represent the Transpose ...
2
votes
0answers
289 views

Motion Artifact Cancellation from ECG Signal Using 3 Axis Accelerometer Data

I have a ECG signal measured as a test subject is performing 3 different activities - sitting, walking(2mph) and jogging(5mph) and also the corresponding 3-axis accelerometer(X,Y and Z) signals. I can ...
1
vote
0answers
61 views

Solving an Array Signal Processing Estimation Problem based on the Rayleigh Quotient

The Rayleigh quotient for a covariance matrix $\mathbf{C}$ and a non-zero steering vector $\mathbf{a}$ is given by $$ R(\mathbf{C},\mathbf{a}) := \frac{\mathbf{a}^H\mathbf{C}\mathbf{a}}{\mathbf{a}^H\...
3
votes
2answers
10k views

Difference Between Equiripple & Least Squares Design for FIR Digital Filters

For an efficient and optimized digital FIR filter design, there are two methods available broadly, Equiripple filter design & Least Squares filter design. A general method for designing a filter ...
4
votes
2answers
3k views

Estimate the Transfer Function of an Unknown System

Suppose you have a system, H, that you want to estimate its transfer function. You have a finite number of complex input samples, x, and noisy complex (magnitude and phase) output samples, y: In ...
3
votes
3answers
383 views

Force Linear Phase for a FIR Filter Synthesized Using Berchin's FDLS?

As a follow-on to this post, how would you force linear phase for a FIR filter you synthesized using Berchin's FDLS?
1
vote
4answers
224 views

Building a Signal Model for Samples from a Sensor

I have a signal I'm getting from a sensor (shown below in the photo of an excel plot) and I need to process it to get it to look something like the red line I've overdrawn on it. Sort of a moving ...
1
vote
0answers
84 views

How to Approximate / Fit a Function and a Lower Bound on It?

I am dealing with a complicated optimization problem with two parameters $N, K$. Setting $K =$ constant and finding the minimum for different $N$'s lead to a set of function values. I can do this for $...
3
votes
2answers
256 views

How to Combine / Fuse 2 Least Squares Estimates?

Say you want to compute the least squares estimate of $w$ from a data-set: $$ \begin{bmatrix}d_1 \\d_2 \\\vdots\\d_N \end{bmatrix} =\begin{bmatrix} x_1 \\x_2 \\ \vdots \\x_N\end{bmatrix}w + \begin{...
4
votes
3answers
6k views

How to Remove the Periodic Oscillations from a Signal

The task that I have is to remove the annual and semiannual oscillation from a set of temperature measurements, taken over several years, by means of least squares method. I found the method ...
2
votes
2answers
237 views

Questions on Weighted Least Square Estimation

This is a page from the book linear algebra,geodesy and gps by Gilbert Strang.... the page explains about the justification of the inverse of the of the co variance matrix of measurement vector $b$ in ...
2
votes
2answers
160 views

Least Square Error Estimation: Conditions for $ (A^TA)^{ -1} = A^{-1}(A^T)^{-1} $?

I am new to linear algebra and have this simple question... in least sqaure estimation...the best estimation of the equation $Ax = b$ is $x_{Estimated} = A (A^t A )^{-1} A^t b$...the projection of $b$ ...
14
votes
1answer
707 views

How to Improve Least Means Squares (LMS) / NLMS Filter Performance?

Are there ways to increase computational performance of a normalized least squares (NLMS) filter? Multidelay block frequency-domain (MDF) filters have been proposed to do this, but they also take away ...
1
vote
2answers
110 views

Solving a Linear Mean Square Estimation the Easy Way

I have an exercise which is quite trivial. However I got stuck and I'm not sure if this the end-result. I assume there has to be a way to get this result much quicker. Given are two randomly ...
0
votes
1answer
242 views

Least Squares with Non Zero Mean Noise

What happens if the noise has no zero mean? I mean, if the exercise is something like: $$y(k) = A x + \eta(k)$$ When I have zero mean, I start from: $$y = A x$$ $$\Rightarrow \hat{y} = A \hat{x}$$ ...
0
votes
0answers
36 views

Non Linear Recursive / Online Least Squares

I am searching for a recursive or online non linear least squares algorithm. I want to spread the computation out as new data is sampled like in the linear Recursive Least Squares or the LMS. ...
1
vote
1answer
79 views

Adaptive LMS Algorithm MATLAB

I'm having some trouble implementing my LMS Adaptive Filter in MATLAB to separate wideband and narrowband signals from a voice signal. I'm using a delayed version of my input as a reference as well ...
1
vote
1answer
103 views

Sequential Non Linear Least Squares Problem

I have the the following non-linear function, $$s(x;A_k,\mu_k,\sigma_k)=\sum_{k=1}^2 A_k \exp\left(\frac{-(x-\mu_k)^2}{\sigma_k^2}\right)$$ with unknown (but deterministic) parameters $A_k,\mu_k,\...
0
votes
0answers
20 views

Can coefficients of a DWT be computed using least squares approximation?

I assume that it can be computed given function values for each sample as a vector and wavelet values for each scale and translation packed in a matrix. Can anyone clarify the matrix construction and ...
-1
votes
1answer
126 views

Properties of Optimization Techniques in Filter Design

I have this design: Can you tell me about the type of filter and the algorithm just viewing this design, or should there be other information?