Podcast #128: We chat with Kent C Dodds about why he loves React and discuss what life was like in the dark days before Git. Listen now.

Questions tagged [optimization]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
2answers
284 views

Best Metric to Compare Sparsity of Vectors

I solved the Basis Pursuit Denoising Problem looking for a sparse solution (I am in compressive sensing): $$ {x}^{\ast} = \arg \min_{x} \left\{ \frac{1}{2} {\left\| A x - y \right\|}_{2}^{2} + \lambda ...
4
votes
1answer
627 views

What Is the Difference between RLS, LMS and Wiener Filter? When Is One Preferred Over Another?

I'm dealing with a channel equalization problem where the channel is modeled as a WSS process. I understand LMS utilities a Wiener-like approach, ie it converges to the optimal (wiener) solution. I ...
0
votes
1answer
82 views

Signal processing research idea [closed]

I am a graduate student in applied math, specializing mostly in harmonic analysis. My undergraduate studies were mostly in pure math but I realized I prefer the applied/computational side. I was ...
3
votes
1answer
559 views

How Can I Use MATLAB to Solve a Total Variation Denoising Problem?

The Total Variation Denoising Problem is given by: $$ \arg \min_{x} \frac{1}{2} {\left\| A x - y \right\|}_{2}^{2} + \lambda \operatorname{TV} \left( x \right) $$ Where $ \operatorname{TV} \left( \...
0
votes
0answers
33 views

Frequency identification as a convex problem

Suppose I have two time series, $x(t)$ and $y(t)$: $x$ is the output of a sine wave generator, and $y$ is the generator's frequency setting. Given a training set of $(x, y)$ pairs, Is it possible to ...
7
votes
1answer
802 views

Adaptive filtering: Optimum filter length and delay

I'm trying to find the optimum filter length for an Adaptive Filtering, using RLS Algorithm. I'm using this design: So the "error" signal is the signal without noise (and that's the signal that I ...
2
votes
1answer
194 views

Optimization of Filter Coefficients to Given Word Length

It seems to me that this is a difficult mathematical problem where research is still carried on: Is there an efficient way to find fixed-point coefficients whose zeros are closest to those calculated ...
1
vote
0answers
423 views

Finding lag times for multiple time series

I have $N$ time series which have unknown time offsets relative to each other. I want to estimate the $(N - 1)$ time offsets, $\tau_{i,i+1}$, which maximise the sum of the cross-correlations between ...
0
votes
1answer
709 views

Two-View 3D reconstruction using the sparse Levenberg–Marquardt algorithm

I have trouble implementing the Levenberg-Marguardt algorithm as described in the book Multi View Geometry in Computer Vision. To be more specific I have trouble calculating the partial derivatives ...
2
votes
1answer
674 views

How does parallel structure implementation of IIR speed up the process ? What happens in case of FIR?

I was learning about digital filter structures and there I came to know that parallel implementation of IIR filters speeds up the process and I understand that.But what I am not convinced of is that ...
0
votes
0answers
24 views

How to decide about length of vectors for estimating correlation matrices

I am optimizing a filter $f$ using mean squared error criterion. $$MSE = f^T*(R_{xx}-R_{yx}^T*R_{yy}^{-1}*R_{yx})*f \tag{1}$$ where $x\in \mathbb{R}^n$ input column vector $y\in \mathbb{R}^m$ ...
2
votes
3answers
5k views

Librosa stft + istft - Understanding my output (which always seems too perfect) at varying window lengths

I've just started to use Python with Librosa for a DSP project I'll be working on. First thing I've been trying to do is determine my preferred parameters for the FFT window size, and hop-distance. ...
1
vote
0answers
101 views

How to Avoid Perspective Distortion Buildup in a Planar Mosaic

Registering images for map or other planar mosaic from a handheld camera or a drone requires projective transform (homography) as the camera is allowed to rotate between frames. Unfortunately, planar ...
4
votes
1answer
291 views

Approximating $ {L}_{0} $ Norm Minimization with Non Linear Convex Inequality Constraints using Reweighted $ {L}_{1} $ Minimization

I have an optimization problem consisting of the $ {\ell}_{0} $ norm as the objective and a nonlinear (convex) constraint as well as a linear constraint. I am wondering if the reweighted $ {\ell}_{1} $...
1
vote
0answers
315 views

Biquad Filter Optimization

I would like to try optimize a bit more the biquad filters indended for RIAA/non-RIAA equalization at low samplerates (44.1/48kHz). Are there any open source optimization libraries (C, C++ or C#) out ...
0
votes
2answers
248 views

How to improve filter quality at low fs

This my 1st post here. I'm using this impulse invariant (MZT) based method to calculate coefficients for biquad digital filter (for RIAA and non-RIAA de-emph.): ...
2
votes
1answer
2k views

Fitting an IIR filter to a complex transfer function

anybody knows of better ways to fit an IIR filter to a complex transfer function than Matlab's invfreqz.m? I'm implementing a little transfer function fitting ...
2
votes
2answers
540 views

Lagrange Multipliers Optimization - Complex Functions

I want to optimize a sum of complex frequency responses (complex sum is SPL, sound pressure level as a complex function of distance) of a number of loudspeakers, say 10. There is a reference, desired ...
1
vote
1answer
1k views

Multiple parallel IIR bandpass filters with different centre frequencies combined into one filter for optimisation… possible?

Before I begin, I have read these already: IIR filter parallelization Concept of combining multiple FIR Filters into 1 FIR filter I am processing audio using Csound in a high performance real time ...
10
votes
0answers
646 views

Will an Unscented Kalman Filter Be “As Good” as Other Optimization Algorithms for This Problem?

I want to calibrate a tri-axis magnetometer when a tri-axis gyroscope is also available. I am fairly certain I can solve this problem using various optimisation algorithms, but I would prefer to use ...
1
vote
1answer
320 views

Optimized 2D wavelet transform using FFT

I'm currenty aiming to optimize my fast wavelet transform (FWT) algorithm for 2D signals (images). It works as follows: one iteration of 1D FWT does convolution of 1D input data with a selected 1D ...
0
votes
1answer
51 views

Optimized resource allocation problem

I am from ECE background and trying to solve channel allocation problem. Let's assume I have three users and three available channels. I would like to allocate channel among them in such a way that ...
0
votes
2answers
84 views

Subgradient Method for K-Means Like Problem

I want to solve k-means-like problem. But at first, I wonder that we can apply subgradient method to k-means problem. We want to find the optimal clustering $S = (S_1,S_2,...,S_k)$ such that $$ {\...
3
votes
1answer
132 views

Signal Reconstruction in Compressed Sensing with a Simple Vector Signal as an Example

While going through the different types of reconstruction algorithm as mentioned in Richard G. Baraniuk - Compressive Sensing - Lecture Notes (Also on DocDroid), I came to know that minimum $ {L}_{1} $...
1
vote
1answer
265 views

find cross correlation lag by optimization

I have data from many closely located sensors (geophones). These are often contaminated with coherent noise which I need to remove. Some of the most effective de-noising methodologies work if the ...
1
vote
1answer
85 views

Filtering performance on Poisson noise with quadratic data-fidelity

We recently performed a work on signal filtering/component separation (sparse signal/trend/noise). The cost function contains: A quadratic data fidelity term, Some smoothed $\ell_1$ terms for ...
0
votes
1answer
98 views

Best way to approximate a curve?

I have a curve like this one: I need a function to approximate this curve, but I need that the function be a low order function (less than 5). What is a good way to obtain what I expect? Thanks!
5
votes
2answers
382 views

Convex Optimization in Signal and Image Processing

In signal processing, convex optimization plays a useful role in problems such as sparse signal recovery and filter design. What other places does convex optimization appear? For example, in ...
2
votes
1answer
113 views

Adaptive Filter Gradient Descent

The quadratic performance surface of an adaptive filter is a paraboloid. Its minimum can be found wherever the gradient is zero. However, since there are two types of paraboloids (elliptical and ...
1
vote
3answers
169 views

Decomposing a DFT into multiple FFT calls

I'm using a good fast FFT implementation (vDSP) that will only work on power of 2 blocks of audio data. Now I have a problem where I would like to be able to apply the calculations to non powers of 2 ...
5
votes
1answer
378 views

Weighted Nuclear Norm Minimization for Image Denoising

Recently, I saw new published papers like Shuhang Gu, Lei Zhang, Wangmeng Zuo, Xiangchu Feng, Weighted Nuclear Norm Minimization with Application to Image Demonising [pdf]. about denoising images ...
0
votes
1answer
59 views

Regularized Least Squares by Laplacian Operator - Optimal Value of the Regularization Factor (Lagrangian Multiplier)

Consider the cost function $$f(X,\lambda) = \|AX-b\|_2^2 + \alpha \|LX\|_2^2$$ $A:$Measurement matrix($R_{m\times n}$,$m \ll n$), $b:$observation vector($R_m$), $L:$Laplacian operator($R_{n \times n}...
0
votes
2answers
317 views

Significance of $ \lambda $ in Basis Pursuit

In basis Pursuit, L1 minimization is done to perform compressed sensing. In the literature there is a $ \lambda $ parameter used as a regularizer. What is its significance?
0
votes
1answer
145 views

Finding the gradient of a norm in a minimization problem

I have to find the gradient of the following term with respect to $X_{1}$: $\|\Phi\circ(X_{1}-X_{2})-u\|_F^2$ , where $u\in\mathbb{R}^{n}$; $X_{1}, X_{2}\in\mathbb{R}^{N\times J}$ and $\Phi\in\...
3
votes
0answers
75 views

When Does $ {L}_{1} $ Regularization Give a Sparse Solution?

I was maximising a likelihood function, which is convex. I know that the system has a K-sparse solution. I wanted to know the conditions (or some sufficient conditions) on the likelihood function ...
2
votes
1answer
2k views

$ {L}_{0} $ Pseudo Norm Minimization in Compressive Sensing

I have recently taken up studying compressive sensing related papers. Some things are not very clear to me or may be I am not able to visualize the scenario as is said. Like how $l_0$ norm ...
0
votes
1answer
78 views

Iterative Blind Sinus Signal Suppression

There are two real signals in the form of $A_i sin(wt+p_i), i=1,2$. Suppose frequency $w$ of both the signals is the same and amplitude $A_i$ and phase $p_i$ are different. The first signal has ...
0
votes
1answer
185 views

How to Smooth Gradient Estimates for Steepest Descent Optimization

In steepest descent methods of minimizing a function $f(x), x \in \mathbb{R}^d$, it's common to approximate the gradient by finite differences: $\qquad\qquad \nabla f(x) \approx gradest( x; h ) \...
3
votes
1answer
821 views

Design $ {L}_{2} $ Norm Optimal Infinite Impulse Response (IIR) Filters

It is widely known that matching a FIR filter of fixed length to a band model is an unconstrained QP-problem. The MATLAB function firls() implements a solution to ...
1
vote
0answers
143 views

Optimal filter bank from SVD/PCA

Given a million data points in say 100d, is there a way to generate an optimal filter bank of say 20 filters from an SVD of the data ? Call the 100d space $F$ (as in Frequency), with coordinates $[f_1,...
2
votes
0answers
159 views

Any idea how can I optimize morlet wavelet parameters by Heisenberg uncertainty principal and Shannon entropy?

Based on a paper in here, they have proposed a method to optimize morlet function parameter. I have tried to implement their technique, but I can't get rational results. any idea? In here you can see ...
0
votes
0answers
718 views

Digital Image Processing - Contemporary Research Topics

I need to propose a masters degree topic, and I'd like it to be in digital image processing. What are currently relevant topics in this area? I suppose that I'm looking for some kind of optimization,...
5
votes
1answer
124 views

Ideas on Matrix Factorization / Transformations for $ {L}_{1} $ Minimization

I am starting with a typical $\ell_1$ basis pursuit problem: $$ \min_{\mathbf{x}} \Vert \mathbf{x} \Vert_1 \quad \mathrm{s.t.} \quad \Vert \mathbf{ERx} - \mathbf{y} \Vert_2 \leq \epsilon, $$ where $\...
13
votes
5answers
20k views

Compressive Sensing Through MATLAB Codes

I am new to the topic of compressed sensing. I read a few papers about it by R.Baranuik, Y.Eldar, Terence Tao etc. All these papers basically provide the mathematical details behind it, i.e., Sparsity,...
3
votes
1answer
303 views

Ideal Geometric Arrangement of Microphone Array

I'm going to have to give a bit of context for this question to make sense. I am working on a project which includes audio source localisation in 3-D space through TDoA (Time Difference of Arrival - ...
5
votes
0answers
576 views

fit theoretical spectrum to simulated one

I have a bunch of simulated time series, for which I can compute the power spectrum. Generally, the simulated power spectrum can be sketched as follows: I now aim to calculate the features of the ...
2
votes
1answer
5k views

Determine the optimum receiver and the corresponding $P_{eM}$ for an AWGN channel

I have a source that emits $M$ equiprobable messages, which are assigned signals $s_1, \dots,s_M,$ that are equidistant by $a$. That is, if we plot the $s_k$ signals in a horizontal axis they are dots ...
2
votes
1answer
115 views

How to calculate signal which is not changed by a filter?

Suppose that there is a FIR filter F and a signal S. The filtered signal is the convolution of F and S, F * S. The problem: how to calculate a signal S' such that F * S' = S' (the filtered version ...
2
votes
0answers
103 views

Phong Reflection Model Parameters

Question: Can anyone refer me the Phong reflection model parameters for a face image taken for web-cam? Details: I am doing 3D reconstruction of 2D images using 3D Morphable Model as in this paper ...
4
votes
1answer
144 views

Finding length of period in time domain data

I have a series of measurements of a signal source, which emits a periodic signal at an unknown interval time of p seconds. Detecting the signal is not easy so I am ...