Questions tagged [quantization]

Quantization, in mathematics and digital signal processing, is the process of mapping input values from a large set (often a continuous set) to output values in a (countable) smaller set, often with a finite number of elements. Rounding and truncation are typical examples of quantization processes.

Filter by
Sorted by
Tagged with
8
votes
2answers
561 views

Quantization SNR of sine wave doesn't match 1.761 + 6.02 * Q

I am trying to show with numpy that the quantization noise of a sine wave matches the SNR formula of SNR = 1.761 + 6.02 * Q. The numpy code is simple: ...
7
votes
1answer
279 views

Optimal amplitude of an $m$-bit sinusoid

A continuous-time sinusoid of zero-to-peak real amplitude $A \le 2^{m-1}-0.5$ (e.g., for $m=16$, $A \le 32767.5$) is quantized to $m$-bit resolution by rounding it to the nearest integer (Fig. 1). ...
6
votes
1answer
7k views

Compute SQNR (Signal to Quantization Noise Ratio)

I'm studying the quantization of an audio signal and in particular the SQNR (Signal to Quantization Noise Ratio). The book on which the study says that: where: N is the number of bits in the ...
6
votes
3answers
300 views

Why are we always interested in mean-squared distortion?

When dealing with quantizers, and in many other communications problems, the interest is usually on the mean-squared distortion or mean-squared error, rather than mean absolute error or anything else. ...
5
votes
1answer
415 views

What is “hard quantization” strategy?

I am working on classification and several times I encountered with this term. What is hard quantization strategy? What does it differ from soft approach?
4
votes
3answers
651 views

Precise 5th and 7th harmonics of a sampled sine wave

Does anyone know in decibels (to 1/100th of a dB) what the theoretical 3rd, 5th and 7th harmonic of a 0dB fs 24-bit (i.e. full-level; 0dB = -8,388,607 to 8,388,607) sampled sine wave without dither ...
4
votes
1answer
35k views

What is “Maximum Quantization Error”?

I have an formula for this "Maximum Quantization Error" but i dont know what it is based in. Its just thrown in my study material without further explanation. It is defined as: $$Q = \dfrac {\Delta ...
4
votes
2answers
134 views

Oversampling in quantization

Q: It is said that "to maintain the same quality in the two cases, we require that the power spectral densities remain the same". Why is this a measure of the same quality? Why is not the ...
4
votes
1answer
166 views

Does delta-sigma ADC also reduce Gaussian noise on input signal to ADC or just quantization noise?

The motive for posing this questions arises from a difference of analysis between a colleague an myself. Our general environment is in the construction of an analog front-end which takes in signals ...
4
votes
1answer
53 views

Sample & Hold: Estimate jitter delay of an ADC

I've got a question regarding the effects of sample and hold. My input signal is $x$, and my output signal $x_{SH}$. The error between the signals is $e_{SH} = x_{SH}-x$. The sampling frequency is ...
4
votes
2answers
162 views

What distribution is the easiest to compress?

I'm currently playing around with some compression algorithms and I'm asking myself if there is a type of data distribution / noise distribution that is easier to target with quantization (meaning ...
3
votes
4answers
359 views

Is it theoretically possible to perfectly quantize a continuous signal?

So, I'm completely new to digital signal processing, but while reading a piece this morning about quantization it got me daydreaming: could a machine ever be fast enough to sample the position and ...
3
votes
4answers
1k views

From a physics perspective, why does D/A quantization error result in a noise floor?

For the last week or so I have been trying to understand how quantization error results in the noise floor outside of a mathematical perspective and I haven't really had any luck finding a source that ...
3
votes
2answers
2k views

Audio signal dither and noise shaping

I'm trying to get a handle on the importance of the error feedback term in noise shaping operation in typical audio dither algorithms. I'm thinking in terms of four signals. The original signal, the ...
3
votes
2answers
104 views

Why are vector quantizers not used in video codecs?

Using a vector quantizer (VQ), groups of image samples (or motion compensated and/or transformed data) can be quantized as vectors. I'm curious about why VQs are not preferred in the modern, highly ...
2
votes
3answers
117 views

Connection between SNR and the dynamic range of the human ear

For signal-to-noise ratio (SNR), SNR=6B dB is called the dynamic range of the quantizer. The dynamic range of the 16-bit quantizer is 6B = 6·16 = 96 dB. Note that the dynamic range of the human ear ...
2
votes
1answer
1k views

How we can quantize a sampled signal in MATLAB?

I have a continuous time signal $x(t)=\sin(2πft)$ where $0 \leq t \leq 3$. I want to sample the continuous time signal and then quantize that sampled signal and then plot both sampled and quantized ...
2
votes
1answer
39 views

Quantization and Sampling - putting it all together

So after I learned this two topic: quantization and sampling, I'm learning the way to look at both of them and try to optimize the split of a given amount of bit B to N and k, where N is the amount of ...
2
votes
2answers
50 views

Having converted a grayscale image to binary using `im2bw()`, is the converse operation possible?

I have converted a gray-scale image to binary using im2bw() now i wanna do the opposite. How can I do that in MATLAB?
2
votes
1answer
140 views

Why harmonic components appear only after a certain level when a signal is clipped?

I recently observed this phenomenon that when a signal is clipped the harmonics start to appear only after a certain level. The Python code to reproduce the effect is given below. The signal has 3 ...
2
votes
2answers
3k views

A query on the non-uniform quantization

I have read that non-uniform quantization boosts the smaller amplitude signals by a large amount. However the larger amplitude signals receive a small gain. As shown in the below diagram (Compressor ...
2
votes
2answers
313 views

DCT: Alternatives to quantization

When using the discrete cosine transform are there commonly used alternatives to quantization to decide which dct components to keep/are important? If not, how do people come up with quantization ...
2
votes
1answer
1k views

Sampling Rate Effect on Quantizer SNR

I am currently reading the 'Coding' chapter on Rabiner & Schafer's Book on speech processing. In one of its exercises, the reader is given a simple A/D converter using 16-bit uniform ...
2
votes
1answer
89 views

Quantizing a filtered signal

In the process of trying to learn dialup, I've managed to learn/figure out everything except how to convert a demodulated/filtered signal back into the original data. Here I have a random two-bit ...
2
votes
1answer
101 views

Variance of a signal

How to calculate the variance of noise samples modeled as follows: $n_a(t)$ is a Gaussian zero-mean white noise process with (two-sided) power spectral density $\frac{N_0}{2}$. $n_a(t)$ is passed ...
2
votes
1answer
1k views

Signal to Quantization Noise Ratio (SQNR)

I have this problem in my homework (following picture). How do find the signal to quantization noise ratio at the output? I don't want the solution. I just want to know a better approach to tackle ...
2
votes
1answer
2k views

Lloyd Max Quantization and Clustering : Part 1

The Lloyd-Max quantizer is a scalar quantizer which can be seen as a special case of a vector quantizer (VQ) designed with the Linde Buzo Gray (LBG) algorithm. In k-means clustering, we are given a ...
2
votes
2answers
267 views

In image compression using transforms, how to deal with the transformed coefficients as they are not integers?

I am new to the field of image compression. While going through various texts, I read about how transforming the image to another domain using, for example, the wavelet transform, or the DCT, makes it ...
2
votes
2answers
48 views

Non-Uniform Quantization

I was reading a research paper on companding schemes for non uniform quantisation. In paper one of the motivations for non-uniform quantisation is that distortion at larger amplitude values is less ...
2
votes
1answer
246 views

Differential Pulse Code Modulation (DPCM)

In the following figure we see an encoder and a decoder of a Delta Modulation System, which is a simple DPCM System with a 1-bit quantizer: We assume that signal $x(n)$ is known, that $\hat{x}(-1)=0$ ...
2
votes
1answer
320 views

What is the no overload region of a quantizer?

I was watching a video on quantization noise and the instructor kept referring to the "no overload" region of a quantizer? Could anyone please explain what that term means?
2
votes
2answers
2k views

What is the difference between clustering and quantization?

The Lloyd-Max quantizer is a scalar quantizer which can be seen as a special case of a vector quantizer (VQ) designed with the Linde Buzo Gray (LBG) algorithm. In k-means clustering, we are given a ...
2
votes
1answer
376 views

Quantization step-size for a given signal based on its PDF

I am familiar with the principles of midtread and midrise quantizer. However, I have difficulties determining the step size where it hasn't been explicitly given. For example, the following ...
2
votes
0answers
64 views

Modelling of quantization noise with logarithmic steps

I have to modell the quantization noise of ADC. I only know that the maximum relative error is 1 dB. Since this is logarithmic, I find it hard to formulate an appropriate model for the quantization ...
1
vote
3answers
118 views

confusion sampling vs quantization?

while converting analog signal to digital equivalent,we have a process that is called analog to digital conversion and it has two main steps/stages sampling and quantization? I am confused whether y ...
1
vote
2answers
53 views

Fixed Point Design Resources

Can anyone point me to good methodologies for designing fixed point versions of possibly nonlinear signal processing algorithms? Are there any systematic methods other than simulation for optimizing ...
1
vote
1answer
491 views

Why use a 1-bit ADC in a Sigma Delta Modulator?

When looking at the discrete model of a Sigma-Delta Modulator as shown below, we can see that the quantizer is modelled as a white-noise source $e[n]$. From this model, we can derive the noise shaping ...
1
vote
1answer
43 views

Separability vs. Resolution - Synonymous terms?

In terms of discrete representation of a variable, let's say time measurements in absolute values in [seconds], is there a difference between separability and resolution? When do speak of either ...
1
vote
2answers
174 views

Are time series data always contain noise?

I wonder if every time series data should contain noise or not. For example I am taking the price of a ticker, say Yahoo, every hour and noting the values. Does this data contains noise or not?
1
vote
1answer
219 views

Quantization SNR of bipolar signal

I want to estimate the SNR of a bipolar signal. I know that each bit increases the SNR at 6 dB. Do i have to subtract one bit for sign, so that for bipolar signals the SNR is (n-1) x 6 dB ?
1
vote
1answer
854 views

Uniform quantizer for gaussian input signal

I have a gaussian signal $x$ with zero mean and unit variance. I am quantizing it by using a uniform quantizer of step size $q$ calculated by $$q = \frac{x_\mathrm{max} - x_\mathrm{min}}{2^{M_\mathrm{...
1
vote
3answers
1k views

ensure stability against coefficient quantization

for a filter: $$ H(z)=\frac{1+0.1z^{-1}}{1+0.1z^{-1}+0.9998z^{-2}} $$ Which precautions could be taken to ensure that the filter does not become unstable because of coefficient quantization? I've ...
1
vote
1answer
8k views

Quantization Image using MATLAB

I'm trying to quantize an image 8 bits to 4 or 2-bits uniformly. I searched internet, interestingly I could not find what I want exactly. Then I wrote an simple code for it myself. I'm curious about ...
1
vote
1answer
73 views

Is there any difference in Implementing sigma delta modulator using filters and state space model in FPGA?

Sigma delta modulation is extensively used in quantization to reduce quantization noise. In the literature one can see different architecture for example python-deltasigma to implement a modulator. ...
1
vote
2answers
182 views

JPEG compression steps after quantization

I have a 3-channel (for colours) a png image that I opened and I splitted the image into 8x8 blocks I applied all of the blocks discrete cosine transform And then applied quantization I stored the ...
1
vote
1answer
39 views

Is it necessary to scale a signal for quantization noise analysis?

I am doing a series of tests to analyse the round-off (quantization) noise performance of single and two stage biquad cascades (direct form 1), at different sampling rates. The system I am simulating ...
1
vote
1answer
211 views

Proper rounding when converting between digitized values and floating point

I have some very large files that are unsigned 8 bit (0 to 255), real valued. I need to do some simple tuning and decimation. In the past, when I've dealt with low bit rate samples, I've run into ...
1
vote
1answer
76 views

For image quantization, is it necessary to sample image?

When we want to quantize an image, is it necessary to do sampling? When we know that image is a discrete signal, is it necessary to find the best samples with Nyquist rate?
1
vote
1answer
12k views

Analog to digital conversion using Python

I'm a beginner. I try emulate analog signal conversion to digital (including sampling by time and quantizing by level) using Python. Here is my code: ...
1
vote
1answer
27 views

Is there an optimal way to quantize log-likelihood ratios of an AWGN channel?

My understanding is that given an AWGN channel and BPSK modulation, an LDPC decoder that uses message passing takes as input log-likelihood ratios $L$ of the following form by Bayes' rule: $$ L=\frac{...