# Questions tagged [quantization]

Quantization, in mathematics and digital signal processing, is the process of mapping input values from a large set (often a continuous set) to output values in a (countable) smaller set, often with a finite number of elements. Rounding and truncation are typical examples of quantization processes.

94 questions
Filter by
Sorted by
Tagged with
561 views

### Quantization SNR of sine wave doesn't match 1.761 + 6.02 * Q

I am trying to show with numpy that the quantization noise of a sine wave matches the SNR formula of SNR = 1.761 + 6.02 * Q. The numpy code is simple: ...
279 views

### Optimal amplitude of an $m$-bit sinusoid

A continuous-time sinusoid of zero-to-peak real amplitude $A \le 2^{m-1}-0.5$ (e.g., for $m=16$, $A \le 32767.5$) is quantized to $m$-bit resolution by rounding it to the nearest integer (Fig. 1). ...
7k views

### Compute SQNR (Signal to Quantization Noise Ratio)

I'm studying the quantization of an audio signal and in particular the SQNR (Signal to Quantization Noise Ratio). The book on which the study says that: where: N is the number of bits in the ...
300 views

### Why are we always interested in mean-squared distortion?

When dealing with quantizers, and in many other communications problems, the interest is usually on the mean-squared distortion or mean-squared error, rather than mean absolute error or anything else. ...
415 views

### What is “hard quantization” strategy?

I am working on classification and several times I encountered with this term. What is hard quantization strategy? What does it differ from soft approach?
651 views

### Precise 5th and 7th harmonics of a sampled sine wave

Does anyone know in decibels (to 1/100th of a dB) what the theoretical 3rd, 5th and 7th harmonic of a 0dB fs 24-bit (i.e. full-level; 0dB = -8,388,607 to 8,388,607) sampled sine wave without dither ...
35k views

1k views

### ensure stability against coefficient quantization

for a filter: $$H(z)=\frac{1+0.1z^{-1}}{1+0.1z^{-1}+0.9998z^{-2}}$$ Which precautions could be taken to ensure that the filter does not become unstable because of coefficient quantization? I've ...
8k views

### Quantization Image using MATLAB

I'm trying to quantize an image 8 bits to 4 or 2-bits uniformly. I searched internet, interestingly I could not find what I want exactly. Then I wrote an simple code for it myself. I'm curious about ...
73 views

### Is there any difference in Implementing sigma delta modulator using filters and state space model in FPGA?

Sigma delta modulation is extensively used in quantization to reduce quantization noise. In the literature one can see different architecture for example python-deltasigma to implement a modulator. ...
182 views

### JPEG compression steps after quantization

I have a 3-channel (for colours) a png image that I opened and I splitted the image into 8x8 blocks I applied all of the blocks discrete cosine transform And then applied quantization I stored the ...
39 views

### Is it necessary to scale a signal for quantization noise analysis?

I am doing a series of tests to analyse the round-off (quantization) noise performance of single and two stage biquad cascades (direct form 1), at different sampling rates. The system I am simulating ...
211 views

### Proper rounding when converting between digitized values and floating point

I have some very large files that are unsigned 8 bit (0 to 255), real valued. I need to do some simple tuning and decimation. In the past, when I've dealt with low bit rate samples, I've run into ...
76 views

### For image quantization, is it necessary to sample image?

When we want to quantize an image, is it necessary to do sampling? When we know that image is a discrete signal, is it necessary to find the best samples with Nyquist rate?
My understanding is that given an AWGN channel and BPSK modulation, an LDPC decoder that uses message passing takes as input log-likelihood ratios $L$ of the following form by Bayes' rule:  L=\frac{...