1
$\begingroup$

Assume that I have samples from an image, but the samples aren't on a grid, but instead there are multiple lowres versions of the original where the sampling locations are slightly jittered, so the pixels in the lowres images haven't been sampled from the exact same location (i.e. the lowres images aren't identical, however assume I now the precise sampling location for each pixel in the lowres images). What methods exist for reconstructing the original image?

The most general case of this is assume you have random samples from the image (making the assumption here that the image is a continuous signal). Are there optimal algorithms for reconstruction? For example, this assumes that the sampling density can vary spatially in the image, so that some regions have very few samples while others are densely sampled.

My DSP books seem to concentrate on methods where some signal has been sampled at fixed periodic intervals, so they don't seem to be of much use.

EDIT: Pointers to literature that discusses this would be great, even knowing what such reconstruction problems are called!

Improve this question
$\endgroup$
7
  • $\begingroup$ Welcome to SE.DSP. I am not sure about "multiple lowres versions of the original". Do you consider single "bigger" pixels, or patches of pixels"? $\endgroup$
    – Laurent Duval
    Jun 5 '19 at 18:22
  • $\begingroup$ A related question, more for 1-d signals but adaptable: What is an algorithm to re-sample from a variable rate to a fixed rate? $\endgroup$
    – Olli Niemitalo
    Jun 5 '19 at 18:50
  • $\begingroup$ Assume that the original has resolution 2Wx2H while the lowres is WxH. Then each pixel in the lowres corresponds to a 2x2 patch in the high-res. What I mean is that the lowres pixel is not sampled at the center of the 2x2 patch but it's sampled at a random small subpixel offset from the center, i.e. jittered. $\endgroup$
    – eof
    Jun 5 '19 at 18:53
  • $\begingroup$ That sounds a bit like anti-aliasing random sampling in raytracing, which raises a worry: is the continuous-space image, which is being randomly sampled, band-limited? $\endgroup$
    – Olli Niemitalo
    Jun 5 '19 at 19:00
  • $\begingroup$ You're right. I wanted to test various filtering algorithms without having to ray trace lots of images and the internet is full of high res images of complex scenes. $\endgroup$
    – eof
    Jun 5 '19 at 19:12

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.