9
$\begingroup$

I've been looking into marker detection algorithms to use with a kinect based application, and the majority of the work I've been able to find is obviously focused on feature detection in 'normal' images.

However, the kinect hardware provides (essentially, once you've adjusted) an 11-bit depth value per pixel.

This depth image also has various visual artifacts in it from the shadows cast around the edges of objects (see for example the strong black border in this video http://www.youtube.com/watch?v=-q8rRk8Iqww&feature=related).

While some traditional machine vision techniques (eg. edge detection) work well with this, others don't, and it seems like there's little information on the net discussing this.

As a simple example, using the depth value makes it trivial to detect the orientation of a marker block once you've located it.

So, has anyone seen any discussions / papers / etc. that cover processing a depth image for feature detection?

Can anyone recommend a good algorithm for detecting "depth" markers (effectively origami blocks instead of printed b/w markers)?

What I've done so far has been adhoc experimentation using opencv to process the images, but that's no where near stable or fast enough.

If you link to a commercial machine vision product without some kind of trial, please mention in your answer why you think it's appropriate.

$\endgroup$

migrated from stackoverflow.com Apr 20 '12 at 15:41

This question came from our site for professional and enthusiast programmers.

  • $\begingroup$ There are tons of papers and programs for this. Sorry can't answer in more detail, on low bandwidth. See RGBDemo app, it includes an object recognizer. Also, PointCloud Library (PCL), ROS, OpenCV, for software, and presumably Google Scholar for papers. You mention OpenCV isn't satisfactory to you, but PCL and RGBDemo might be. $\endgroup$ – mankoff Apr 18 '12 at 14:41
  • $\begingroup$ I'm not looking for an implementation of a demo that shows off the kinect, or some PC demos that show how to generate a 3d model from a kinect or an image processing toolkit (ie. opencv). I'm looking for algorithms for feature recognition based on depth images. $\endgroup$ – Doug Apr 19 '12 at 6:39
  • $\begingroup$ RGBDemo implements those algorithms. Read the code or the references for the code. $\endgroup$ – mankoff Apr 19 '12 at 9:38
8
$\begingroup$

My favourite 2.5D/3D feature descriptor for registration and recognition is the spin image (original paper + more details in Ph.D. thesis and software available from CMU).

Other recent advances (all searchable on-line for suitable algorithims) include: 3D-Sift, Fast Point Feature Histogram, Normal Aligned Radial Features (NARF), Depth Kernel Descriptors. Older methods simply used surface properties such as curvature and edges to identify region patches.

Which is best? Depends on what you want to find, viewpoint invariance, additional clutter, etc.

$\endgroup$
7
$\begingroup$

You got all the key words right, I'm surprised that you really didn't find any related articles while looking for material.

Fortunately, I have access to IEEE Xplore digital library. I din't need any of these particular algorithms before, but it looks very interesting so here are some results from a quick search that I think might be relevant (don't judge them by their titles, look at their abstracts):

Unfortunately, I don't think you can access any of these papers for free, at least not via the IEEE Xplore library. If you don't have access, you can probably get by with Google scholar, and there are some free paper databases out there (I used Mendeley database back when I didn't have IEEE access yet). Also, just Googling parts of the abstract or random parts of the paper sometimes yields some results (you might stumble across a almost finished pre-published versions of the article).

The search queries I used to find the mentioned papers were: 3D image, depth image, kinect. You might also want to throw in processing when looking up the first two queries.

Hope this helps some! I feel sorry I can not get in to the subject more, sounds really interesting.

$\endgroup$
  • $\begingroup$ And another: scholar.google.com/scholar_url?hl=en&q=http://… $\endgroup$ – mankoff Apr 19 '12 at 9:39
  • $\begingroup$ @mankoff just from the abstract, I just see the work concentrating on tracking, and it seems that it concentrates on using the direct information with not much feature detection. But then, I just read the abstract, so not sure. $\endgroup$ – penelope Apr 19 '12 at 11:49
  • $\begingroup$ Googling the paper titles is sufficient to find PDFs for several of those papers. Another good source is CiteSeer: citeseerx.ist.psu.edu/index Thanks for the list of papers! $\endgroup$ – Rethunk Apr 29 '12 at 23:39

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.