1
$\begingroup$

I am working on segmenting hands from monocular images and I have already come up with a pretty descent segmentation. The only issues I am having are when people have rings on their finger. Then the hand is no longer a connected component and I get the hand and the finger component. The following image shows my segmented mask, where the ring finger is detached because of a ring.

Hand and finger

Is there any natural method to connect components like these together? Otherwise I could try to segment the rings, but not all people have rings, so I would prefer to try to tackle this in this way.

Also, if there is another SE better suited for this question, please let me know.

$\endgroup$
6
  • 1
    $\begingroup$ Maybe you can try to get the main axis of the hand, e.g. by looking at the igenvectors of the covariance matrix and then prolungate the finger in such a direction $\endgroup$
    – LJSilver
    Commented May 18, 2016 at 17:07
  • $\begingroup$ @LJSilver thanks for the response! That is essentially what I was thinking, just doing it with the finger instead of the hand. I.e. getting the orientation and finding the vector that points to the hand. I am just uncertain of how to prolong the finger. I was considering to make a copy of the finger and translating it towards the hand in the correct direction. I think that will work, I'll report if that does the trick. $\endgroup$
    – Gumeo
    Commented May 18, 2016 at 17:11
  • 1
    $\begingroup$ Yes that's smarter! However Im not in image processing so wait for some expert to answer $\endgroup$
    – LJSilver
    Commented May 18, 2016 at 17:15
  • 1
    $\begingroup$ Ps. You can just slide the terminal part of the finger, that won't modify the rest $\endgroup$
    – LJSilver
    Commented May 18, 2016 at 17:16
  • 1
    $\begingroup$ Why doesn't your method pick up the ring? $\endgroup$ Commented May 19, 2016 at 0:59

1 Answer 1

2
$\begingroup$

I guess that the missing area is due to a ring. A solution would be to use a PCA in order to compute the finger orientation. Then you apply a closing (mathematica morphology) with an segment oriented segment (same orientation as the finger).

It might modify a little bit the gap between the fingers where they are connected to the hand.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.