I am working on a project that requires me to detect and track a human in a live video from a webcam connected to a Beagleboard xm. I have completed this task using Opencv in pixel domain. The results on the board are very accurate but extremely slow. Many people have suggested me to leave pixel domain and do the same task in an h.264/MPEG-4 compressed video as it would extremely reduce the computational overhead. I have read many research papers but failed to discover any software platform or a library that I can use to analyze and process h.264 compressed videos. I will be thankful if someone can suggest me some library for h.264 compressed video analysis and guide me further. I know about P and I frames but don't know how to extract them and use which programming software or language to process them.

Thanks and Regards.

  • 1
    $\begingroup$ A simple google search throws up things like this. What doesn't that do? $\endgroup$
    – Peter K.
    Nov 14, 2013 at 19:46
  • $\begingroup$ Thanks for the response. I have also come across it many times but they have not mentioned the software platform they are using for object tracking $\endgroup$
    – bunny
    Nov 14, 2013 at 19:50
  • $\begingroup$ OK, so google again: does this help? However, I suspect you're asking for an intermediate-level: doing video processing in the compressed domain. Usually people do not release that, because it's generally no useful for others (it's "research" quality code, which is OK for papers but not for general use). $\endgroup$
    – Peter K.
    Nov 14, 2013 at 19:56
  • $\begingroup$ So how can I view motion vectors. Is there any library like opencv which I can use... I have studied the internal structure of h.264 bitstream, know about P,I,B frames theoretically but cant find a way to analyze them. $\endgroup$
    – bunny
    Nov 14, 2013 at 20:17
  • $\begingroup$ Till now I have opened raw h.264 video in Opencv by decompressing it frame by frame but doing so surely boils down to pixels that I have already done and kills the purpose of taking raw h.264 video $\endgroup$
    – bunny
    Nov 14, 2013 at 20:18


Browse other questions tagged or ask your own question.