I need some help on solving this issue. Any tips are appreciated.
The goal of the project is to try to track a Bounding Box object, chosen arbitrarily in an image, throughout many frames of a recorded video.
I extract from the chosen bounding box cv2.goodFeaturesToTrack and use a sparse optical tracker cv2.OpticalFlowPyrLK in OpenCV to track these features. However I need to also update the bounding box corners for each frame.
Since the bounding box corners are initially chosen to be random and do not necessarily belong with the features in the same rigid object , I am looking for using the information on the movement of these special features to infer the new bounding box coordinates.
I tried to add the bounding box corners to the tracker but it is not robust and loses it in a few frames.
I am using OpenCV in python.