I have a problem in which i have a video that was taken from the side of the subject, something like this and i need to transform the coordinates of the subject to be as if the photo was taken from above like this
I have the real set of coordinates that i can relate to from picture 2 to picture 1 , i only need to transform the coordinates of the moving subject, not the whole picture.
I tried using polynomial regression in order to approximate the right transformation, but it failed to work (i can see that it's not the true movement).
also i have a problem that the video is taken with a fish eye lens.
what is the right way to approach it? or if you can direct me to the appropriate papers? (i never done image processing before).