Video frames alignment

For example, I cropped one face in the first frame of a some fake video. Then I want crop the corresponding face in the real video. However, it seems the fake video is manipulated on a random segment in the corresponding real video, and the offset is not given. Is it possible to solve this? Thanks.

real:  -----------------------------------
fake: |<-- offset -->|-------------
         