Just a little update.
I figured out what caused the problem. This only occurs when I enabled HW Acceleration for the OMXPlayer. When I turen that off everything is back to normal. It works fine with HW acceleration of MMAL. Feel free to see if you get the same result.