5ef7c84a broke decoding for the first keyframe due to an unnecessary
check for a reference frame.

CC: libav-stable@libav.org