Speeds up next marker search when a SOS marker is found but the frame is
discarded (which happens in avformat_find_stream_info).