Having it there forces decoding of a frame in order to get frame_size, but it
is not really needed for proper demuxing or decoding.