It turns out that this frame type is actually intra and should be used as
a reference for interframes too.