This will be useful in the later commits, where we want to parse an SPS
without having a whole decoding context.