This is needed for the AAC decoder, which may need to call get_buffer()
more than once if the channel configuration changes.