The 0 case was added with the support for multiple packets. It
appears unintended and causes extra complexity and out of array
accesses (though within padding)

No testcase
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>