There should not be any valid reason anymore for passing completely
empty packets to lavf.
OTOH side data-only packets can be useful.