Also use av_packet_move_ref() to cache them instead of copying
pointers.

Fixes invalid reads since e1bc3f43.
Signed-off-by: James Almer <jamrial@gmail.com>