This ensures that frames do not get mixed on context reinits

Fixes Ticket2836
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>