This moves some allocations to init, reducing possible failure modes in update.
Always copies from the previous context instead of just during init

Fixes Ticket2923
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>