It can end up slightly messing up a series of valid timestamps
after a invalid one.
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>