This is needed because of 32bit float formats (which are difficult to
store in 16bits)

This also fixes undefined behavior found by fate
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>