Commit 8ff09e90 authored by Michael Niedermayer's avatar Michael Niedermayer

avcodec/jpeg2000dec: Use 32x32->64bit for 5/3 dequantization

This fixes overflows, using fewer bits would impact high bit depth quality

Fixes Ticket4654
Signed-off-by: 's avatarMichael Niedermayer <michaelni@gmx.at>
parent 5a1f7852
......@@ -1437,7 +1437,7 @@ static void dequantization_int(int x, int y, Jpeg2000Cblk *cblk,
int32_t *datap = &comp->i_data[(comp->coord[0][1] - comp->coord[0][0]) * (y + j) + x];
int *src = t1->data[j];
for (i = 0; i < w; ++i)
datap[i] = (src[i] * band->i_stepsize) / 32768;
datap[i] = (src[i] * (int64_t)band->i_stepsize) / 32768;
}
}
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment