Commit bf868c4a authored by Mans Rullgard's avatar Mans Rullgard

tiny_psnr: fix range calculation for sample size of 32 bits

For a sample size of 32 bits, the shift would overflow producing
undefined results.  Incidentally, in the only test currently using
32-bit samples, the output matches the reference exactly on most
systems meaning the bad 'max' value is never used.
Signed-off-by: 's avatarMans Rullgard <mans@mansr.com>
parent 3dc06b69
......@@ -146,7 +146,7 @@ int main(int argc, char *argv[])
}
}
max = (1 << (8 * len)) - 1;
max = (1LL << (8 * len)) - 1;
f[0] = fopen(argv[1], "rb");
f[1] = fopen(argv[2], "rb");
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment