swscale/output: fix signed integer overflow for ya16

Fixes #7666.

swscale/output: fix signed integer overflow for ya16
Fixes #7666.
21838cad · Paul B Mahol · 646799b4 · 21838cad
Commit 21838cad authored Sep 26, 2019 by Paul B Mahol
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

output.c libswscale/output.c +1 -1

No files found.
--- a/libswscale/output.c
+++ b/libswscale/output.c
@@ -904,7 +904,7 @@ yuv2ya16_X_c_template(SwsContext *c, const int16_t *lumFilter,

    for (i = 0; i < dstW; i++) {
        int j;
-        int Y = 1 << 18;
+        int64_t Y = 1 << 18;
        int64_t A = 0xffff<<14;

        for (j = 0; j < lumFilterSize; j++)