• Clément Bœsch's avatar
    lavfi/gradfun: fix rounding in MMX code. · 2d66fc54
    Clément Bœsch authored
    Current code divides before increasing precision.
    
    Also reduce upper bound for strength from 255 to 64.  This will prevent
    an overflow in the SSSE3 and MMX filter_line code: delta is expressed as
    an u16 being shifted by 2 to the left. If it overflows, having a
    strength not above 64 will make sure that m is set to 0 (making the
    m*m*delta >> 14 expression void).
    
    A value above 64 should not make any sense unless gradfun is used as
    a blur filter.
    Signed-off-by: 's avatarAnton Khirnov <anton@khirnov.net>
    2d66fc54
Name
Last commit
Last update
..
doxy Loading commit data...
APIchanges Loading commit data...
Doxyfile Loading commit data...
Makefile Loading commit data...
RELEASE_NOTES Loading commit data...
avconv.texi Loading commit data...
avplay.texi Loading commit data...
avprobe.texi Loading commit data...
avserver.conf Loading commit data...
avserver.texi Loading commit data...
avtools-common-opts.texi Loading commit data...
avutil.txt Loading commit data...
bitstream_filters.texi Loading commit data...
build_system.txt Loading commit data...
demuxers.texi Loading commit data...
developer.texi Loading commit data...
doxy-wrapper.sh Loading commit data...
encoders.texi Loading commit data...
eval.texi Loading commit data...
faq.texi Loading commit data...
fate.texi Loading commit data...
filters.texi Loading commit data...
general.texi Loading commit data...
git-howto.texi Loading commit data...
git-howto.txt Loading commit data...
indevs.texi Loading commit data...
libavfilter.texi Loading commit data...
metadata.texi Loading commit data...
multithreading.txt Loading commit data...
muxers.texi Loading commit data...
nut.texi Loading commit data...
optimization.txt Loading commit data...
outdevs.texi Loading commit data...
platform.texi Loading commit data...
print_options.c Loading commit data...
protocols.texi Loading commit data...
rate_distortion.txt Loading commit data...
soc.txt Loading commit data...
swscale.txt Loading commit data...
t2h.init Loading commit data...
tablegen.txt Loading commit data...
texi2pod.pl Loading commit data...
viterbi.txt Loading commit data...