• Martin Storsjö's avatar
    dnn-layer-mathbinary-test: Fix tests for cases with extra intermediate precision · f4d8fad8
    Martin Storsjö authored
    This fixes tests on 32 bit x86 mingw with clang, which uses x87
    fpu by default.
    
    In this setup, while the get_expected function is declared to
    return float, the compiler is (especially given the optimization
    flags set) free to keep the intermediate values (in this case,
    the return value from the inlined function) in higher precision.
    
    This results in the situation where 7.28 (which actually, as
    a float, ends up as 7.2800002098), multiplied by 100, is
    728.000000 when really forced into a 32 bit float, but 728.000021
    when kept with higher intermediate precision.
    
    For the multiplication case, a more suitable epsilon would e.g.
    be 2*FLT_EPSILON*fabs(expected_output), but just increase the
    current hardcoded threshold for now.
    Signed-off-by: 's avatarMartin Storsjö <martin@martin.st>
    f4d8fad8
Name
Last commit
Last update
compat Loading commit data...
doc Loading commit data...
ffbuild Loading commit data...
fftools Loading commit data...
libavcodec Loading commit data...
libavdevice Loading commit data...
libavfilter Loading commit data...
libavformat Loading commit data...
libavresample Loading commit data...
libavutil Loading commit data...
libpostproc Loading commit data...
libswresample Loading commit data...
libswscale Loading commit data...
presets Loading commit data...
tests Loading commit data...
tools Loading commit data...
.gitattributes Loading commit data...
.gitignore Loading commit data...
.mailmap Loading commit data...
.travis.yml Loading commit data...
CONTRIBUTING.md Loading commit data...
COPYING.GPLv2 Loading commit data...
COPYING.GPLv3 Loading commit data...
COPYING.LGPLv2.1 Loading commit data...
COPYING.LGPLv3 Loading commit data...
CREDITS Loading commit data...
Changelog Loading commit data...
INSTALL.md Loading commit data...
LICENSE.md Loading commit data...
MAINTAINERS Loading commit data...
Makefile Loading commit data...
README.md Loading commit data...
RELEASE Loading commit data...
configure Loading commit data...