1. 01 Jun, 2021 1 commit
  2. 17 Feb, 2021 1 commit
    • Paolo Severini's avatar
      [Test] Make CSuite benchmark runner work better on Windows · a974dd7e
      Paolo Severini authored
      The csuite.py script does not work correctly on Windows. It runs
      correctly in baseline mode, but there are two problems when running in
      compare mode:
      
      1. In compare mode the output of benchmark.py is piped to the
         compare-baseline.py script, but Windows only execute python files if
         python.exe is the default program to open '.py' files, and this is
         not the case, by default, when python is installed as part of the
         depot_tools.
      
         Fix: explicitly add the 'python' command before compare-baseline.py.
      
      2. By default CSuite prints the results to stdout using escapes codes
         that add color highlights. But this does not work on Windows when
         compare-baseline.py is launched with a pipe:
      
         python test/benchmarks/csuite/benchmark.py <...> |
             python test/benchmarks/csuite/compare-baseline.py <baseline_results>
      
         Fix: Do not use a pipe. Write the benchmark numbers for the
         compare-run into a separate file, and pass the path to this file to
         compare-baseline.py
      
      Change-Id: Ic22d5bd4b47901f0ba0f35bc2496441346d21c6a
      Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/2656855Reviewed-by: 's avatarMichael Stanton <mvstanton@chromium.org>
      Commit-Queue: Paolo Severini <paolosev@microsoft.com>
      Cr-Commit-Position: refs/heads/master@{#72807}
      a974dd7e
  3. 24 Jul, 2020 1 commit
  4. 26 Feb, 2020 1 commit
  5. 20 Mar, 2019 1 commit
  6. 20 Feb, 2019 1 commit
  7. 19 Feb, 2019 1 commit
  8. 21 Dec, 2018 1 commit
    • Mike Stanton's avatar
      [Test] CSuite benchmark runner · 98b47ebb
      Mike Stanton authored
      It's nice to have a quick way to get stable results on the local
      machine for the classic d8 benchmarks. CSuite revitalizes an
      old tool called BSuite which offers multiple averaged runs,
      and a nice ascii display of results.
      
      Sample usage:
      
      ./csuite.py octane baseline ~/src/v8/out/d8
      ./csuite.py octane compare ~/src/v8/out-mine/d8
      
                                    benchmark:    score |   master |      % |
      ===================================================+==========+========+
                                      Richards:  26201.0 |  26568.0 |   -1.4 |
                                     DeltaBlue:  55744.0 |  58309.0 |   -4.4 |
                                        Crypto:  31831.0 |  31815.0 |        |
                                      RayTrace:  73481.0 |  73185.0 |    0.4 |
                    ............<snip>............................
                                        Octane:  36388.0 |  35741.0 |    1.8 |
      ---------------------------------------------------+----------+--------+
      
      
      See README.md for more documentation.
      
      Change-Id: I182490506ca07fab1240bd485bd1d7a8920db893
      Reviewed-on: https://chromium-review.googlesource.com/c/1387487
      Commit-Queue: Michael Stanton <mvstanton@chromium.org>
      Reviewed-by: 's avatarYang Guo <yangguo@chromium.org>
      Reviewed-by: 's avatarJakob Kummerow <jkummerow@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#58434}
      98b47ebb