1. 23 Apr, 2019 2 commits
  2. 11 Apr, 2019 1 commit
  3. 07 Apr, 2019 1 commit
  4. 05 Apr, 2019 1 commit
    • Michael Achenbach's avatar
      [test] Expose variant flags in json output · ff0b9dd3
      Michael Achenbach authored
      For standard test failures, the variant name is enough to deduce the
      full command line of the test. This is used to create the flako
      command line on the infra side.
      
      Test failures from numfuzz have additional variant_flags, calculated
      by the fuzzer, which don't match a variant name. Exposing those in
      the test results will enable printing a proper flako command line
      on infra side for numfuzz cases.
      
      Bug: v8:8971
      Change-Id: Ie47d42a0b34037da458b474f2a9ab38f1a5d238a
      Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/1554689Reviewed-by: 's avatarSergiy Belozorov <sergiyb@chromium.org>
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#60656}
      ff0b9dd3
  5. 01 Mar, 2019 1 commit
  6. 28 Feb, 2019 1 commit
  7. 19 Feb, 2019 1 commit
  8. 12 Feb, 2019 2 commits
    • Tamer Tas's avatar
      [testrunner] enable the progress indicator · baeb4e32
      Tamer Tas authored
      Using test generators meant that we had to remove the progress indicator since
      the total number of tests weren't known before-hand.
      
      This CL implements a progress indicator using test number estimations.
      
      cctest and unittests progress indicator is accurate, however estimating
      means the progress will terminate over 100% in big test suites and sometimes
      under 100%.
      
      R=machenbach@chromium.org
      CC=​sergiyb@chromium.org,yangguo@chromium.org
      
      Bug: v8:8769
      Change-Id: I40ca5b40f9b1223376d33707f0945900ea98cea3
      Reviewed-on: https://chromium-review.googlesource.com/c/1460471
      Commit-Queue: Tamer Tas <tmrts@chromium.org>
      Reviewed-by: 's avatarMichael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#59538}
      baeb4e32
    • Tamer Tas's avatar
      [testrunner] enable variant sharding · ad5b6d7d
      Tamer Tas authored
      Testrunner runs variants of a test sequentially without taking sharding into
      account. A slow test with slow variants slows down the whole test run no matter
      the sharding configuration.
      
      This CL implements a test hashing algorithm and variant sharding for test
      variants.
      
      R=machenbach@chromium.org
      CC=yangguo@chromium.org,sergiyb@chromium.org
      
      Bug: v8:8174
      Change-Id: I15f8c547fa2f361fb6c53bf8d5df055d3df38d3e
      Reviewed-on: https://chromium-review.googlesource.com/c/1458016
      Commit-Queue: Tamer Tas <tmrts@chromium.org>
      Reviewed-by: 's avatarMichael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#59530}
      ad5b6d7d
  9. 07 Feb, 2019 1 commit
  10. 31 Jan, 2019 1 commit
  11. 30 Jan, 2019 1 commit
  12. 24 Jan, 2019 3 commits
  13. 23 Jan, 2019 1 commit
  14. 21 Jan, 2019 1 commit
  15. 11 Jan, 2019 1 commit
  16. 16 Oct, 2018 2 commits
  17. 10 Oct, 2018 1 commit
  18. 02 Oct, 2018 1 commit
  19. 25 Jul, 2018 1 commit
    • Jakob Kummerow's avatar
      [tests] Make processing of test filters faster · f15cb8fe
      Jakob Kummerow authored
      The test driver compares command-line arguments against test names
      it finds on disk. Using Python's "fnmatch" for this nicely handles
      wildcards, but is relatively slow. For given test names that don't
      contain any '*', we can use string equality testing, which is much
      faster.
      
      Example: the time to evaluate
      
       tools/run-tests.py --arch x64 --mode release \
         $(grep 'object-spread' -l -r test/test262/data/test/ | \
             sed -E 's|\.js$||' | \
             sed -E 's|^test/test262/data/test/|test262/|')
      
      goes from "I gave up and killed the process after several minutes"
      to a couple of seconds with this patch.
      
      Change-Id: I9ec404b7516afd801fe6126347f6dff533d1977c
      Reviewed-on: https://chromium-review.googlesource.com/1149196
      Commit-Queue: Jakob Kummerow <jkummerow@chromium.org>
      Reviewed-by: 's avatarMichael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#54704}
      f15cb8fe
  20. 20 Feb, 2018 1 commit
    • Michael Achenbach's avatar
      [test] Abort testing immediately on interrupt and sigterm · 4a2d9b1b
      Michael Achenbach authored
      This is a partial revert of:
      https://crrev.com/c/890938 and https://crrev.com/c/893982
      
      Before this CL, the test runner blocked on ongoing tests in order to
      process their results after an internal timeout. However, the logic
      required for this feature was overly complicated and prevented an
      acceptable implementation for fast aborts. Furthermore, also the fuzzers
      suffered from timeouts on swarming due to hanging tests.
      
      Instead, we now abort immediately on internal timeout (used on
      fuzzers), SIGINT (Ctrl-C) and SIGTERM. Ongoing tests are immediately
      terminated and their results are disregarded. On SIGTERM and SIGINT,
      we return with non-zero exit codes, and zero on internal timeout.
      
      This will also properly return json output, when the external hard
      timeout is reached on swarming (causes SIGTERM).
      
      TBR=sergiyb@chromium.org
      
      Bug: v8:7423, chromium:813065
      Change-Id: Ib20f835f58a0970693bdd3b21dc5d766d8e115d8
      Reviewed-on: https://chromium-review.googlesource.com/924852Reviewed-by: 's avatarMichael Achenbach <machenbach@chromium.org>
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#51399}
      4a2d9b1b
  21. 16 Feb, 2018 1 commit
  22. 14 Feb, 2018 1 commit
  23. 08 Feb, 2018 1 commit
  24. 02 Feb, 2018 1 commit
  25. 01 Feb, 2018 1 commit
  26. 31 Jan, 2018 5 commits
  27. 30 Jan, 2018 2 commits
  28. 29 Jan, 2018 1 commit
  29. 26 Jan, 2018 2 commits