1. 02 May, 2019 1 commit
    • Michael Achenbach's avatar
      Reland "[test] Remove longer timeout on bots" · 393f788c
      Michael Achenbach authored
      This is a reland of e632f8f4
      
      Original change's description:
      > [test] Remove longer timeout on bots
      >
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_gc_stress_dbg
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_gcc_rel
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_msan_rel
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_tsan_rel
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_arm64_dbg
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_mac64_asan_rel
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_win64_dbg
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_android_arm64_n5x_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_cfi_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_ubsan_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_arm_lite_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_noi18n_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_mac64_dbg_ng
      >
      > Bug: v8:9145
      > Change-Id: I6efee8579d9d9e0aad0431f6b87c152141d4ec7f
      > Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/1581261
      > Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      > Reviewed-by: Tamer Tas <tmrts@chromium.org>
      > Cr-Commit-Position: refs/heads/master@{#61107}
      
      Bug: v8:9145
      Change-Id: Id8f0468bbf2d67f62141e7f7c42417d351c3fffa
      Cq-Include-Trybots: luci.v8.try:v8_linux_gc_stress_dbg
      Cq-Include-Trybots: luci.v8.try:v8_linux_gcc_rel
      Cq-Include-Trybots: luci.v8.try:v8_linux64_msan_rel
      Cq-Include-Trybots: luci.v8.try:v8_linux64_tsan_rel
      Cq-Include-Trybots: luci.v8.try:v8_linux_arm64_dbg
      Cq-Include-Trybots: luci.v8.try:v8_mac64_asan_rel
      Cq-Include-Trybots: luci.v8.try:v8_win64_dbg
      Cq-Include-Trybots: luci.v8.try:v8_android_arm64_n5x_rel_ng
      Cq-Include-Trybots: luci.v8.try:v8_linux64_cfi_rel_ng
      Cq-Include-Trybots: luci.v8.try:v8_linux64_ubsan_rel_ng
      Cq-Include-Trybots: luci.v8.try:v8_linux_arm_lite_rel_ng
      Cq-Include-Trybots: luci.v8.try:v8_linux_noi18n_rel_ng
      Cq-Include-Trybots: luci.v8.try:v8_mac64_dbg_ng
      Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/1588429Reviewed-by: 's avatarTamer Tas <tmrts@chromium.org>
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#61167}
      393f788c
  2. 30 Apr, 2019 2 commits
    • Yang Guo's avatar
      Revert "[test] Remove longer timeout on bots" · 2e6b9f57
      Yang Guo authored
      This reverts commit e632f8f4.
      
      Reason for revert: Seems to cause some timeouts to trigger failures: https://ci.chromium.org/p/v8/builders/ci/V8%20Linux64%20TSAN/26129
      
      Original change's description:
      > [test] Remove longer timeout on bots
      > 
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_gc_stress_dbg
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_gcc_rel
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_msan_rel
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_tsan_rel
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_arm64_dbg
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_mac64_asan_rel
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_win64_dbg
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_android_arm64_n5x_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_cfi_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_ubsan_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_arm_lite_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_noi18n_rel_ng
      > CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_mac64_dbg_ng
      > 
      > Bug: v8:9145
      > Change-Id: I6efee8579d9d9e0aad0431f6b87c152141d4ec7f
      > Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/1581261
      > Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      > Reviewed-by: Tamer Tas <tmrts@chromium.org>
      > Cr-Commit-Position: refs/heads/master@{#61107}
      
      TBR=machenbach@chromium.org,tmrts@chromium.org
      
      Change-Id: I5e23aebc41e6ab15baa57093f7f056cdabd58f21
      No-Presubmit: true
      No-Tree-Checks: true
      No-Try: true
      Bug: v8:9145
      Cq-Include-Trybots: luci.v8.try:v8_linux_gc_stress_dbg, luci.v8.try:v8_linux_gcc_rel, luci.v8.try:v8_linux64_msan_rel, luci.v8.try:v8_linux64_tsan_rel, luci.v8.try:v8_linux_arm64_dbg, luci.v8.try:v8_mac64_asan_rel, luci.v8.try:v8_win64_dbg, luci.v8.try:v8_android_arm64_n5x_rel_ng, luci.v8.try:v8_linux64_cfi_rel_ng, luci.v8.try:v8_linux64_ubsan_rel_ng, luci.v8.try:v8_linux_arm_lite_rel_ng, luci.v8.try:v8_linux_noi18n_rel_ng, luci.v8.try:v8_mac64_dbg_ng
      Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/1588425Reviewed-by: 's avatarYang Guo <yangguo@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#61111}
      2e6b9f57
    • Michael Achenbach's avatar
      [test] Remove longer timeout on bots · e632f8f4
      Michael Achenbach authored
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_gc_stress_dbg
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_gcc_rel
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_msan_rel
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_tsan_rel
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_arm64_dbg
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_mac64_asan_rel
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_win64_dbg
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_android_arm64_n5x_rel_ng
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_cfi_rel_ng
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux64_ubsan_rel_ng
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_arm_lite_rel_ng
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_linux_noi18n_rel_ng
      CQ_INCLUDE_TRYBOTS=luci.v8.try:v8_mac64_dbg_ng
      
      Bug: v8:9145
      Change-Id: I6efee8579d9d9e0aad0431f6b87c152141d4ec7f
      Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/1581261
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Reviewed-by: 's avatarTamer Tas <tmrts@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#61107}
      e632f8f4
  3. 23 Apr, 2019 1 commit
  4. 27 Feb, 2019 1 commit
  5. 19 Feb, 2019 1 commit
  6. 13 Dec, 2018 1 commit
  7. 22 Nov, 2018 2 commits
  8. 09 Oct, 2018 1 commit
  9. 07 Sep, 2018 1 commit
    • Michael Achenbach's avatar
      Reland "[test] Increase coverage of d8_default test suites" · 0dba4b90
      Michael Achenbach authored
      This is a reland of 8ac91f6c
      
      Skips failing tests on gc stress and fixes predictable testing.
      
      Original change's description:
      > [test] Increase coverage of d8_default test suites
      >
      > NOTRY=true
      >
      > Bug: v8:7285,v8:8140
      > Cq-Include-Trybots: luci.v8.try:v8_linux_noi18n_rel_ng
      > Change-Id: I9cb216de302bc787189f8f12f5b254909b0f5773
      > Reviewed-on: https://chromium-review.googlesource.com/1208496
      > Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      > Reviewed-by: Ross McIlroy <rmcilroy@chromium.org>
      > Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>
      > Cr-Commit-Position: refs/heads/master@{#55682}
      
      Bug: v8:7285, v8:8140, v8:8141
      Change-Id: Ia7a437b874d5c8712f6def30382404e527145610
      Cq-Include-Trybots: luci.v8.try:v8_linux_noi18n_rel_ng
      Cq-Include-Trybots: luci.v8.try:v8_android_arm64_n5x_rel_ng
      Cq-Include-Trybots: luci.v8.try:v8_linux_optional_rel_ng
      Cq-Include-Trybots: luci.v8.try:v8_linux_gc_stress_dbg
      Cq-Include-Trybots: luci.v8.try:v8_mac64_gc_stress_dbg
      Reviewed-on: https://chromium-review.googlesource.com/1209762Reviewed-by: 's avatarSergiy Byelozyorov <sergiyb@chromium.org>
      Reviewed-by: 's avatarYang Guo <yangguo@chromium.org>
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#55701}
      0dba4b90
  10. 06 Sep, 2018 1 commit
  11. 05 Sep, 2018 1 commit
  12. 29 Aug, 2018 1 commit
  13. 10 Aug, 2018 3 commits
    • Michael Achenbach's avatar
      Reland "[test] Add logic to run tests on Android" · b2537f21
      Michael Achenbach authored
      This is a reland of 4c094342
      
      Original change's description:
      > [test] Add logic to run tests on Android
      > 
      > This adds a new command abstraction for running commands on Android
      > using dockered devices on swarming.
      > 
      > The new abstraction handles pushing all required files to the device.
      > The logic used for pushing and running is reused from the perf runner.
      > 
      > This adds only the mjsunit test suite. Others will be handled in
      > follow up CLs. The suite logic is enhanced with auto-detection of files
      > to be pushed to devices, for e.g. load or import statements.
      > 
      > Some test cases need an extra resource section for specifying required
      > files.
      > 
      > Remaining failing tests are marked in the status files for later
      > triage.
      > 
      > Bug: chromium:866862
      > Change-Id: I2b957559f07fdcd8c1bd2f7034f5ba7754a31fb7
      > Reviewed-on: https://chromium-review.googlesource.com/1150153
      > Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>
      > Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      > Cr-Commit-Position: refs/heads/master@{#55041}
      
      Bug: chromium:866862
      Change-Id: Icf7e04c75d4abeab7254d10ba21240e46b0022ae
      Reviewed-on: https://chromium-review.googlesource.com/1170643Reviewed-by: 's avatarSergiy Byelozyorov <sergiyb@chromium.org>
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#55059}
      b2537f21
    • Sergiy Byelozyorov's avatar
      Revert "[test] Add logic to run tests on Android" · 2071051e
      Sergiy Byelozyorov authored
      This reverts commit 4c094342.
      
      Reason for revert: Unfortunately this broke all perf builders.
      
      Original change's description:
      > [test] Add logic to run tests on Android
      > 
      > This adds a new command abstraction for running commands on Android
      > using dockered devices on swarming.
      > 
      > The new abstraction handles pushing all required files to the device.
      > The logic used for pushing and running is reused from the perf runner.
      > 
      > This adds only the mjsunit test suite. Others will be handled in
      > follow up CLs. The suite logic is enhanced with auto-detection of files
      > to be pushed to devices, for e.g. load or import statements.
      > 
      > Some test cases need an extra resource section for specifying required
      > files.
      > 
      > Remaining failing tests are marked in the status files for later
      > triage.
      > 
      > Bug: chromium:866862
      > Change-Id: I2b957559f07fdcd8c1bd2f7034f5ba7754a31fb7
      > Reviewed-on: https://chromium-review.googlesource.com/1150153
      > Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>
      > Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      > Cr-Commit-Position: refs/heads/master@{#55041}
      
      TBR=machenbach@chromium.org,yangguo@chromium.org,sergiyb@chromium.org
      
      Change-Id: If80129810586b709dab762c9b5724888e15daec2
      No-Presubmit: true
      No-Tree-Checks: true
      No-Try: true
      Bug: chromium:866862
      Reviewed-on: https://chromium-review.googlesource.com/1170962Reviewed-by: 's avatarSergiy Byelozyorov <sergiyb@chromium.org>
      Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#55058}
      2071051e
    • Michael Achenbach's avatar
      [test] Add logic to run tests on Android · 4c094342
      Michael Achenbach authored
      This adds a new command abstraction for running commands on Android
      using dockered devices on swarming.
      
      The new abstraction handles pushing all required files to the device.
      The logic used for pushing and running is reused from the perf runner.
      
      This adds only the mjsunit test suite. Others will be handled in
      follow up CLs. The suite logic is enhanced with auto-detection of files
      to be pushed to devices, for e.g. load or import statements.
      
      Some test cases need an extra resource section for specifying required
      files.
      
      Remaining failing tests are marked in the status files for later
      triage.
      
      Bug: chromium:866862
      Change-Id: I2b957559f07fdcd8c1bd2f7034f5ba7754a31fb7
      Reviewed-on: https://chromium-review.googlesource.com/1150153Reviewed-by: 's avatarSergiy Byelozyorov <sergiyb@chromium.org>
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#55041}
      4c094342
  14. 08 Jun, 2018 1 commit
  15. 01 Feb, 2018 2 commits
  16. 31 Jan, 2018 3 commits
  17. 30 Jan, 2018 2 commits
  18. 23 Jan, 2018 1 commit
  19. 22 Jan, 2018 1 commit
  20. 19 Jan, 2018 2 commits
  21. 17 Jan, 2018 1 commit
  22. 15 Jan, 2018 2 commits
  23. 12 Jan, 2018 1 commit
  24. 09 Jan, 2018 1 commit
  25. 08 Jan, 2018 1 commit
  26. 04 Jan, 2018 3 commits
    • Michal Majewski's avatar
      [test] Fix predictable mode with output processors · 9a3773e6
      Michal Majewski authored
      Bug: v8:6917
      Change-Id: I7bc5d09ff19a9cf7cb4bee68ca6cf34f5cfa8b19
      Reviewed-on: https://chromium-review.googlesource.com/850874
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Reviewed-by: 's avatarMichael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#50365}
      9a3773e6
    • Michal Majewski's avatar
      [test] Check output on the worker process. · 9f7d440e
      Michal Majewski authored
      I added additional exception logging in the execution.py since
      errors in processing results were really difficult to debug.
      
      There is a problem on Windows with class serialization when
      it comes from dynamically loaded module. To fix it I moved all
      output processors to the tools/testrunner/outproc/ and import
      them in test/*/testcfg.py.
      
      Bug: v8:6917
      Change-Id: Ida604641d659b006e91faf1d56a37769ec47f5f3
      Reviewed-on: https://chromium-review.googlesource.com/842784
      Commit-Queue: Michał Majewski <majeski@google.com>
      Reviewed-by: 's avatarMichael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#50361}
      9f7d440e
    • Michael Achenbach's avatar
      Revert "Revert "[test] Move has unexpected output to outproc."" · c1e9bc02
      Michael Achenbach authored
      This reverts commit 1685b5d2.
      
      Reason for revert: Was probably caused by infra change:
      https://crrev.com/c/845781
      
      Original change's description:
      > Revert "[test] Move has unexpected output to outproc."
      > 
      > This reverts commit 71605b3e.
      > 
      > Reason for revert: Seems to break static-initializers step:
      > https://build.chromium.org/p/client.v8/builders/V8%20Linux64/builds/22156
      > 
      > Original change's description:
      > > [test] Move has unexpected output to outproc.
      > > 
      > > Expected outcomes optimized to serialize [PASS] as None.
      > > 
      > > Keeping expected outcomes inside output processors should be
      > > optimized in the future. Few possible optimizations:
      > > - separate classes for tests that are expected to PASS - done as
      > > an example in mozilla test suite.
      > > - cache output processors inside testcase.
      > > - share output processors between copies of the same test - needs
      > > some updates to the create_variant to update outproc only if
      > > expected outcomes changed.
      > > 
      > > Bug: v8:6917
      > > Change-Id: Ie73f1dcdf17fdfc65bce27228f818b1dd1e420c9
      > > Reviewed-on: https://chromium-review.googlesource.com/843025
      > > Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      > > Reviewed-by: Michael Achenbach <machenbach@chromium.org>
      > > Cr-Commit-Position: refs/heads/master@{#50347}
      > 
      > TBR=machenbach@chromium.org,sergiyb@chromium.org,majeski@google.com
      > 
      > Change-Id: Ice1f3aee0a26f7f38996459d38fd6e0bd964113d
      > No-Presubmit: true
      > No-Tree-Checks: true
      > No-Try: true
      > Bug: v8:6917
      > Reviewed-on: https://chromium-review.googlesource.com/849572
      > Reviewed-by: Bill Budge <bbudge@chromium.org>
      > Commit-Queue: Bill Budge <bbudge@chromium.org>
      > Cr-Commit-Position: refs/heads/master@{#50348}
      
      TBR=bbudge@chromium.org,machenbach@chromium.org,sergiyb@chromium.org,majeski@google.com
      
      Change-Id: I7a522b6487de6e96985d223524533493eb9171f0
      No-Presubmit: true
      No-Tree-Checks: true
      No-Try: true
      Bug: v8:6917
      Reviewed-on: https://chromium-review.googlesource.com/848975Reviewed-by: 's avatarMichael Achenbach <machenbach@chromium.org>
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#50350}
      c1e9bc02
  27. 03 Jan, 2018 2 commits
    • Bill Budge's avatar
      Revert "[test] Move has unexpected output to outproc." · 1685b5d2
      Bill Budge authored
      This reverts commit 71605b3e.
      
      Reason for revert: Seems to break static-initializers step:
      https://build.chromium.org/p/client.v8/builders/V8%20Linux64/builds/22156
      
      Original change's description:
      > [test] Move has unexpected output to outproc.
      > 
      > Expected outcomes optimized to serialize [PASS] as None.
      > 
      > Keeping expected outcomes inside output processors should be
      > optimized in the future. Few possible optimizations:
      > - separate classes for tests that are expected to PASS - done as
      > an example in mozilla test suite.
      > - cache output processors inside testcase.
      > - share output processors between copies of the same test - needs
      > some updates to the create_variant to update outproc only if
      > expected outcomes changed.
      > 
      > Bug: v8:6917
      > Change-Id: Ie73f1dcdf17fdfc65bce27228f818b1dd1e420c9
      > Reviewed-on: https://chromium-review.googlesource.com/843025
      > Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      > Reviewed-by: Michael Achenbach <machenbach@chromium.org>
      > Cr-Commit-Position: refs/heads/master@{#50347}
      
      TBR=machenbach@chromium.org,sergiyb@chromium.org,majeski@google.com
      
      Change-Id: Ice1f3aee0a26f7f38996459d38fd6e0bd964113d
      No-Presubmit: true
      No-Tree-Checks: true
      No-Try: true
      Bug: v8:6917
      Reviewed-on: https://chromium-review.googlesource.com/849572Reviewed-by: 's avatarBill Budge <bbudge@chromium.org>
      Commit-Queue: Bill Budge <bbudge@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#50348}
      1685b5d2
    • Michal Majewski's avatar
      [test] Move has unexpected output to outproc. · 71605b3e
      Michal Majewski authored
      Expected outcomes optimized to serialize [PASS] as None.
      
      Keeping expected outcomes inside output processors should be
      optimized in the future. Few possible optimizations:
      - separate classes for tests that are expected to PASS - done as
      an example in mozilla test suite.
      - cache output processors inside testcase.
      - share output processors between copies of the same test - needs
      some updates to the create_variant to update outproc only if
      expected outcomes changed.
      
      Bug: v8:6917
      Change-Id: Ie73f1dcdf17fdfc65bce27228f818b1dd1e420c9
      Reviewed-on: https://chromium-review.googlesource.com/843025
      Commit-Queue: Michael Achenbach <machenbach@chromium.org>
      Reviewed-by: 's avatarMichael Achenbach <machenbach@chromium.org>
      Cr-Commit-Position: refs/heads/master@{#50347}
      71605b3e