- 24 Jul, 2018 1 commit
-
-
Michael Achenbach authored
Bug: chromium:846711 Change-Id: Ic51e31a48106e495c3dc7d75ef4c97fa82071a64 Reviewed-on: https://chromium-review.googlesource.com/1148057Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org> Commit-Queue: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#54633}
-
- 08 Feb, 2018 1 commit
-
-
Michael Achenbach authored
Timeouts on num-fuzzer only lead to false positives, as tests might take unpredictably longer. This CL forgives timeouts through a global override mechanism of the expected outcomes. This allows to remove already existing scattered code that allowed timeouts in some test suites only. Bug: v8:6917 Change-Id: Ib131765d360e335789c1952bc6793ed051e016ea Reviewed-on: https://chromium-review.googlesource.com/908454 Commit-Queue: Michael Achenbach <machenbach@chromium.org> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org> Cr-Commit-Position: refs/heads/master@{#51188}
-
- 26 Jan, 2018 1 commit
-
-
Michael Achenbach authored
A timeout result of randomly combined tests is not a useful indicator. Therefore we ignore those now. This also prevents timeouts from being re-run. TBR=sergiyb@chromium.org NOTRY=true Bug: v8:6917 Change-Id: I8e5eb93e2f13067ca5270fb152c3dc1eda1bb3c2 Reviewed-on: https://chromium-review.googlesource.com/888559Reviewed-by: Michael Achenbach <machenbach@chromium.org> Commit-Queue: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#50879}
-
- 23 Jan, 2018 1 commit
-
-
Michal Majewski authored
Since we're not winning anything by changing the result between processors on the main process, reduce is noop there and result is immutable. Bug: v8:6917 Change-Id: Ieb282e7abd4ab31162aee6b52493a6e1b6a25109 Cq-Include-Trybots: luci.v8.try:v8_linux64_fyi_rel_ng Reviewed-on: https://chromium-review.googlesource.com/878239 Commit-Queue: Michał Majewski <majeski@google.com> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#50784}
-
- 15 Jan, 2018 1 commit
-
-
Michal Majewski authored
Bug: v8:6917 Change-Id: Id73e4892a0d1b3b9c5bdd70ccc136e7bd2edf360 Cq-Include-Trybots: luci.v8.try:v8_linux64_fyi_rel_ng Reviewed-on: https://chromium-review.googlesource.com/863603 Commit-Queue: Michał Majewski <majeski@google.com> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#50565}
-
- 09 Jan, 2018 1 commit
-
-
Michal Majewski authored
Bug: v8:6972 Change-Id: I0f3f933f14b26771b73daa053c17ce4cf8906bd7 Reviewed-on: https://chromium-review.googlesource.com/819635 Commit-Queue: Michał Majewski <majeski@google.com> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#50459}
-
- 04 Jan, 2018 2 commits
-
-
Michal Majewski authored
I added additional exception logging in the execution.py since errors in processing results were really difficult to debug. There is a problem on Windows with class serialization when it comes from dynamically loaded module. To fix it I moved all output processors to the tools/testrunner/outproc/ and import them in test/*/testcfg.py. Bug: v8:6917 Change-Id: Ida604641d659b006e91faf1d56a37769ec47f5f3 Reviewed-on: https://chromium-review.googlesource.com/842784 Commit-Queue: Michał Majewski <majeski@google.com> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#50361}
-
Michael Achenbach authored
This reverts commit 1685b5d2. Reason for revert: Was probably caused by infra change: https://crrev.com/c/845781 Original change's description: > Revert "[test] Move has unexpected output to outproc." > > This reverts commit 71605b3e. > > Reason for revert: Seems to break static-initializers step: > https://build.chromium.org/p/client.v8/builders/V8%20Linux64/builds/22156 > > Original change's description: > > [test] Move has unexpected output to outproc. > > > > Expected outcomes optimized to serialize [PASS] as None. > > > > Keeping expected outcomes inside output processors should be > > optimized in the future. Few possible optimizations: > > - separate classes for tests that are expected to PASS - done as > > an example in mozilla test suite. > > - cache output processors inside testcase. > > - share output processors between copies of the same test - needs > > some updates to the create_variant to update outproc only if > > expected outcomes changed. > > > > Bug: v8:6917 > > Change-Id: Ie73f1dcdf17fdfc65bce27228f818b1dd1e420c9 > > Reviewed-on: https://chromium-review.googlesource.com/843025 > > Commit-Queue: Michael Achenbach <machenbach@chromium.org> > > Reviewed-by: Michael Achenbach <machenbach@chromium.org> > > Cr-Commit-Position: refs/heads/master@{#50347} > > TBR=machenbach@chromium.org,sergiyb@chromium.org,majeski@google.com > > Change-Id: Ice1f3aee0a26f7f38996459d38fd6e0bd964113d > No-Presubmit: true > No-Tree-Checks: true > No-Try: true > Bug: v8:6917 > Reviewed-on: https://chromium-review.googlesource.com/849572 > Reviewed-by: Bill Budge <bbudge@chromium.org> > Commit-Queue: Bill Budge <bbudge@chromium.org> > Cr-Commit-Position: refs/heads/master@{#50348} TBR=bbudge@chromium.org,machenbach@chromium.org,sergiyb@chromium.org,majeski@google.com Change-Id: I7a522b6487de6e96985d223524533493eb9171f0 No-Presubmit: true No-Tree-Checks: true No-Try: true Bug: v8:6917 Reviewed-on: https://chromium-review.googlesource.com/848975Reviewed-by: Michael Achenbach <machenbach@chromium.org> Commit-Queue: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#50350}
-
- 03 Jan, 2018 2 commits
-
-
Bill Budge authored
This reverts commit 71605b3e. Reason for revert: Seems to break static-initializers step: https://build.chromium.org/p/client.v8/builders/V8%20Linux64/builds/22156 Original change's description: > [test] Move has unexpected output to outproc. > > Expected outcomes optimized to serialize [PASS] as None. > > Keeping expected outcomes inside output processors should be > optimized in the future. Few possible optimizations: > - separate classes for tests that are expected to PASS - done as > an example in mozilla test suite. > - cache output processors inside testcase. > - share output processors between copies of the same test - needs > some updates to the create_variant to update outproc only if > expected outcomes changed. > > Bug: v8:6917 > Change-Id: Ie73f1dcdf17fdfc65bce27228f818b1dd1e420c9 > Reviewed-on: https://chromium-review.googlesource.com/843025 > Commit-Queue: Michael Achenbach <machenbach@chromium.org> > Reviewed-by: Michael Achenbach <machenbach@chromium.org> > Cr-Commit-Position: refs/heads/master@{#50347} TBR=machenbach@chromium.org,sergiyb@chromium.org,majeski@google.com Change-Id: Ice1f3aee0a26f7f38996459d38fd6e0bd964113d No-Presubmit: true No-Tree-Checks: true No-Try: true Bug: v8:6917 Reviewed-on: https://chromium-review.googlesource.com/849572Reviewed-by: Bill Budge <bbudge@chromium.org> Commit-Queue: Bill Budge <bbudge@chromium.org> Cr-Commit-Position: refs/heads/master@{#50348}
-
Michal Majewski authored
Expected outcomes optimized to serialize [PASS] as None. Keeping expected outcomes inside output processors should be optimized in the future. Few possible optimizations: - separate classes for tests that are expected to PASS - done as an example in mozilla test suite. - cache output processors inside testcase. - share output processors between copies of the same test - needs some updates to the create_variant to update outproc only if expected outcomes changed. Bug: v8:6917 Change-Id: Ie73f1dcdf17fdfc65bce27228f818b1dd1e420c9 Reviewed-on: https://chromium-review.googlesource.com/843025 Commit-Queue: Michael Achenbach <machenbach@chromium.org> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#50347}
-
- 21 Dec, 2017 3 commits
-
-
Michal Majewski authored
All get outcome logic moved out from testsuite which makes output processors serializable. Output processors that are not global are stored inside testcase to share them with all test copies. Bug: v8:6917 Cq-Include-Trybots: master.tryserver.v8:v8_linux_noi18n_rel_ng Change-Id: I625466b2b00565d885556f96cab03d8d16fa7ff4 Reviewed-on: https://chromium-review.googlesource.com/837069 Commit-Queue: Michał Majewski <majeski@google.com> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org> Cr-Commit-Position: refs/heads/master@{#50275}
-
Michal Majewski authored
Bug: v8:6917 Change-Id: I51ec0be7ea961d3c81e03675cc65d03ecf526c3d Reviewed-on: https://chromium-review.googlesource.com/836988 Commit-Queue: Michał Majewski <majeski@google.com> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org> Cr-Commit-Position: refs/heads/master@{#50268}
-
Michal Majewski authored
Bug: v8:6917 Change-Id: I81bff2190766b3ccbc5da43ff2f3105c6c95da67 Reviewed-on: https://chromium-review.googlesource.com/836557 Commit-Queue: Michał Majewski <majeski@google.com> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org> Cr-Commit-Position: refs/heads/master@{#50263}
-
- 20 Dec, 2017 1 commit
-
-
Michal Majewski authored
First CL moving parsing output to a separate class. Following CLs will move (and deduplicate) code from testcases by sharing common features like comparing stdout to the expected output. Bug: v8:6917 Change-Id: I1174a985949a0b946cefbf7e7c91e8815cbb4f15 Reviewed-on: https://chromium-review.googlesource.com/834130 Commit-Queue: Michał Majewski <majeski@google.com> Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org> Reviewed-by: Michael Achenbach <machenbach@chromium.org> Cr-Commit-Position: refs/heads/master@{#50228}
-