- 27 Nov, 2015 2 commits
-
-
jkummerow authored
And add a presubmit check to guard against future duplicates. R=machenbach@chromium.org Review URL: https://codereview.chromium.org/1477403002 Cr-Commit-Position: refs/heads/master@{#32380}
-
machenbach authored
This will allow moving the test outcome check beyond the multi-process boundary in a follow up. It'll allow wrapping more complex test jobs like predicable mode on the multi- process side, which will make the code easier to maintain. BUG= Review URL: https://codereview.chromium.org/1469833002 Cr-Commit-Position: refs/heads/master@{#32373}
-
- 25 Nov, 2015 3 commits
-
-
adamk authored
This will make sure that message tests cover both the parser and preparser paths, just as we do for parsing-related cctests. BUG=v8:4372 LOG=n Review URL: https://codereview.chromium.org/1469383004 Cr-Commit-Position: refs/heads/master@{#32307}
-
machenbach authored
This loads all test suites and status files to catch subtle syntax errors. It also checks basic status file integrity and common mistakes. NOTRY=true Review URL: https://codereview.chromium.org/1475663002 Cr-Commit-Position: refs/heads/master@{#32271}
-
machenbach authored
BUG= Review URL: https://codereview.chromium.org/1466303005 Cr-Commit-Position: refs/heads/master@{#32267}
-
- 23 Nov, 2015 1 commit
-
-
machenbach authored
The feature sometimes prevents subsequent swarming bots to delete the work directory on windows. The data file is not kept on swarming bots anyways, therefore this switches off the feature completely. BUG=chromium:535160 LOG=n Review URL: https://codereview.chromium.org/1468933002 Cr-Commit-Position: refs/heads/master@{#32168}
-
- 06 Nov, 2015 1 commit
-
-
rmcilroy authored
Adds a blacklist of tests which are currently unsupported or broken in Ignition to the mjsunit and test262 test status. Also removes --ignition-script-filter flag, and adds a --ignition_fallback_on_eval_and_catch flag which fallsback to fullcodegen for functions which call eval or contain a catch block. BUG=v8:4280 LOG=N Review URL: https://codereview.chromium.org/1420963009 Cr-Commit-Position: refs/heads/master@{#31864}
-
- 03 Nov, 2015 1 commit
-
-
machenbach authored
The flake detection is done on the infra-side according to the contents of the json test results. We don't want the runner to fail after flakes. This was controlled on the infra side by accepting any exit codes so far. After the swarming switch, this is more difficult, because the runner is wrapped by the swarming collect script. There, failing exit codes can mean many things, including network failures. Therefore, we now force exit code 0 with test failures if those failures are reported in the formal test results json. The infrastructure will take care of reporting the flakes and failures accordingly. BUG=chromium:535160 LOG=n Review URL: https://codereview.chromium.org/1416373005 Cr-Commit-Position: refs/heads/master@{#31740}
-
- 20 Oct, 2015 1 commit
-
-
bmeurer authored
Review URL: https://codereview.chromium.org/1402353006 Cr-Commit-Position: refs/heads/master@{#31409}
-
- 06 Oct, 2015 1 commit
-
-
rmcilroy authored
Adds an ignition variant to the test runner and adds support to test262 for filtering such that only test scripts (not the test harness) get run by the interpreter. BUG=v8:4280 LOG=N Review URL: https://codereview.chromium.org/1379093002 Cr-Commit-Position: refs/heads/master@{#31123}
-
- 01 Oct, 2015 1 commit
-
-
machenbach authored
Swarming won't support an incremental data file. By just sorting the lowest hanging fruits to the beginning we already get a big bang for the buck (>80% of the improvement we get otherwise). This will require semi-regular manual updates of the slowest tests. BUG=chromium:535160 LOG=n Review URL: https://codereview.chromium.org/1385443002 Cr-Commit-Position: refs/heads/master@{#31061}
-
- 29 Sep, 2015 2 commits
-
-
dusan.m.milosavljevic authored
TEST= BUG= Review URL: https://codereview.chromium.org/1334793004 Cr-Commit-Position: refs/heads/master@{#31011}
-
cbruni authored
[run-tests.py] - adding more detailed information about the flags - show more detailed error message on failing Popen commands BUG= Review URL: https://codereview.chromium.org/1369343002 Cr-Commit-Position: refs/heads/master@{#30997}
-
- 17 Sep, 2015 3 commits
-
-
jkummerow authored
Now run-tests.py understands "suite/foo/bar" with forward slashes for command-line test selection on all test suites on all platforms. Previously, file-based suites like mjsunit also accepted "mjsunit/foo\bar"; that behavior is sacrificed here in favor of unification. For the cctest suite, OTOH, it wasn't possible on Windows to select specific tests at all. Original review: https://codereview.chromium.org/1348653003/ This reverts commit 5f44a910. NOTRY=true Review URL: https://codereview.chromium.org/1356613002 Cr-Commit-Position: refs/heads/master@{#30798}
-
jkummerow authored
Revert of [test] Fix cctest path separators on Windows (patchset #2 id:20001 of https://codereview.chromium.org/1348653003/ ) Reason for revert: mozilla tests are failing on Windows Original issue's description: > [test] Fix cctest path separators on Windows > > Now run-tests.py understands "suite/foo/bar" with forward slashes for > command-line test selection on all test suites on all platforms. > > Previously, file-based suites like mjsunit also accepted "mjsunit/foo\bar"; > that behavior is sacrificed here in favor of unification. For the cctest > suite, OTOH, it wasn't possible on Windows to select specific tests at all. > > Committed: https://crrev.com/b36cfdb39ae648b49a1396c4f669df9b1f57996c > Cr-Commit-Position: refs/heads/master@{#30794} TBR=machenbach@google.com,machenbach@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true Review URL: https://codereview.chromium.org/1349163002 Cr-Commit-Position: refs/heads/master@{#30795}
-
jkummerow authored
Now run-tests.py understands "suite/foo/bar" with forward slashes for command-line test selection on all test suites on all platforms. Previously, file-based suites like mjsunit also accepted "mjsunit/foo\bar"; that behavior is sacrificed here in favor of unification. For the cctest suite, OTOH, it wasn't possible on Windows to select specific tests at all. Review URL: https://codereview.chromium.org/1348653003 Cr-Commit-Position: refs/heads/master@{#30794}
-
- 07 Sep, 2015 1 commit
-
-
machenbach authored
This information can be used on the buildbot side to only rebuild the failing target for bisection. BUG=chromium:511215 LOG=n NOTRY=true Review URL: https://codereview.chromium.org/1313353006 Cr-Commit-Position: refs/heads/master@{#30617}
-
- 07 Aug, 2015 1 commit
-
-
machenbach authored
BUG=chromium:511215 LOG=n Review URL: https://codereview.chromium.org/1276853002 Cr-Commit-Position: refs/heads/master@{#30057}
-
- 06 Aug, 2015 1 commit
-
-
machenbach authored
Use the same path separator for test cases on the cmd-line on all platforms as in testcase.GetLabel, which is used to report failures. BUG=chromium:511215 LOG=n NOTRY=true Review URL: https://codereview.chromium.org/1281453003 Cr-Commit-Position: refs/heads/master@{#30045}
-
- 29 Jul, 2015 1 commit
-
-
machenbach authored
This allows variants to be named on test failures (follow up) and then to be used in the test runner for a repro. This also speeds up variant iteration for test262 and fixes a bug with variants for benchmarks. BUG=chromium:511215 NOTREECHECKS=true LOG=n Review URL: https://codereview.chromium.org/1245623005 Cr-Commit-Position: refs/heads/master@{#29899}
-
- 23 Jul, 2015 1 commit
-
-
machenbach authored
There are many test names in the v8 code base that prefix others, which makes it hard to only run those tests. BUG=chromium:511215 LOG=n NOTRY=true Review URL: https://codereview.chromium.org/1251363002 Cr-Commit-Position: refs/heads/master@{#29809}
-
- 09 Jul, 2015 1 commit
-
-
machenbach authored
TBR=bmeurer@chromium.org NOTRY=true Review URL: https://codereview.chromium.org/1228073002 Cr-Commit-Position: refs/heads/master@{#29554}
-
- 07 Jul, 2015 2 commits
-
-
machenbach authored
BUG=v8:4254 LOG=n NOTRY=true NOPRESUBMIT=true NOTREECHECKS=true TBR=jkummerow@chromium.org Review URL: https://codereview.chromium.org/1220333004 Cr-Commit-Position: refs/heads/master@{#29513}
-
machenbach authored
BUG=v8:4254 LOG=n NOTRY=true NOPRESUBMIT=true NOTREECHECKS=true TBR=jkummerow@chromium.org Review URL: https://codereview.chromium.org/1219013007 Cr-Commit-Position: refs/heads/master@{#29510}
-
- 22 Jun, 2015 2 commits
-
-
arv authored
Also reordered related test BUG=N LOG=N R=adamk, littledan Review URL: https://codereview.chromium.org/1199013002 Cr-Commit-Position: refs/heads/master@{#29200}
-
arv authored
This adds a new FAIL_SLOPPY expected output. It then uses this to determine if the test case has unexpected output. BUG=v8:4164 LOG=N R=machenbach@chromium.org Review URL: https://codereview.chromium.org/1197913002 Cr-Commit-Position: refs/heads/master@{#29194}
-
- 19 Jun, 2015 1 commit
-
-
arv authored
This reverts commit 72bb369d. Always skip slow tests. Also, some eval tests are failing in strict mode with nosnap BUG=N LOG=N R=adamk@chromium.org, littledan@chromium.org, machenbach@chromium.org Review URL: https://codereview.chromium.org/1190063002 Cr-Commit-Position: refs/heads/master@{#29164}
-
- 17 Jun, 2015 1 commit
-
-
machenbach authored
Revert of Update test262-es6 to 6/11 (patchset #2 id:40001 of https://codereview.chromium.org/1175313003/) Reason for revert: [Sheriff] Please fix test expectations for nosnap before reland. There are 54 tests failing: http://build.chromium.org/p/client.v8/builders/V8%20Linux%20-%20nosnap/builds/3422 Original issue's description: > Update test262-es6 to 6/11 > > This reverts commit 67b16919 and picks > up the fixes to the yaml parser upstream. > > BUG=N > LOG=N > R=adamk@chromium.org, machenbach@chromium.org > > Committed: https://crrev.com/bc847230610d0518a700a69546d23784e6ce3479 > Cr-Commit-Position: refs/heads/master@{#29056} TBR=adamk@chromium.org,arv@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=N Review URL: https://codereview.chromium.org/1186093005 Cr-Commit-Position: refs/heads/master@{#29067}
-
- 16 Jun, 2015 1 commit
-
-
arv authored
This reverts commit 67b16919 and picks up the fixes to the yaml parser upstream. BUG=N LOG=N R=adamk@chromium.org, machenbach@chromium.org Review URL: https://codereview.chromium.org/1175313003 Cr-Commit-Position: refs/heads/master@{#29056}
-
- 12 Jun, 2015 1 commit
-
-
machenbach authored
Also use again the taskkill method, recently removed in https://codereview.chromium.org/1156133006/ BUG=chromium:485932 LOG=n TBR=jkummerow@chromium.org NOTREECHECKS=true Review URL: https://codereview.chromium.org/1177903005 Cr-Commit-Position: refs/heads/master@{#29001}
-
- 11 Jun, 2015 1 commit
-
-
machenbach authored
NOTRY=true Review URL: https://codereview.chromium.org/1180473003 Cr-Commit-Position: refs/heads/master@{#28936}
-
- 10 Jun, 2015 5 commits
-
-
machenbach authored
This saves >1s for mjsunit and >10s for test262. Review URL: https://codereview.chromium.org/1174923002 Cr-Commit-Position: refs/heads/master@{#28904}
-
machenbach authored
Reason for revert: All build problems had other reasons. Original issue's description: > Revert of [test] Refactoring - Let runner handle test IDs. (patchset #1 id:1 of https://codereview.chromium.org/1168303007/) > > Reason for revert: > [Sheriff] Revert until the tree is in a better state. > > Original issue's description: > > [test] Refactoring - Let runner handle test IDs. > > > > This prepares for properly rerunning tests. Currently when > > tests are rerun, the same test object is reused. This > > will be changed in a follow up. > > > > Committed: https://crrev.com/f41a81b8a513fc360c500c066b74f223bc9c0223 > > Cr-Commit-Position: refs/heads/master@{#28864} > > TBR=jkummerow@chromium.org,tandrii@chromium.org > NOPRESUBMIT=true > NOTREECHECKS=true > NOTRY=true > > Committed: https://crrev.com/f83444a5f24381ec9ccc28b1e18e1e9370415bb2 > Cr-Commit-Position: refs/heads/master@{#28891} TBR=jkummerow@chromium.org,tandrii@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true Review URL: https://codereview.chromium.org/1179483002 Cr-Commit-Position: refs/heads/master@{#28903}
-
machenbach authored
Revert of Revert of [test] Refactoring - Use subject/observer pattern for progress indicators. (patchset #1 id:1 of https://codereview.chromium.org/1163373005/) Reason for revert: All build problems had other causes. Original issue's description: > Revert of [test] Refactoring - Use subject/observer pattern for progress indicators. (patchset #3 id:40001 of https://codereview.chromium.org/1171943002/) > > Reason for revert: > might break stuff > > Original issue's description: > > [test] Refactoring - Use subject/observer pattern for progress indicators. > > > > This should prevent bugs caused by missing super calls in > > overridden methods. The assumption is that methods of > > different indicators are independent. > > > > Committed: https://crrev.com/fbe973ff1722a6158a5b2babce9c1a32d26a1d3b > > Cr-Commit-Position: refs/heads/master@{#28866} > > TBR=jkummerow@chromium.org,tandrii@chromium.org > NOPRESUBMIT=true > NOTREECHECKS=true > NOTRY=true > > Committed: https://crrev.com/2a3962d9d2a7415378811f4d56522531332d5a3e > Cr-Commit-Position: refs/heads/master@{#28869} TBR=jkummerow@chromium.org,tandrii@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true Review URL: https://codereview.chromium.org/1176863002 Cr-Commit-Position: refs/heads/master@{#28901}
-
machenbach authored
Revert of [test] Refactoring - Let runner handle test IDs. (patchset #1 id:1 of https://codereview.chromium.org/1168303007/) Reason for revert: [Sheriff] Revert until the tree is in a better state. Original issue's description: > [test] Refactoring - Let runner handle test IDs. > > This prepares for properly rerunning tests. Currently when > tests are rerun, the same test object is reused. This > will be changed in a follow up. > > Committed: https://crrev.com/f41a81b8a513fc360c500c066b74f223bc9c0223 > Cr-Commit-Position: refs/heads/master@{#28864} TBR=jkummerow@chromium.org,tandrii@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true Review URL: https://codereview.chromium.org/1167343003 Cr-Commit-Position: refs/heads/master@{#28891}
-
machenbach authored
Revert of Update Test262 to 5/30 (patchset #4 id:60001 of https://codereview.chromium.org/1136553008/) Reason for revert: [Sheriff] Still lots of breakages on some builders. E.g. http://build.chromium.org/p/client.v8/builders/V8%20Linux%20-%20nosnap/builds/3313 Original issue's description: > Update Test262 to 5/30 > > This updates the test runner to run all tests in both sloppy > and strict mode. > > It also marks the test in the status file as failing in > sloppy mode even if all it does is marking the test as > [PASS, FAIL]. A future CL will have to validate that the > tests pass and fail in the correct mode. > > Committed: https://crrev.com/d869f4a4801d4ef6868c266c07f9e29d2e29cba5 > Cr-Commit-Position: refs/heads/master@{#28879} TBR=rossberg@chromium.org,arv@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true Review URL: https://codereview.chromium.org/1173933002 Cr-Commit-Position: refs/heads/master@{#28890}
-
- 09 Jun, 2015 4 commits
-
-
arv authored
This updates the test runner to run all tests in both sloppy and strict mode. It also marks the test in the status file as failing in sloppy mode even if all it does is marking the test as [PASS, FAIL]. A future CL will have to validate that the tests pass and fail in the correct mode. Review URL: https://codereview.chromium.org/1136553008 Cr-Commit-Position: refs/heads/master@{#28879}
-
machenbach authored
Revert of [test] Refactoring - Use subject/observer pattern for progress indicators. (patchset #3 id:40001 of https://codereview.chromium.org/1171943002/) Reason for revert: might break stuff Original issue's description: > [test] Refactoring - Use subject/observer pattern for progress indicators. > > This should prevent bugs caused by missing super calls in > overridden methods. The assumption is that methods of > different indicators are independent. > > Committed: https://crrev.com/fbe973ff1722a6158a5b2babce9c1a32d26a1d3b > Cr-Commit-Position: refs/heads/master@{#28866} TBR=jkummerow@chromium.org,tandrii@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true Review URL: https://codereview.chromium.org/1163373005 Cr-Commit-Position: refs/heads/master@{#28869}
-
machenbach authored
This should prevent bugs caused by missing super calls in overridden methods. The assumption is that methods of different indicators are independent. Review URL: https://codereview.chromium.org/1171943002 Cr-Commit-Position: refs/heads/master@{#28866}
-
machenbach authored
This prepares for properly rerunning tests. Currently when tests are rerun, the same test object is reused. This will be changed in a follow up. Review URL: https://codereview.chromium.org/1168303007 Cr-Commit-Position: refs/heads/master@{#28864}
-