summaryrefslogtreecommitdiffstats
path: root/base/test/test_switches.h
Commit message (Collapse)AuthorAgeFilesLines
* Add test launcher switch to avoid early termination due to broken tests.carlosk2015-08-261-0/+1
| | | | | | | | | | | | | | | Due to big changes to Chromium done in the context of the PlzNavigate project, many tests are broken when we enable it. But getting a precise number of broken tests is difficult because the test launcher will early terminate due to too many broken tests. Hence my adding this option, disabled by default, of forcing the test launcher to finish running even if many tests fail. BUG=504347 Review URL: https://codereview.chromium.org/1307563002 Cr-Commit-Position: refs/heads/master@{#345605}
* iOS gtest launcher: get list of tests from executable running in simulatorPaweł Hajdan2015-01-151-0/+1
| | | | | | | | | BUG=426870 R=lliabraa@google.com, sky@chromium.org Review URL: https://codereview.chromium.org/838603004 Cr-Commit-Position: refs/heads/master@{#311652}
* Implement listing tests to a JSON file for iOS gtest test launcherPaweł Hajdan, Jr2014-11-241-0/+1
| | | | | | | | | | | | | | | | This is needed because the launcher is compiled with host toolchain and access to full Mac OS X system that we need for the launcher, whereas the gtest test code is compiled for sandboxed execution on iOS. The launcher needs to know which tests to run, so it needs to query test binary for that. BUG=426870 R=sky@chromium.org Review URL: https://codereview.chromium.org/747003002 Cr-Commit-Position: refs/heads/master@{#305426}
* Revert of Implement unit test specific test launcher timeout (patchset #6 of ↵phajdan.jr2014-08-251-1/+0
| | | | | | | | | | | | | | | | | | | | | https://codereview.chromium.org/476543004/) Reason for revert: Multiple tests are timing out on dbg bots. Original issue's description: > Implement unit test specific test launcher timeout > > BUG=402213 TBR=jam@chromium.org,dalecurtis@chromium.org,rileya@chromium.org NOTREECHECKS=true NOTRY=true BUG=402213 Review URL: https://codereview.chromium.org/504813003 Cr-Commit-Position: refs/heads/master@{#291682}
* Implement unit test specific test launcher timeoutPaweł Hajdan, Jr2014-08-251-0/+1
| | | | | | | | | BUG=402213 R=dalecurtis@chromium.org, jam@chromium.org Review URL: https://codereview.chromium.org/476543004 Cr-Commit-Position: refs/heads/master@{#291673}
* Remove large test timeout. It's large and only used at one place.phajdan.jr@chromium.org2014-08-201-1/+0
| | | | | | | | | | | | | | | It seems the last place where it was used is no longer needed. The special case was added in 2012 (https://chromiumcodereview.appspot.com/10890031) and if somehow we still need it now, I'd rather adjust action_max_timeout for android (in C++ sources) rather than have another kind of timeout. BUG=none R=ajwong@chromium.org, yfriedman@chromium.org Review URL: https://codereview.chromium.org/485173002 Cr-Commit-Position: refs/heads/master@{#290808} git-svn-id: svn://svn.chromium.org/chrome/trunk/src@290808 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: add an option to pass test filter using a filephajdan.jr@chromium.org2013-12-191-0/+1
| | | | | | | | | | | | | | | This is useful when --gtest_filter on the command line would exceed command line length limits. This will be used with chromium_trybot recipe to pass a list of tests to retry after deapplying the patch. BUG=236893, 44497 R=sky@chromium.org Review URL: https://codereview.chromium.org/117113003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@241833 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Make new test launcher automatically use single process mode when ↵phajdan.jr@chromium.org2013-12-111-0/+1
| | | | | | | | | | | | | | | | debugged. This also applies on Valgrind. Use --test-launcher-debug-launcher to override auto-detection and debug the launcher itself. BUG=236893 R=sky@chromium.org Review URL: https://codereview.chromium.org/101223009 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@240186 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Flip test launcher defaults (developer mode is now default)phajdan.jr@chromium.org2013-11-271-1/+1
| | | | | | | | | | | | | chromium-dev discussions: https://groups.google.com/a/chromium.org/d/msg/chromium-dev/ewfTWVUiYGw/uTlP2mOZlmAJ https://groups.google.com/a/chromium.org/d/msg/chromium-dev/Mw1hrGwnUpw/pYVzC3o_SDQJ BUG=236893 R=maruel@chromium.org, sky@chromium.org Review URL: https://codereview.chromium.org/59623015 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@237448 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Make the test launcher's retry limit configurable.phajdan.jr@chromium.org2013-11-141-0/+1
| | | | | | | | | BUG=236893 R=sky@chromium.org Review URL: https://codereview.chromium.org/70973003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@234998 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Add test launcher developer mode for local debugging.phajdan.jr@chromium.org2013-11-071-0/+1
| | | | | | | | | BUG=236893, 312984 R=sky@chromium.org Review URL: https://codereview.chromium.org/61363002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@233667 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Make it possible to pass sharding settings from command line.phajdan.jr@chromium.org2013-11-051-0/+2
| | | | | | | | | | | | | | | This overrides any environment variables (a message is printed that clearly says which settings are applied). Main rationale is that runtest.py is well suited to pass command line flags but not environment variables. BUG=236893 R=sky@chromium.org Review URL: https://codereview.chromium.org/58413003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@232869 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Add a flag controlling handling of test stdio by the new launcher.phajdan.jr@chromium.org2013-10-291-0/+1
| | | | | | | | | | | | Pass --test-launcher-test-stdio=always to always include test stdio in test launcher's standard output. BUG=236893 R=hubbe@chromium.org Review URL: https://codereview.chromium.org/46043019 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@231665 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: report results of all test iterations, to stdout and optionally JSON file.phajdan.jr@chromium.org2013-10-141-0/+1
| | | | | | | | | BUG=236893 R=sky@chromium.org Review URL: https://codereview.chromium.org/27017006 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@228488 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: add independent test timeout for the test launcherphajdan.jr@chromium.org2013-09-241-0/+1
| | | | | | | | | | | | | | | | Otherwise when increasing action timeout some tests actually start taking longer (they probably sleep). Also change test status to timeout for tests in a batch that completed but took longer than the timeout so that the outcome is not dependent on test order and similar factors. BUG=236893 R=sky@chromium.org Review URL: https://codereview.chromium.org/24255017 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@225013 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Add command-line switches for number of jobs and batch limit.phajdan.jr@chromium.org2013-09-051-0/+2
| | | | | | | | | BUG=236893 R=sky@chromium.org Review URL: https://codereview.chromium.org/23760003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@221315 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: make the new test launcher handle test crashesphajdan.jr@chromium.org2013-08-231-0/+1
| | | | | | | | | | | | Test launcher now recognizes when a test crashes and schedules tests that have not been run because of the crash to run again. BUG=236893 R=sky@chromium.org Review URL: https://codereview.chromium.org/22893056 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@219335 0039d316-1c4b-4281-b951-d872f2087c98
* Revert 144488 - For unit tests, track additions to AtExitManager and warn.scottbyer@chromium.org2012-07-251-2/+0
| | | | | | | | | | | | | | | | | | | While trying to bullet proof a unit test, I had trouble getting very far when running all tests in shuffle mode. Tracked that back to a few other tests doing stuff that accessed Singleton()s outside of a test-scoped ShadowingAtExitManager. Seemed to me that should be an invariant around any unit test, so created this towards that end, hopefully helping stabilize out unit_tests a bit more. BUG=133403 Review URL: https://chromiumcodereview.appspot.com/10582012 TBR=scottbyer@chromium.org Review URL: https://chromiumcodereview.appspot.com/10834010 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@148405 0039d316-1c4b-4281-b951-d872f2087c98
* For unit tests, track additions to AtExitManager and warn.scottbyer@chromium.org2012-06-271-0/+2
| | | | | | | | | | | | | | | | While trying to bullet proof a unit test, I had trouble getting very far when running all tests in shuffle mode. Tracked that back to a few other tests doing stuff that accessed Singleton()s outside of a test-scoped ShadowingAtExitManager. Seemed to me that should be an invariant around any unit test, so created this towards that end, hopefully helping stabilize out unit_tests a bit more. BUG=133403 Review URL: https://chromiumcodereview.appspot.com/10582012 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@144488 0039d316-1c4b-4281-b951-d872f2087c98
* Cleanup: Remove unused switches in base.thestig@chromium.org2012-02-081-2/+1
| | | | | | | | BUG=none TEST=none Review URL: https://chromiumcodereview.appspot.com/9307103 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@120948 0039d316-1c4b-4281-b951-d872f2087c98
* Remove unused test command-line switches.phajdan.jr@chromium.org2011-08-251-3/+0
| | | | | | | | BUG=none Review URL: http://codereview.chromium.org/7743006 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@98263 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Move --test-terminate-timeout logic to base/test/test_timeoutsphajdan.jr@chromium.org2011-06-101-0/+1
| | | | | | | | | | | | | | | | | This is the first step towards removing --test-terminate-timeout completely. In this CL --test-terminate-timeout becomes a synonym for --ui-test-action-max-timeout. This makes it possible to switch callers to --ui-test-action-max-timeout and remove --test-terminate-timeout. Removing number of different kinds of timeouts makes it easier to pick one. BUG=none Review URL: http://codereview.chromium.org/7111035 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@88653 0039d316-1c4b-4281-b951-d872f2087c98
* Revert 88111 - GTTF: Move --test-terminate-timeout logic to ↵rsimha@chromium.org2011-06-081-1/+0
| | | | | | | | | | | | | | | | | | | | | | | base/test/test_timeouts Reason for revert: This patch causes --test-terminate-timeout to be disregarded by out_of_proc_test_runner.cc, resulting in redness on the sync buildbots. This is the first step towards removing --test-terminate-timeout completely. In this CL --test-terminate-timeout becomes a synonym for --ui-test-action-max-timeout. This makes it possible to switch callers to --ui-test-action-max-timeout and remove --test-terminate-timeout. Removing number of different kinds of timeouts makes it easier to pick one. BUG=none Review URL: http://codereview.chromium.org/7111035 TBR=phajdan.jr@chromium.org Review URL: http://codereview.chromium.org/7104059 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@88352 0039d316-1c4b-4281-b951-d872f2087c98
* GTTF: Move --test-terminate-timeout logic to base/test/test_timeoutsphajdan.jr@chromium.org2011-06-071-0/+1
| | | | | | | | | | | | | | | | This is the first step towards removing --test-terminate-timeout completely. In this CL --test-terminate-timeout becomes a synonym for --ui-test-action-max-timeout. This makes it possible to switch callers to --ui-test-action-max-timeout and remove --test-terminate-timeout. Removing number of different kinds of timeouts makes it easier to pick one. BUG=none Review URL: http://codereview.chromium.org/7111035 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@88111 0039d316-1c4b-4281-b951-d872f2087c98
* Removing command_execution_timeout_ms in favor of action_max_timeout_ms.hnguyen@chromium.org2011-04-111-2/+1
| | | | | | | R=jcivelli@chromium.org,sky@chromium.org,phajdan.jr@chromium.org,nirnimesh@chromium.org Review URL: http://codereview.chromium.org/6685099 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@81164 0039d316-1c4b-4281-b951-d872f2087c98
* Separate BufferedDataSource and BufferedResourceLoader into two files.annacc@chromium.org2010-12-161-0/+1
| | | | | | | | | | | | | | | It's time to finally separate the huge monster files buffered_data_source.[h/cc] into two. ericroman: There are some variables and short methods that both BufferedDataSource and BufferedResourceLoader rely on and that I have moved to src/net/http/http_util.h. Could you please verify that this is an ok place to put them? Also, appcache issues have been resolved (and approved by michaeln) so I've removed those comments. BUG=None. TEST=Compiles. Review URL: http://codereview.chromium.org/5756004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@69429 0039d316-1c4b-4281-b951-d872f2087c98
* Move TestTimeouts from chrome/test to base/test.sergeyu@chromium.org2010-10-051-0/+22
BUG=None TEST=unittests Review URL: http://codereview.chromium.org/3544008 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@61540 0039d316-1c4b-4281-b951-d872f2087c98