summaryrefslogtreecommitdiffstats
path: root/build/android/test_runner.py
Commit message (Collapse)AuthorAgeFilesLines
* [Android] Add --gtest-also-run-disabled-tests option.frankf@chromium.org2013-09-171-57/+56
| | | | | | | | | BUG=285037 R=craigdh@chromium.org Review URL: https://codereview.chromium.org/23619062 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@223710 0039d316-1c4b-4281-b951-d872f2087c98
* [Android] Add --no-timeout to perf sharder.frankf@chromium.org2013-09-061-16/+21
| | | | | | | | | | | This delegates timeout logic to the step command. BUG= R=bulach@chromium.org, craigdh@chromium.org Review URL: https://codereview.chromium.org/23784006 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@221721 0039d316-1c4b-4281-b951-d872f2087c98
* [Android] Adds python option for EMMA coveragegkanwar@chromium.org2013-08-201-40/+8
| | | | | | | | | | | | This is a piece of the overall java coverage change. See: https://codereview.chromium.org/20210002/ NOTRY=True BUG=255644 Review URL: https://chromiumcodereview.appspot.com/23293006 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@218531 0039d316-1c4b-4281-b951-d872f2087c98
* [Android] Move getting the list of devices out of test_dispatcher.frankf@chromium.org2013-08-201-28/+48
| | | | | | | | | BUG=272486 NOTRY=True Review URL: https://chromiumcodereview.appspot.com/23205011 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@218483 0039d316-1c4b-4281-b951-d872f2087c98
* Fixes test runner command linegkanwar@chromium.org2013-08-161-0/+2
| | | | | | | | | | | test_runner.py --help would give 'Invalid command.' previously. NOTRY=True BUG= Review URL: https://chromiumcodereview.appspot.com/23294002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@218057 0039d316-1c4b-4281-b951-d872f2087c98
* Removes python_test_root flag name entirelygkanwar@chromium.org2013-08-161-2/+1
| | | | | | | | | NOTRY=True BUG=271802 Review URL: https://chromiumcodereview.appspot.com/23180007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@218050 0039d316-1c4b-4281-b951-d872f2087c98
* Android: removes buildtype following crrev.com/217855bulach@chromium.org2013-08-161-2/+1
| | | | | | | | | | | Fixes perf runners. BUG=260494 TBR=craigdh@chromium.org Review URL: https://chromiumcodereview.appspot.com/23285002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@218013 0039d316-1c4b-4281-b951-d872f2087c98
* [android] Make build_type a singleton.craigdh@chromium.org2013-08-151-13/+2
| | | | | | | | | | BUG=260494 TEST=None NOTRY=True Review URL: https://chromiumcodereview.appspot.com/22933005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@217855 0039d316-1c4b-4281-b951-d872f2087c98
* Android perf tests: always return 0 on the sharding stage.bulach@chromium.org2013-08-151-3/+4
| | | | | | | | | | | | | The first stage ("sharded steps") should never fail. Individual steps' exit code will be returned on the second stage, print-step. BUG=268450 TBR=frankf@chromium.org NOTRY=True Review URL: https://chromiumcodereview.appspot.com/23082003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@217794 0039d316-1c4b-4281-b951-d872f2087c98
* [Android] Changes python_test_root to host-driven-rootgkanwar@chromium.org2013-08-141-3/+4
| | | | | | | | | NOTRY=True BUG=271802 Review URL: https://chromiumcodereview.appspot.com/22982007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@217587 0039d316-1c4b-4281-b951-d872f2087c98
* Android: first step into making "perf tests" reuse the functional test infra.bulach@chromium.org2013-08-141-0/+63
| | | | | | | | | | | | | | Perf tests are currently using build/android/bb_run_sharded_steps.py, which lacks a lot of functionality to retry on different devices on failure, plus it adds an entirely separate hierarchy for running tests. This patch is the first step to deprecate it and reuse the same mechanism as all other functional tests. BUG=270165,268450 Review URL: https://chromiumcodereview.appspot.com/22854004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@217550 0039d316-1c4b-4281-b951-d872f2087c98
* Fixes monkey test timeoutgkanwar@chromium.org2013-08-121-1/+1
| | | | | | | | | | | Monkey test has its own timeout which varies by the number of events, so pass None for the test_dispatcher timeout. NOTRY=True BUG= Review URL: https://chromiumcodereview.appspot.com/22939002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@217072 0039d316-1c4b-4281-b951-d872f2087c98
* Fixes exit code on invalid command to test_runner.pygkanwar@chromium.org2013-08-091-2/+1
| | | | | | | | | NOTRY=True BUG= Review URL: https://chromiumcodereview.appspot.com/22495005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@216523 0039d316-1c4b-4281-b951-d872f2087c98
* [Andriod] Fixes monkey command linegkanwar@chromium.org2013-08-091-3/+9
| | | | | | | | | | | | Adds example, usage, and changes default activity name to use the ContentShell activity. NOTRY=True BUG= Review URL: https://chromiumcodereview.appspot.com/22456003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@216501 0039d316-1c4b-4281-b951-d872f2087c98
* Converts monkey test to its own test typegkanwar@chromium.org2013-08-081-4/+83
| | | | | | | | | NOTRY=True BUG=223650, 263479 Review URL: https://chromiumcodereview.appspot.com/22617003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@216343 0039d316-1c4b-4281-b951-d872f2087c98
* Removes unused and deprecated flags in test_runner.pygkanwar@chromium.org2013-08-081-16/+0
| | | | | | | | | | | | | | Flags: * --profiler * --install_apk (-I) * --disable_assertions NOTRY=True BUG= Review URL: https://chromiumcodereview.appspot.com/22622004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@216338 0039d316-1c4b-4281-b951-d872f2087c98
* Fixes exit code when there are no host-driven testsgkanwar@chromium.org2013-08-061-13/+14
| | | | | | | | | | | Undoes the temporary fix in 215986. NOTRY=True BUG= Review URL: https://chromiumcodereview.appspot.com/22445005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@216027 0039d316-1c4b-4281-b951-d872f2087c98
* Converts host driven tests to common test_dispatchergkanwar@chromium.org2013-08-061-46/+41
| | | | | | | | | | | | | | | Also renames several files in pylib/host_driven to match the general file naming scheme. This change will break existing host-driven tests downstream which are run though scripts other than test_runner. NOTRY=True BUG=176323 Review URL: https://chromiumcodereview.appspot.com/19537004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@215944 0039d316-1c4b-4281-b951-d872f2087c98
* Changes argument passing to use options objectsgkanwar@chromium.org2013-08-011-30/+75
| | | | | | | | | | | | | | Options objects are specific to the test type, and are named tuples, so they are also immutable. This is a precursor to the host-driven refactor. BUG=176323 NOTRY=True Review URL: https://chromiumcodereview.appspot.com/21008004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@215054 0039d316-1c4b-4281-b951-d872f2087c98
* [Android] Dedup content_browsertests test setup from gtests.frankf@chromium.org2013-07-301-71/+13
| | | | | | | | | | | | | | | - This also changes the command for running content_browsertests to be in line with other gtest targets - Additional cleanup: get rid of --exe option and fall back to using exe if apk is not found TEST=test_runner.py gtest -s content_browsertests BUG=261950 R=bulach@chromium.org, craigdh@chromium.org Review URL: https://codereview.chromium.org/20649002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@214421 0039d316-1c4b-4281-b951-d872f2087c98
* [android] Instumentation tests determine whether to install the test apk ↵craigdh@chromium.org2013-07-261-6/+6
| | | | | | | | | | | | | | based on Md5Sum. This deprecates the -I switch to instrumention tests. BUG=260084 TEST=None NOTRY=True Review URL: https://chromiumcodereview.appspot.com/19799003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@213956 0039d316-1c4b-4281-b951-d872f2087c98
* [Android] webkit_unit_tests should use isolate file.frankf@chromium.org2013-07-231-12/+2
| | | | | | | | | | | | Also, remove --webkit/--out-directory options which were used to run tests from a webkit checkout BUG=263019, 263021 NOTRY=True Review URL: https://chromiumcodereview.appspot.com/19971005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@213205 0039d316-1c4b-4281-b951-d872f2087c98
* [Android] Redesigns the sharder to allow replicated vs distributed testsgkanwar@google.com2013-07-191-88/+206
| | | | | | | | | | | In addition, cleans up dispatch. BUG=259063, 259128 NOTRY=True Review URL: https://chromiumcodereview.appspot.com/18770008 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@212663 0039d316-1c4b-4281-b951-d872f2087c98
* [Android] Clean up gtest filtering logic.frankf@chromium.org2013-07-181-1/+1
| | | | | | | | | | | Apply gtest_filter option to tests obtained from the device. BUG=246871 NOTRY=True Review URL: https://chromiumcodereview.appspot.com/19479002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@212229 0039d316-1c4b-4281-b951-d872f2087c98
* Adds errors on extra positional argsgkanwar@google.com2013-07-121-0/+9
| | | | | | | | BUG=259651 Review URL: https://chromiumcodereview.appspot.com/18617003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@211478 0039d316-1c4b-4281-b951-d872f2087c98
* Updates the test runner script exit codesgkanwar@google.com2013-07-101-33/+27
| | | | | | | | | | | | | | | | | | The script now returns exit codes based on what occurred in the test. Exit codes: 0 -- normal 1 -- fail/crash 88 -- warning In addition, the scripts now handle DeviceUnresponsiveError by returning a warning exit code overall, rather than silently moving on. BUG=170477, 258171 Review URL: https://chromiumcodereview.appspot.com/18323020 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@210749 0039d316-1c4b-4281-b951-d872f2087c98
* Relands test_runner.py, updates buildbot scriptsgkanwar@google.com2013-07-091-0/+532
| | | | | | | | | | | | Relands 210035 ("Creates a new test running script test_runner.py"), and updates the buildbot scripts to point to the test_runner.py script, so the buildbots don't get deprecated warnings. BUG=248351 Review URL: https://chromiumcodereview.appspot.com/18514008 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@210538 0039d316-1c4b-4281-b951-d872f2087c98
* Revert 210035 "Creates a new test running script test_runner.py"ilevy@chromium.org2013-07-051-531/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Causes android buildbots to spew deprecation warnings. > Creates a new test running script test_runner.py > > This new script serves as a unified entry point for all tests. The > existing scripts are now just wrappers around the new script. Old > commands should thus still work, but you can now make use of the > new script to run various types of tests. > > There are a few TODOs left: > * Add options to run Monkey tests. > > Miscellaneous notes: > * --python_test_root is now a required flag when Python host-driven > tests are being run. > > BUG=248351 > > Review URL: https://chromiumcodereview.appspot.com/15942016 TBR=gkanwar@google.com Review URL: https://codereview.chromium.org/18732002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@210251 0039d316-1c4b-4281-b951-d872f2087c98
* Creates a new test running script test_runner.pygkanwar@google.com2013-07-031-0/+531
This new script serves as a unified entry point for all tests. The existing scripts are now just wrappers around the new script. Old commands should thus still work, but you can now make use of the new script to run various types of tests. There are a few TODOs left: * Add options to run Monkey tests. Miscellaneous notes: * --python_test_root is now a required flag when Python host-driven tests are being run. BUG=248351 Review URL: https://chromiumcodereview.appspot.com/15942016 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@210035 0039d316-1c4b-4281-b951-d872f2087c98