summaryrefslogtreecommitdiffstats
path: root/tools/code_coverage/coverage_posix.py
Commit message (Collapse)AuthorAgeFilesLines
* DevTools: rename debugger/ to devtools/, move DevTools files into ↵pfeldman@chromium.org2012-12-191-1/+1
| | | | | | | | content/renderer/devtools. Review URL: https://codereview.chromium.org/11630004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@173891 0039d316-1c4b-4281-b951-d872f2087c98
* Revert 172809kkania@chromium.org2012-12-171-93/+160
| | | | | | | | | | | | | | | | > Enable all browser tests except below tests and tests which are failing on local machine. > EncodingAliases*.* > NewStackCloudPolicyTest*.* > DeviceManagementServiceIntegrationTestInstance*.* > RestoreOnStartupPolicyTestInstance*.* > PolicyPrefsTestInstance*.* > > Review URL: https://chromiumcodereview.appspot.com/11557022 TBR=pshenoy@chromium.org Review URL: https://codereview.chromium.org/11616002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@173500 0039d316-1c4b-4281-b951-d872f2087c98
* Enable all browser tests except below tests and tests which are failing on ↵pshenoy@chromium.org2012-12-131-160/+93
| | | | | | | | | | | | | | local machine. EncodingAliases*.* NewStackCloudPolicyTest*.* DeviceManagementServiceIntegrationTestInstance*.* RestoreOnStartupPolicyTestInstance*.* PolicyPrefsTestInstance*.* Review URL: https://chromiumcodereview.appspot.com/11557022 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@172809 0039d316-1c4b-4281-b951-d872f2087c98
* Enable few more browser tests on coverage bot.pshenoy@chromium.org2012-12-061-1/+25
| | | | | | | | | | | | | | 1. src/chrome/browser/nacl_host 2. src/chrome/browser/debugger 3. src/chrome/browser/first_run 4. src/chrome/browser/importer 5. src/chrome/browser/page_cycler 6. src/chrome/browser/performance_monitor 7. src/chrome/browser/prerender Review URL: https://chromiumcodereview.appspot.com/11475004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@171577 0039d316-1c4b-4281-b951-d872f2087c98
* Enabled below browser_tests on coverage bot.pshenoy@chromium.org2012-12-041-4/+20
| | | | | | | | | | | | | 1. src/chrome/browser/nacl_host 2. src/chrome/browser/automation 3. src/chrome/browser/autofill 4. src/chrome/browser/autocomplete 5. src/chrome/browser/captive_portal 6. src/chrome/browser/geolocation Review URL: https://chromiumcodereview.appspot.com/11415289 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@171064 0039d316-1c4b-4281-b951-d872f2087c98
* Enable 'chrome/browser/net' and 'chrome/browser/extensions' related ↵pshenoy@chromium.org2012-12-041-8/+61
| | | | | | | | browser_tests on coverage bot. Review URL: https://chromiumcodereview.appspot.com/11415264 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@170987 0039d316-1c4b-4281-b951-d872f2087c98
* Enable only 'downloads' related tests in browser_tests on coverage bot.pshenoy@chromium.org2012-11-291-0/+27
| | | | | | Review URL: https://chromiumcodereview.appspot.com/11414214 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@170297 0039d316-1c4b-4281-b951-d872f2087c98
* Exclude tests prefixed with FLAKY, FAILS, DISABLED and MAYBE. pshenoy@chromium.org2012-11-151-21/+4
| | | | | | Review URL: https://chromiumcodereview.appspot.com/11411012 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@168024 0039d316-1c4b-4281-b951-d872f2087c98
* 1. Added option to run only browser_tests.pshenoy@chromium.org2012-11-151-51/+40
| | | | | | | | | 2. Since tests in browser_tests are failing randomly on coverage bot, enabling tests by feature. Currently running only downloads realted browser tests. 3. Store coverage nformation related to browser_tests in a separate folder. Review URL: https://chromiumcodereview.appspot.com/11312250 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@167860 0039d316-1c4b-4281-b951-d872f2087c98
* Execute "unit_tests" when running coverage_posix.py with --all_unittests ↵pshenoy@chromium.org2012-11-131-0/+1
| | | | | | | | parameter. Review URL: https://chromiumcodereview.appspot.com/11293230 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@167361 0039d316-1c4b-4281-b951-d872f2087c98
* We need to build browser_tests during 'compile' step, so enabling in gypi. ↵pshenoy@chromium.org2012-11-091-0/+5
| | | | | | | | Disabled from running in coverage_posix.py. Review URL: https://chromiumcodereview.appspot.com/11377077 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@166975 0039d316-1c4b-4281-b951-d872f2087c98
* Store coverage.info file in separate folders based on commandline parameters ↵pshenoy@chromium.org2012-11-061-0/+20
| | | | | | | | | | to coverage_posix.py. This CL is dependent on changes in http://codereview.chromium.org/11273046 Review URL: https://chromiumcodereview.appspot.com/11274053 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@166271 0039d316-1c4b-4281-b951-d872f2087c98
* Run all tests including FLAKY tests to get the overall coverage numbers.pshenoy@chromium.org2012-08-301-2/+2
| | | | | | Review URL: https://chromiumcodereview.appspot.com/10893040 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@154233 0039d316-1c4b-4281-b951-d872f2087c98
* Skipping few more tests from running on coverage bot.pshenoy@chromium.org2012-08-211-5/+72
| | | | | | Review URL: https://chromiumcodereview.appspot.com/10831376 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@152601 0039d316-1c4b-4281-b951-d872f2087c98
* Skipping few failing tests from gpu_tests, performance_ui_tests and ↵pshenoy@chromium.org2012-08-151-10/+79
| | | | | | | | sync_integration_tests on coverage bot. Review URL: https://chromiumcodereview.appspot.com/10837246 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@151636 0039d316-1c4b-4281-b951-d872f2087c98
* Skip running pyauto tests on coverage bots.pshenoy@chromium.org2012-08-091-3/+4
| | | | | | Review URL: https://chromiumcodereview.appspot.com/10855038 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@150931 0039d316-1c4b-4281-b951-d872f2087c98
* Disablng few more failing tests cases from browser_tests.pshenoy@chromium.org2012-06-191-2/+22
| | | | | | Review URL: https://chromiumcodereview.appspot.com/10579025 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@143058 0039d316-1c4b-4281-b951-d872f2087c98
* FullscreenControllerTests fail on coverage bots thereby aborting the test. ↵pshenoy@chromium.org2012-06-181-1/+4
| | | | | | | | Skipping these tests when running browser_tests. Review URL: https://chromiumcodereview.appspot.com/10568013 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@142755 0039d316-1c4b-4281-b951-d872f2087c98
* Run CODE_COVERAGE test suite for pyauto tests.pshenoy@chromium.org2012-06-151-2/+2
| | | | | | Review URL: https://chromiumcodereview.appspot.com/10534171 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@142330 0039d316-1c4b-4281-b951-d872f2087c98
* Added pyautolib (dependency to run pyauto tests) to coverage_build target.pshenoy@chromium.org2012-06-121-1/+4
| | | | | | Review URL: https://chromiumcodereview.appspot.com/10533095 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@141691 0039d316-1c4b-4281-b951-d872f2087c98
* Added pyauto tests in coverage_build target.pshenoy@chromium.org2012-06-081-22/+30
| | | | | | Review URL: https://chromiumcodereview.appspot.com/10546065 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@141319 0039d316-1c4b-4281-b951-d872f2087c98
* Changes to code coverage infrastructure to allow subset coverage analysis.rdsmith@chromium.org2011-12-021-15/+79
| | | | | | | | | | | | | | | This change adds controls to tools/code_coverage/coverage_posix.py to allow specification of test filters for a coverage run, modifies handling of filters to match what gtest expects (all positive filters, a '-', and all negative filters), disables FLAKY and FAILS tests from being included in code coverage, and adds a downloads system specific file for constructing html output (restricting output to just the source files of interest). Review URL: http://codereview.chromium.org/8598003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@112599 0039d316-1c4b-4281-b951-d872f2087c98
* Add support for Linux kernels >=3.0-rc1 in Python related build files by:tony@chromium.org2011-06-161-2/+2
| | | | | | | | | | | | | | | - replacing occurences of sys.platform == 'linux2' with sys.platform.startswith('linux') - congregating occurences of sys.platform in ('linux[X]', 'linuxY', ...) to sys.platform.startswith('linux') - adding the key 'linux3' to all relevant lookup dicts BUG=85845 TEST=Try building chromium on Linux >=3.0-r1 Review URL: http://codereview.chromium.org/7172016 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@89354 0039d316-1c4b-4281-b951-d872f2087c98
* scons: excise more scons references from the code baseevan@chromium.org2010-12-031-1/+1
| | | | | | | | | | I got to undo some hacks, too! TEST=compiles Review URL: http://codereview.chromium.org/5535003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@68119 0039d316-1c4b-4281-b951-d872f2087c98
* Print current path for debugging.jrg@chromium.org2010-09-271-2/+9
| | | | | | | | | | | Not clear why getcwd() doesn't end with 'build' when run on buildbot. http://buildbot.jail.google.com/buildbot/waterfall.fyi/builders/Linux%20Coverage%20(dbg)/builds/6081/steps/Run%20Coverage%20Bundles/logs/stdio Review URL: http://codereview.chromium.org/3506006 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@60687 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust linux start path.jrg@chromium.org2010-09-251-5/+3
| | | | | | | | Should fix the "zero percent coverage" problem. Review URL: http://codereview.chromium.org/3396024 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@60554 0039d316-1c4b-4281-b951-d872f2087c98
* Disable another choking/forking test.jrg@chromium.org2010-09-211-4/+10
| | | | | | | | | | http://buildbot.jail.google.com/buildbot/waterfall.fyi/builders/Mac%20Coverage%20(dbg)/builds/6765/steps/Run%20Coverage%20Bundles/logs/stdio Also fix paths for Mac (r54844 fixed it for windows but broke Mac) Review URL: http://codereview.chromium.org/3416017 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@60107 0039d316-1c4b-4281-b951-d872f2087c98
* Fix code coverage for Windows.mad@google.com2010-08-031-4/+4
| | | | | | | | | BUG=0 TEST=Look at the code coverage dashboards... :-) Review URL: http://codereview.chromium.org/3077019 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@54844 0039d316-1c4b-4281-b951-d872f2087c98
* Restore previous dribbling-subprocess-output code for non-Windows.jrg@chromium.org2010-07-161-0/+39
| | | | | | | | | | | | | | | | | | | | | | | | (Windows code adds buffering when used on POSIX adding uncomfortable delays in output). Windows code retained for use on Windows only. Add command line flag --dont-clear-coverage-data to facilitate tester use. Workflow: 1. compile for coverage 2. run chrome and do whatever 3. Run coverage script by hand; e.g. tools/code_coverage/coverage_posix.py --directory out/Debug --genhtml out/index.html --dont-clear-coverage-data The coverage_posix.py tool otherwise deletes all coverage data when it starts since it assumes it only wants coverage data generated by it's subprocesses. BUG=none TEST=coverage bots stay green; Anantha happier. Review URL: http://codereview.chromium.org/2870054 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@52713 0039d316-1c4b-4281-b951-d872f2087c98
* Solving an issue with subprocess.POpen on Windows.mad@google.com2010-07-091-18/+56
| | | | | | | | | | And also improving the coverage analysis speed by not generating useless xml, and also making that the timeout option is always of the right type and not cause exceptions later on. TEST=Run the coverage build. BUG=0 Review URL: http://codereview.chromium.org/2927001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@51954 0039d316-1c4b-4281-b951-d872f2087c98
* Correct mcov execution cwd so it works from either makefiles (targetjrg@chromium.org2010-06-051-8/+26
| | | | | | | | | | | | | | coverage_run) or from buildbot. Kind of a hack but good enough for now. Make mcov path args into abs paths. Die with non-zero error code if coverage.info file not generated for clearer failure in buildbot. Review URL: http://codereview.chromium.org/2639005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48992 0039d316-1c4b-4281-b951-d872f2087c98
* chrome_tests.gypi: give better deps to make sure coverage_bundles.py ↵jrg@chromium.org2010-05-261-1/+1
| | | | | | | | | | generated more appropriately. coverage_posix.py: Properly catch syntax errors on eval'd files. Review URL: http://codereview.chromium.org/2259001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48246 0039d316-1c4b-4281-b951-d872f2087c98
* Fix process kill and "wait for death" on Windows.jrg@chromium.org2010-05-251-7/+8
| | | | | | | | http://build.chromium.org/buildbot/waterfall.fyi/builders/Win%20Coverage%20(dbg)/builds/3420/steps/Run%20Coverage%20Bundles/logs/stdio Review URL: http://codereview.chromium.org/2166007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48108 0039d316-1c4b-4281-b951-d872f2087c98
* Exclusion list for problematic tests.jrg@chromium.org2010-05-241-0/+60
| | | | | | Review URL: http://codereview.chromium.org/2154002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48091 0039d316-1c4b-4281-b951-d872f2087c98
* coverage: Ignore test failures and continue running other tests.thestig@chromium.org2010-05-241-1/+1
| | | | | | | | BUG=none TEST=none Review URL: http://codereview.chromium.org/2083022 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48073 0039d316-1c4b-4281-b951-d872f2087c98
* Fix linux coverage directoryjrg@chromium.org2010-05-241-1/+1
| | | | | | Review URL: http://codereview.chromium.org/2174001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48060 0039d316-1c4b-4281-b951-d872f2087c98
* Handle buildbot directory naming issues.jrg@chromium.org2010-05-211-15/+124
| | | | | | | | | | Actually use our timeout code for running the unit tests (more reliable killing of children), and make the timeout smaller. Review URL: http://codereview.chromium.org/2084016 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@47930 0039d316-1c4b-4281-b951-d872f2087c98
* Split coverage into build and run phases in preparation for splittingjrg@chromium.org2010-05-181-1/+30
| | | | | | | | | | | | | | it into 2 distinct buildbot phases. Add changes to reduce size or increase speed of coverage builds. Add 'bundle files' mechanism to process_coverage.py to make the above split easier. Add unit test for said mechanism. TEST=build coverage on 10.6 and watch it work. Review URL: http://codereview.chromium.org/2121003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@47496 0039d316-1c4b-4281-b951-d872f2087c98
* Kill subprocesses (e.g. unit tests) which appear to be hanging. Use ajrg@chromium.org2010-05-061-7/+138
| | | | | | | | | | | | | | | | | | | mechanism similar to buildbot (e.g. give up if no output from a subprocess within a few minutes). When SIGTERMed (e.g. by buildbot), make an effort to SIGTERM any running subprocess. Should make the coverage bots more resiliant against getting "stuck" (e.g. the "clean" stage won't fail because a running process prevents a directory from being empty). Added some unit tests for the coverage script. BUG=None TEST=Run the coverage script. Review URL: http://codereview.chromium.org/1957004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@46538 0039d316-1c4b-4281-b951-d872f2087c98
* New failure:jrg@chromium.org2010-02-261-1/+2
| | | | | | | | | | http://build.chromium.org/buildbot/waterfall.fyi/builders/Win%20Coverage%20(dbg)/builds/1517/steps/compile/logs/stdio Looks like .o's added in which need to be ignored. Review URL: http://codereview.chromium.org/661210 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@40171 0039d316-1c4b-4281-b951-d872f2087c98
* coverage_posix.py: use proper root directory for Linux now thatjrg@chromium.org2009-12-311-4/+19
| | | | | | | | | | | compile paths are not absolute. genhtml: be more tolerant of "source file" names like "effective_tld_names_unittest2.gperf". Review URL: http://codereview.chromium.org/523031 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@35410 0039d316-1c4b-4281-b951-d872f2087c98
* Use Xvfb when running the tests.jrg@chromium.org2009-12-291-0/+63
| | | | | | | | | | | | | | Normal buildbot-run tests that need an X display connection (e.g. ui_tests) are executed by RunPythonCommandInBuildDir() from scripts/slave/slave_utils.py which takes care of this. However, we are currently running coverage_posix.py from within a build command which itself is not run a s a "python command in build dir". Thus, no Xvfb. TODO(jrg): transition coverage generation to a distinct buildbot step. Review URL: http://codereview.chromium.org/524007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@35357 0039d316-1c4b-4281-b951-d872f2087c98
* Do not make test failures fatal (since it is so common.)jrg@chromium.org2009-12-291-2/+3
| | | | | | Review URL: http://codereview.chromium.org/522021 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@35348 0039d316-1c4b-4281-b951-d872f2087c98
* Current status:jrg@chromium.org2009-12-171-3/+10
| | | | | | | | | | | http://build.chromium.org/buildbot/waterfall.fyi/builders/XP%20Coverage%20%28dbg%29/builds/234/steps/compile/logs/stdio Compiles look fine, and processing looks fine, but when running the test the binary isn't found? Add more logging info to get better data. Review URL: http://codereview.chromium.org/504037 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@34800 0039d316-1c4b-4281-b951-d872f2087c98
* Now that we append to this file instead of clobbering it each timejrg@chromium.org2009-12-071-9/+8
| | | | | | | | | (since tests are run one at a time) we need to delete it before we begin on Windows. Review URL: http://codereview.chromium.org/460129 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@34019 0039d316-1c4b-4281-b951-d872f2087c98
* Modify windows code coverage pattern to dump info once per test andjrg@chromium.org2009-12-051-22/+34
| | | | | | | | concatenate instead of trying to collect all at once to avoid OOM problems. Review URL: http://codereview.chromium.org/460095 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33916 0039d316-1c4b-4281-b951-d872f2087c98
* Turn off exclusions for windows coveragejrg@chromium.org2009-12-031-2/+4
| | | | | | Review URL: http://codereview.chromium.org/455040 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33655 0039d316-1c4b-4281-b951-d872f2087c98
* Add hard-coded win paths so bb happy.jrg@chromium.org2009-12-031-0/+4
| | | | | | Review URL: http://codereview.chromium.org/465020 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33651 0039d316-1c4b-4281-b951-d872f2087c98
* Fix coverage on the Mac.jrg@chromium.org2009-10-231-9/+32
| | | | | | | | Add extra unit test bundles (all platforms). Review URL: http://codereview.chromium.org/307032 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@29845 0039d316-1c4b-4281-b951-d872f2087c98
* Beginning of code coverage on Windows.jrg@chromium.org2009-07-071-23/+153
| | | | | | Review URL: http://codereview.chromium.org/155123 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@20045 0039d316-1c4b-4281-b951-d872f2087c98