summaryrefslogtreecommitdiffstats
path: root/tools/perf_expectations/perf_expectations.json
Commit message (Collapse)AuthorAgeFilesLines
* Widen vista dual intl1 and morejs variance further.chase@chromium.org2009-12-071-2/+2
| | | | | | | | | | | | These test results are not that unexpected, the test just needs to be reset and variance increased. BUG=none TEST=vista intl1 and morejs are green Review URL: http://codereview.chromium.org/467040 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@34001 0039d316-1c4b-4281-b951-d872f2087c98
* Update perf expectations for recent changes.chase@chromium.org2009-12-071-8/+8
| | | | | | | | | | | | | A DamageRects change sped up some dhtml performance tests. Other tests require a wider variance to avoid false alerts. BUG=none TEST=tests are green Review URL: http://codereview.chromium.org/460115 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33984 0039d316-1c4b-4281-b951-d872f2087c98
* Reset perf expectations after reference build update.chase@chromium.org2009-12-041-36/+36
| | | | | | | | | BUG=29440 TEST=perf tests are green Review URL: http://codereview.chromium.org/466037 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33845 0039d316-1c4b-4281-b951-d872f2087c98
* Add more perf expectations.chase@chromium.org2009-12-041-2/+22
| | | | | | | | | | | | | | | Adds dhtml/intl1/intl2 to all systems. Adds linux-release perf bot expectations. Also reset mac moz perf expectations and widen variance to avoid false positives. BUG=29318 TEST=perf tests are green Review URL: http://codereview.chromium.org/468014 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33759 0039d316-1c4b-4281-b951-d872f2087c98
* Fix mac perf moz expectation.chase@chromium.org2009-12-031-1/+1
| | | | | | | | | BUG=29318 TEST=mac moz perf test goes green Review URL: http://codereview.chromium.org/466020 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33707 0039d316-1c4b-4281-b951-d872f2087c98
* Add perf expectations for vista, other tests.chase@chromium.org2009-12-031-0/+16
| | | | | | | | | BUG=29318 TEST=perf tests are green Review URL: http://codereview.chromium.org/464019 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33699 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust for linux startup test speedup.chase@chromium.org2009-11-251-1/+1
| | | | | | | | | | | | r33010 enabled tcmalloc by default on Linux, which gives a startup speedup of ~30 ms. BUG=none TEST=linux startup test is green Review URL: http://codereview.chromium.org/432024 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@33106 0039d316-1c4b-4281-b951-d872f2087c98
* Bump linux startup perf expectation.chase@chromium.org2009-11-181-1/+1
| | | | | | | | | | | | | r32264 causes the linux startup test to appear to regress. Until the reference build is updated, mark the current behavior as expected. BUG=6844 TEST=linux startup perf test goes green Review URL: http://codereview.chromium.org/403016 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@32360 0039d316-1c4b-4281-b951-d872f2087c98
* Increase mac morejs variance.chase@chromium.org2009-11-171-1/+1
| | | | | | | | | | | | Recent false positives on mac morejs page cycler have shown up. Increase the variance to squelch them. BUG=none TEST=mac morejs perf alerts are quelled Review URL: http://codereview.chromium.org/385122 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@32141 0039d316-1c4b-4281-b951-d872f2087c98
* Reset Windows expectations after new ref build.chase@chromium.org2009-10-271-2/+2
| | | | | | | | | BUG=25200 TEST=perf bots stay green Review URL: http://codereview.chromium.org/334034 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@30151 0039d316-1c4b-4281-b951-d872f2087c98
* Repin XP perf morejs +15ms.chase@chromium.org2009-10-151-1/+1
| | | | | | | | | | | | | r28006 reverted to an earlier version of tcmalloc, and consequently we got slower by 15ms on the morejs page cycler. BUG=none TEST=none Review URL: http://codereview.chromium.org/280001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@29091 0039d316-1c4b-4281-b951-d872f2087c98
* Perf expectations update.chase@chromium.org2009-10-091-2/+2
| | | | | | | | | | | | | Relax "Linux perf morejs" variance. (Test variance too high to give us useful "improved" results.) Repin and relax "XP perf warm startup". BUG=none TEST=none Review URL: http://codereview.chromium.org/266041 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@28561 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust XP morejs expectations after r27708.chase@chromium.org2009-10-011-1/+1
| | | | | | | | | | | | | | | Changing the default allocator from TCMalloc to JEMalloc introduced a page load perf regression. The change is experimental on the trunk. While in place, adjust expectations to avoid firing the perf regression framework. BUG=23565 TEST=XP perf morejs goes green Review URL: http://codereview.chromium.org/255043 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@27757 0039d316-1c4b-4281-b951-d872f2087c98
* Expectations for 3 perf systems on morejs and startup.chase@chromium.org2009-09-241-3/+7
| | | | | | | | | | | | | Set the perf expectations on linux, mac, and windows perf systems for the morejs and warm startup tests. Update comment in the perf_expectations unit test regex. BUG=18597 TEST=build.chromium.org perf slaves stay green Review URL: http://codereview.chromium.org/231017 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@27068 0039d316-1c4b-4281-b951-d872f2087c98
* Revert r26376 "Expectations for 3 perf systems"chase@chromium.org2009-09-161-7/+3
| | | | | | | | BUG=18597 TBR=nsylvain Review URL: http://codereview.chromium.org/201138 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@26380 0039d316-1c4b-4281-b951-d872f2087c98
* Expectations for 3 perf systems on morejs and startup.chase@chromium.org2009-09-161-3/+7
| | | | | | | | | | | | | | | Set the perf expectations on linux, mac, and windows perf systems for the morejs and warm startup tests. The variance assumptions might require fine-tuning on the master to get right. We might be flaky to begin with, or may want to turn off the variance reporting altogether. BUG=18597 TEST=build.chromium.org perf slaves stay green Review URL: http://codereview.chromium.org/193083 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@26376 0039d316-1c4b-4281-b951-d872f2087c98
* Add more unit tests for perf expectations.chase@chromium.org2009-09-081-3/+3
| | | | | | | | | | | | | | - verify main object is a dictionary - verify load key is present and points to a bool - verify all key values are dictionaries - verify all key values have (correct) delta/var keys - verify all keys are in correct format (a/b/c/d) BUG=18597 TEST=verify unit tests catches these errors Review URL: http://codereview.chromium.org/194032 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@25656 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust variance for linux perf test expectations.chase@chromium.org2009-09-021-2/+2
| | | | | | | | | | | This patch should cause the linux perf morejs and startup tests to go green. BUG=18597 TEST=linux perf morejs and startup perf tests go green Review URL: http://codereview.chromium.org/189008 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@25260 0039d316-1c4b-4281-b951-d872f2087c98
* Add linux perf expectations for morejs and startup.chase@chromium.org2009-09-021-1/+4
| | | | | | | | | | | | Initial numbers have high variance on purpose, this should show on the buildbot page as an orange result for those tests. BUG=18597 TEST=linux perf morejs and startup go orange Review URL: http://codereview.chromium.org/190017 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@25255 0039d316-1c4b-4281-b951-d872f2087c98
* Change perf expect. object from array to hash.chase@chromium.org2009-08-311-1/+1
| | | | | | | | | | | | | Simplifies code in Buildbot, making sure the stopgap has the correct format. BUG=18597 TBR=nsylvain TEST=none Review URL: http://codereview.chromium.org/176039 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@24917 0039d316-1c4b-4281-b951-d872f2087c98
* Add perf_expectations/ and empty expectations JSON.chase@chromium.org2009-08-281-0/+1
Adding the directory and empty file now so I can continue making perf-related changes to the buildbot infrastructure. The expectations file will get filled in with some initial values after the infrastructure changes have been made. BUG=18579 TEST=none Review URL: http://codereview.chromium.org/178024 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@24817 0039d316-1c4b-4281-b951-d872f2087c98