summaryrefslogtreecommitdiffstats
path: root/tools/perf_expectations
Commit message (Collapse)AuthorAgeFilesLines
* Adjust expectations.cmp@chromium.org2011-04-241-11/+11
| | | | | | | | | | | | | | | | | | | | | | - linux-release-hardy/intl1/times/t (regression ~82765) - mac-release-10.5/intl2/vm_rss_final_b/vm_rss_f_b (regression around ~82169) - mac-release-10.5/intl2/vm_rss_final_t/vm_rss_f_t (regression around ~82169) - mac-release-10.5/intl2/vm_size_final_b/vm_size_f_b (regression around ~82169) - mac-release-10.5/intl2/vm_size_final_t/vm_size_f_t (regression around ~82169) - xp-release-dual-core/moz/total_op_r/IO_op_r (improvement ~r82301) - xp-release-single-core/intl1/times/t (fix false positives) - xp-release/sizes/chrome.dll/chrome.dll (update) - xp-release/sizes/chrome.exe/chrome.exe (update) - xp-release/sizes/mini_installer.exe/mini_installer.exe (capture improvement) - xp-release/sizes/setup.exe/setup.exe (update) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6899057 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@82811 0039d316-1c4b-4281-b951-d872f2087c98
* Add checksumming to perf_expectations.cmp@chromium.org2011-04-242-140/+169
| | | | | | | | | | | | Add --verbose flag, default most output off. BUG=49122 TEST=run over all perf_expectations, rerun and verify nothing is tested Review URL: http://codereview.chromium.org/6896047 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@82810 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-04-181-4/+4
| | | | | | | | | | | | | | - linux-release-hardy/intl1/times/t (improvement between 81365:81390) - linux-release-hardy/morejs/times/t (fixing false positives) - xp-release-dual-core/moz/total_op_b/IO_op_b (regression from ~r81801) - xp-release-dual-core/moz/total_op_r/IO_op_r (regression from ~r81801) TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6883030 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@82032 0039d316-1c4b-4281-b951-d872f2087c98
* Add linux-release-lowmem expectations.cmp@chromium.org2011-04-161-0/+17
| | | | | | | | | | BUG=35879 TEST=linux perf lowmem steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6874034 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@81887 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-04-131-3/+3
| | | | | | | | | | | | - mac-release-10.5/intl1/times/t (improved at r80750, webkit roll) - xp-release-dual-core/intl1/times/t (improved at r81180, webkit roll) - xp-release-single-core/intl1/times/t (improved at r81180, webkit roll) TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6834007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@81336 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-04-121-10/+10
| | | | | | | | | | | | | | | | | | | - linux-release-hardy/dhtml/times/t (improved at r80750, webkit roll) - linux-release-hardy/dhtml/total_op_r/IO_op_r (regressed ~80848) - linux-release-hardy/moz/times/t (improved at r80091?, webkit roll) - mac-release-10.5/intl2/commit_charge/cc (improved at r79662, webkit roll) - mac-release-10.5/intl2/times/t (improved at r80750, webkit roll) - mac-release-10.6/dhtml/times/t (improved at r80750, webkit roll) - mac-release-10.6/intl1/times/t (improvement from r79662, webkit roll) - xp-release-dual-core/moz/total_op_r/IO_op_r (regressed ~80848) - xp-release-dual-core/moz/vm_peak_r/vm_pk_r (improved at r79665, webkit roll) - xp-release-single-core/morejs/times/t (improved r81023?) TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6823072 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@81217 0039d316-1c4b-4281-b951-d872f2087c98
* Add xp-release sizes expectations.cmp@chromium.org2011-03-291-0/+4
| | | | | | | | | | BUG=none TEST=sizes steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6758010 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@79649 0039d316-1c4b-4281-b951-d872f2087c98
* Fix make_expectations.py for "new" expectations.cmp@chromium.org2011-03-281-2/+4
| | | | | | | | | | | BUG=none TEST=make_expectations.py works for previously unknown expectations (those without regress/improve values) TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6765004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@79634 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-03-271-2/+2
| | | | | | | | | | | | | - linux-release-hardy/dhtml/times/t (from v8 roll at r79379) - xp-release-single-core/dhtml/times/t (get rid of false positives) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6706003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@79503 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations. (redo of r79500)cmp@chromium.org2011-03-261-4/+4
| | | | | | | | | | | | | | | - linux-release-hardy/morejs/times/t (from r79379, v8 update) - xp-release-dual-core/moz/vm_peak_b/vm_pk_b (from r79224) - xp-release-dual-core/moz/vm_peak_r/vm_pk_r (from r79224 and r79379) - xp-release-single-core/morejs/times/t (from r79379, v8 update) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6752001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@79501 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-03-261-4/+4
| | | | | | | | | | | | | | | - linux-release-hardy/morejs/times/t (from r79379, v8 update) - xp-release-dual-core/moz/vm_peak_b/vm_pk_b (from r79224) - xp-release-dual-core/moz/vm_peak_r/vm_pk_r (from r79224 and r79379) - xp-release-single-core/morejs/times/t (from r79379, v8 update) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6706002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@79500 0039d316-1c4b-4281-b951-d872f2087c98
* Support absolute perf expectations.cmp@chromium.org2011-03-251-10/+32
| | | | | | | | | BUG=none TEST=stores absolute perf values if type is set correctly Review URL: http://codereview.chromium.org/6713114 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@79459 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-03-231-2/+2
| | | | | | | | | | | | | - linux-release-hardy/dhtml/vm_rss_final_b/vm_rss_f_b (from r78369) - linux-release-hardy/dhtml/vm_rss_final_t/vm_rss_f_t (from r78369) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6732004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@79183 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-03-231-11/+11
| | | | | | | | | | | | | | | | | | | | | | - linux-release-hardy/intl1/times/t (from r78369) - linux-release-hardy/intl2/times/t (from r78369) - linux-release-hardy/moz/times/t (from r78369) - mac-release-10.5/intl2/vm_size_final_b/vm_size_f_b (from r79038) - mac-release-10.5/intl2/vm_size_final_t/vm_size_f_t (from r79038) - mac-release-10.6/dhtml/times/t (slight increase) - xp-release-dual-core/intl1/times/t (ref build improved, likely system change) - xp-release-dual-core/intl2/times/t (from r78369) - xp-release-dual-core/moz/vm_peak_r/vm_pk_r (from r78369) - xp-release-single-core/intl1/times/t (slight increase) - xp-release-single-core/intl2/times/t (slight increase) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6731001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@79162 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-03-151-7/+7
| | | | | | | | | | | | | | | | | | - mac-release-10.5/moz/times/t (false positives) - vista-release-single-core/intl1/times/t (fixed ref buid config) - vista-release-single-core/moz/times/t (fixed ref build config) - xp-release-dual-core/intl2/times/t (false positives) - xp-release-dual-core/moz/total_op_b/IO_op_b (improvement from r77288) - xp-release-single-core/dhtml/times/t (fix ref build config) - xp-release-single-core/intl1/times/t (false positives) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6694012 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@78157 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-03-111-15/+15
| | | | | | | | | | | | | | | | | | | | | | | | | - linux-release-hardy/morejs/times/t (v8 rev to version 3.2.0.2, see r77461) - mac-release-10.5/intl2/vm_rss_final_b/vm_rss_f_b (false positives) - mac-release-10.5/intl2/vm_rss_final_r/vm_rss_f_r (false positives) - mac-release-10.5/intl2/vm_rss_final_t/vm_rss_f_t (false positives) - mac-release-10.5/intl2/vm_size_final_b/vm_size_f_b (false positives) - mac-release-10.5/intl2/vm_size_final_r/vm_size_f_r (false positives) - mac-release-10.5/intl2/vm_size_final_t/vm_size_f_t (false positives) - vista-release-dual-core/dhtml/times/t (false positives) - vista-release-single-core/intl1/times/t (ref build slower?) - vista-release-single-core/morejs/times/t (ref build got slower) - vista-release-single-core/moz/times/t (ref build got slower) - xp-release-dual-core/moz/total_byte_b/IO_b (from r77288) - xp-release-single-core/dhtml/times/t (ref build got slower) - xp-release-dual-core/intl1/times/t (false positives) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6680011 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@77871 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.cmp@chromium.org2011-03-061-4/+4
| | | | | | | | | | | | | | | - xp-release-dual-core/moz/vm_peak_b/vm_pk_b (see bug 75060) - xp-release-dual-core/moz/total_op_b/IO_op_b (system change) - xp-release-dual-core/moz/total_op_r/IO_op_r (system change) - xp-release-dual-core/startup/warm/t (system change) BUG=75060 TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6623046 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@77097 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.chase@chromium.org2011-03-031-10/+10
| | | | | | | | | | | | | | | | | | | | - linux-release-hardy/dhtml/total_byte_b/IO_b (from r76558) - mac-release-10.5/intl1/times/t (from r76040 webkit roll r79538:79665) - mac-release-10.5/intl2/times/t (from r76040 webkit roll r79538:79665) - mac-release-10.5/intl2/vm_size_final_b/vm_size_f_b (from r76561) - mac-release-10.5/intl2/vm_size_final_r/vm_size_f_r (from r76561) - mac-release-10.5/intl2/vm_size_final_t/vm_size_f_t (from r76561) - vista-release-single-core/dhtml/times/t (from r75758) - vista-release-single-core/intl2/times/t (from r75758) - xp-release-dual-core/moz/times/t (from r73783) - xp-release-dual-core/startup/warm/t (unknown 76395:76646) BUG=none TEST=perf steps are green Review URL: http://codereview.chromium.org/6614008 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@76708 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.chase@chromium.org2011-02-281-3/+3
| | | | | | | | | | | | | | | | - xp-release-single-core/dhtml/times/t - xp-release-single-core/intl1/times/t - xp-release-single-core/intl2/times/t Also fix expectations for this bot due to r75758. BUG=none TEST=XP Perf (jank) dhtml/intl1/intl2 is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6588064 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@76286 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.chase@chromium.org2011-02-281-14/+14
| | | | | | | | | | | | | | | | | | | | | | | | | - linux-release-hardy/dhtml/total_op_b/IO_op_b - linux-release-hardy/dhtml/total_op_r/IO_op_r - linux-release-hardy/intl2/times/t (webkit roll at r76135) - mac-release-10.5/morejs/times/t - vista-release-dual-core/morejs/times/t (maybe from r71024, weird) - vista-release-single-core/intl1/times/t (improvement from r75758) - vista-release-single-core/morejs/times/t (improvement from r75758) - vista-release-single-core/moz/times/t (improvement from r75758) - xp-release-dual-core/moz/total_byte_b/IO_b - xp-release-dual-core/moz/total_byte_r/IO_r - xp-release-dual-core/intl1/times/t (improvement from r75758) - xp-release-dual-core/intl2/times/t (webkit roll at r76135) - xp-release-single-core/morejs/times/t (improvement from r75758) - xp-release-single-core/moz/times/t (improvement from r75758) BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6597046 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@76258 0039d316-1c4b-4281-b951-d872f2087c98
* Update expectations.chase@chromium.org2011-02-221-16/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | - linux-release-hardy/dhtml/vm_rss_final_b/vm_rss_f_b - linux-release-hardy/dhtml/vm_rss_final_r/vm_rss_f_r - linux-release-hardy/dhtml/vm_rss_final_t/vm_rss_f_t - linux-release-hardy/dhtml/vm_size_final_b/vm_size_f_b - linux-release-hardy/dhtml/vm_size_final_r/vm_size_f_r - linux-release-hardy/dhtml/vm_size_final_t/vm_size_f_t - linux-release-hardy/intl2/times/t - linux-release-hardy/moz/times/t - mac-release-10.5/intl1/times/t - mac-release-10.5/intl2/vm_rss_final_b/vm_rss_f_b - mac-release-10.5/intl2/vm_rss_final_r/vm_rss_f_r - mac-release-10.5/intl2/vm_rss_final_t/vm_rss_f_t - mac-release-10.5/intl2/vm_size_final_b/vm_size_f_b - mac-release-10.5/intl2/vm_size_final_r/vm_size_f_r - mac-release-10.5/intl2/vm_size_final_t/vm_size_f_t BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6538097 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@75634 0039d316-1c4b-4281-b951-d872f2087c98
* Update expectations with new mem change.chase@chromium.org2011-02-131-4/+4
| | | | | | | | | | BUG=72850 TEST=mac10.5 perf intl2 is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6480047 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@74744 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.chase@chromium.org2011-01-291-26/+26
| | | | | | | | | | | | Running make_expectations over the expectations file. BUG=none TEST=none TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6392015 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@73096 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.chase@chromium.org2011-01-291-26/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Some are gradually increased results, non-trivial to locate in the graphs. Others are reduced variation and setting them now means easier to find real regressions or increases in flaky results. Others are improvements to capture: - "linux-release-hardy/dhtml/times/t" - "linux-release-hardy/dhtml/total_byte_r/IO_r" - "linux-release-hardy/dhtml/vm_rss_final_b/vm_rss_f_b" - "linux-release-hardy/intl1/times/t" - "mac-release-10.5/intl1/times/t" - "mac-release-10.5/intl2/vm_rss_final_b/vm_rss_f_b" - "mac-release-10.5/intl2/vm_rss_final_r/vm_rss_f_r" - "mac-release-10.5/intl2/vm_rss_final_t/vm_rss_f_t" - "mac-release-10.5/intl2/vm_size_final_b/vm_size_f_b" - "mac-release-10.5/intl2/vm_size_final_r/vm_size_f_r" - "mac-release-10.5/intl2/vm_size_final_t/vm_size_f_t" - "mac-release-10.5/morejs/times/t" - "vista-release-single-core/dhtml/times/t" - "vista-release-single-core/intl1/times/t" - "vista-release-single-core/moz/times/t" - "xp-release-dual-core/dhtml/times/t" - "xp-release-dual-core/intl1/times/t" - "xp-release-dual-core/intl2/times/t" - "xp-release-dual-core/morejs/times/t" - "xp-release-dual-core/moz/times/t" - "xp-release-dual-core/moz/total_byte_b/IO_b" - "xp-release-dual-core/moz/total_byte_r/IO_r" - "xp-release-dual-core/moz/total_op_b/IO_op_b" - "xp-release-dual-core/moz/total_op_r/IO_op_r" - "xp-release-dual-core/moz/vm_peak_b/vm_pk_b" - "xp-release-dual-core/moz/vm_peak_r/vm_pk_r" BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6409002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@73093 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.chase@chromium.org2011-01-111-2/+2
| | | | | | | | | | | | | | | | These 2 just needed a new baseline given their updated results. - vista-release-single-core/intl2/times/t - xp-release-single-core/dhtml/times/t BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6144004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@71091 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations.chase@chromium.org2011-01-061-7/+7
| | | | | | | | | | | | | | | | | | - linux-release-hardy/v8_benchmark/score/score - vista-release-single-core/morejs/times/t - vista-release-single-core/moz/times/t - xp-release-single-core/intl1/times/t - xp-release-single-core/intl2/times/t - xp-release-single-core/morejs/times/t - xp-release-single-core/moz/times/t BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/6007008 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@70594 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust perf expectations after v8 and ref roll.chase@chromium.org2010-12-141-10/+10
| | | | | | | | | | | | | | | | | | | | | mac-release-10.5/intl1/times/t mac-release-10.5/intl2/times/t mac-release-10.5/startup/times/t mac-release-10.5/v8_benchmark/score/score mac-release-10.6/v8_benchmark/score/score vista-release-dual-core/v8_benchmark/score/score xp-release-dual-core/intl1/times/t xp-release-dual-core/intl2/times/t xp-release-dual-core/morejs/times/t xp-release-dual-core/v8_benchmark/score/score BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/5781007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@69078 0039d316-1c4b-4281-b951-d872f2087c98
* Update expectations after v8 and ref roll.chase@chromium.org2010-12-131-14/+14
| | | | | | | | | | | | | | | | | | | | | | | | | mac-release-10.5/morejs/times/t mac-release-10.6/dhtml/times/t mac-release-10.6/morejs/times/t mac-release-10.6/moz/times/t vista-release-dual-core/intl1/times/t vista-release-dual-core/morejs/times/t vista-release-dual-core/moz/times/t xp-release-dual-core/moz/times/t xp-release-dual-core/moz/total_byte_b/IO_b xp-release-dual-core/moz/total_byte_r/IO_r xp-release-dual-core/moz/total_op_b/IO_op_b xp-release-dual-core/moz/total_op_r/IO_op_r xp-release-dual-core/moz/vm_peak_b/vm_pk_b xp-release-dual-core/moz/vm_peak_r/vm_pk_r BUG=none TEST=perf waterfall steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/5782002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@69056 0039d316-1c4b-4281-b951-d872f2087c98
* Rebase linux-release-hardy perf expectations.chase@chromium.org2010-12-101-16/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | These changed after the v8 and ref build updates. linux-release-hardy/dhtml/times/t linux-release-hardy/dhtml/total_byte_b/IO_b linux-release-hardy/dhtml/total_byte_r/IO_r linux-release-hardy/dhtml/total_op_b/IO_op_b linux-release-hardy/dhtml/total_op_r/IO_op_r linux-release-hardy/dhtml/vm_rss_final_b/vm_rss_f_b linux-release-hardy/dhtml/vm_rss_final_r/vm_rss_f_r linux-release-hardy/dhtml/vm_rss_final_t/vm_rss_f_t linux-release-hardy/dhtml/vm_size_final_b/vm_size_f_b linux-release-hardy/dhtml/vm_size_final_r/vm_size_f_r linux-release-hardy/dhtml/vm_size_final_t/vm_size_f_t linux-release-hardy/intl1/times/t linux-release-hardy/intl2/times/t linux-release-hardy/morejs/times/t linux-release-hardy/moz/times/t linux-release-hardy/v8_benchmark/score/score BUG=none TEST=linux steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/5731002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@68815 0039d316-1c4b-4281-b951-d872f2087c98
* Update perf expectations after V8 roll.chase@chromium.org2010-12-081-5/+5
| | | | | | | | | | | | | | | | | | | | | | | v8_benchmark improved on the following platforms after r68477: - linux-release-hardy v8_benchmark - mac-release-10.5 v8_benchmark - mac-release-10.6 v8_benchmark - vista-release-dual-core v8_benchmark - xp-release-dual-core v8_benchmark We should be curious about the linux-release-hardy results, which don't show a score increase like the other platforms. BUG=none TEST=v8_benchmark is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/5573012 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@68551 0039d316-1c4b-4281-b951-d872f2087c98
* Fix some make_expectations.py issues.chase@chromium.org2010-12-081-3/+1
| | | | | | | | | | | | Update indent spacing in a print call. Remove a case handler for open() which cannot happen. BUG=none TEST=none Review URL: http://codereview.chromium.org/5654003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@68544 0039d316-1c4b-4281-b951-d872f2087c98
* Add script to update perf_expectations.json.chase@chromium.org2010-12-071-0/+239
| | | | | | | | | | | | | | | This script reads perf_expectations.json for revision ranges, downloads the appropriate trace data, calculates the improve/regress ranges, then writes the updated values back to perf_expectations.json. BUG=none TEST=make_expectations.py downloads updated results, writes correct perf_expectations.json file Review URL: http://codereview.chromium.org/5607005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@68429 0039d316-1c4b-4281-b951-d872f2087c98
* Update v8_benchmark after V8 roll at r64892.chase@chromium.org2010-11-161-5/+5
| | | | | | | | | | BUG=63267 TEST=v8 benchmark step is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/5030004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@66200 0039d316-1c4b-4281-b951-d872f2087c98
* Update expectations for xpdual/moz.chase@chromium.org2010-11-071-3/+3
| | | | | | | | | | | | | | | | - total_op_b went up around r65182, bug for that is 62272 - total_byte_r and total_byte_b went up around r64763, bug for that is 62274. BUG=62272, 62274 TEST=xp perf is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/4652001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@65343 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust XP Perf (1) expectations.chase@chromium.org2010-10-291-1/+1
| | | | | | | | | | | | | We improved some on intl1/times/t. Update expectations to match. BUG=none TEST=xp perf/intl1 is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/4133008 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@64352 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust Linux Perf expectations.chase@chromium.org2010-10-291-5/+5
| | | | | | | | | | | | | | | | - linux-release-hardy/dhtml - linux-release-hardy/intl1/times/t - linux-release-hardy/morejs/times/t The dhtml vm_rss_final_b increase appears due to r64072. BUG=none TEST=linux perf is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/4133007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@64343 0039d316-1c4b-4281-b951-d872f2087c98
* Update revision ranges for failing tests.chase@chromium.org2010-10-271-26/+26
| | | | | | | | | | | | | These new expectations match what's present on the new perf dashboard. BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/4138007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@64033 0039d316-1c4b-4281-b951-d872f2087c98
* Expectations update.chase@chromium.org2010-10-211-7/+7
| | | | | | | | | | | | | | | | | | - linux-release-hardy/intl1/times/t - linux-release-hardy/dhtml/commit_charge/cc - linux-release-hardy/dhtml/total_op_b/IO_op_b - xp-release-dual-core/intl1/times/t - xp-release-dual-core/morejs/times/t - xp-release-dual-core/moz/times/t - xp-release-dual-core/moz/total_byte_r/IO_r BUG=59985 TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3962002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@63339 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust expectations for vistadual/morejs.chase@chromium.org2010-10-181-1/+1
| | | | | | | | | | BUG=none TEST=vistadual/morejs is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3750016 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@62917 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust perf expectations.chase@chromium.org2010-10-011-6/+6
| | | | | | | | | | | | | | | | | | | - linux-release-hardy/intl2/times/t - mac-release-10.5/startup/warm/t improvement due to WebKit roll at r61094 - mac-release-10.6/morejs/times/t - xp-release-dual-core/intl2/times/t - xp-release-dual-core/moz/total_byte_r/IO_r big decrease at 61200:61205. - xp-release-dual-core/startup/warm/t speedup from r61096 BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3601005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@61235 0039d316-1c4b-4281-b951-d872f2087c98
* Add more perf expectations.chase@chromium.org2010-10-011-0/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - linux-release-hardy/dhtml/total_byte_b/IO_b - linux-release-hardy/dhtml/total_byte_r/IO_r - linux-release-hardy/dhtml/total_op_b/IO_op_b - linux-release-hardy/dhtml/total_op_r/IO_op_r - linux-release-hardy/dhtml/vm_rss_final_b/vm_rss_f_b - linux-release-hardy/dhtml/vm_rss_final_r/vm_rss_f_r - linux-release-hardy/dhtml/vm_rss_final_t/vm_rss_f_t - linux-release-hardy/dhtml/vm_size_final_b/vm_size_f_b - linux-release-hardy/dhtml/vm_size_final_r/vm_size_f_r - linux-release-hardy/dhtml/vm_size_final_t/vm_size_f_t - linux-release-hardy/dhtml/commit_charge/cc - linux-release-hardy/dhtml/processes/proc_ - linux-release-hardy/v8_benchmark/score/score - mac-release-10.5/intl2/vm_rss_final_b - mac-release-10.5/intl2/vm_rss_final_r - mac-release-10.5/intl2/vm_rss_final_t - mac-release-10.5/intl2/vm_size_final_b - mac-release-10.5/intl2/vm_size_final_r - mac-release-10.5/intl2/vm_size_final_t - mac-release-10.5/v8_benchmark/score/score - mac-release-10.6/v8_benchmark/score/score - vista-release-dual-core/v8_benchmark/score/score - xp-release-dual-core/v8_benchmark/score/score BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3585006 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@61194 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust perf expectations based on recent results.chase@chromium.org2010-09-301-8/+8
| | | | | | | | | | | | | | | | | | | | | | | Most changes are to avoid false positives. There's a small regression somewhere in the intl page cyclers which I filed a bug on. - linux-release-hardy/dhtml/times/t - mac-release-10.6/intl1/times/t - mac-release-10.6/intl2/times/t - vista-release-dual-core/intl1/times/t - xp-release-dual-core/intl1/times/t - xp-release-dual-core/intl2/times/t - xp-release-dual-core/morejs/times/t - xp-release-dual-core/startup/warm/t BUG=57447 TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3572005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@61093 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust perf expectations.chase@chromium.org2010-09-221-6/+6
| | | | | | | | | | | | | | | | | | | | Adjust after a slight intl1/intl2 perf improvement, and avoid false alarms on other tests. - linux-release-hardy/startup/warm/t - mac-release-10.5/intl2/times/t - mac-release-10.6/intl1/times/t - mac-release-10.6/moz/times/t - vista-release-dual-core/dhtml/times/t - vista-release-dual-core/intl1/times/t BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3441023 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@60134 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust perf expectations.chase@chromium.org2010-09-201-8/+8
| | | | | | | | | | | | | | | | | | | | | | This widens or otherwise adjust perf expectations to avoid false negatives: - linux-release-hardy/dhtml/times/t - mac-release-10.6/dhtml/times/t - mac-release-10.6/intl1/times/t - mac-release-10.6/intl2/times/t - vista-release-dual-core/dhtml/times/t - xp-release-dual-core/moz/times/t - xp-release-dual-core/moz/total_byte_r/IO_r - xp-release-dual-core/startup/warm/t BUG=none TEST=perf steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3466004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@59968 0039d316-1c4b-4281-b951-d872f2087c98
* Update expectations with wider windows.chase@chromium.org2010-09-131-3/+3
| | | | | | | | | | | | | | | | | Following upstream WebKit perf slowdown and possible V8 regression. - mac-release-10.5/morejs/times/t - mac-release-10.6/morejs/times/t - xp-release-dual-core/morejs/times/t BUG=none TEST=mac10.5, mac10.6, and xpdual morejs is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3367027 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@59282 0039d316-1c4b-4281-b951-d872f2087c98
* adjust page_cycler_morejs by 120ms on Linux, Mac, 80 on Win. The test hasdpranke@chromium.org2010-09-131-8/+8
| | | | | | | | | | | | | | slowed due to WebKit bug 45524. Hopefully I am adjusting the expectations correctly. BUG=https://bugs.webkit.org/show_bug.cgi?id=45524 TEST=page cycle bots green up TBR=chase@chromium.org Review URL: http://codereview.chromium.org/3306017 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@59206 0039d316-1c4b-4281-b951-d872f2087c98
* Update perf expectations.chase@chromium.org2010-09-031-7/+7
| | | | | | | | | | | | | | | | | | | - mac-release-10.5/intl1/times/t - mac-release-10.5/startup/warm/t - mac-release-10.6/intl2/times/t - xp-release-dual-core/intl2/times/t - xp-release-dual-core/moz/total_byte_r/IO_r - xp-release-dual-core/moz/total_op_r/IO_op_r - xp-release-dual-core/moz/vm_peak_r/vm_pk_r BUG=none TEST=these are green: mac10.5 perf (1) intl1 and startup, mac10.6 (perf) intl2, xp perf(1) intl2 and moz TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3328007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@58435 0039d316-1c4b-4281-b951-d872f2087c98
* Update vistadual/intl2/times.chase@chromium.org2010-09-011-1/+1
| | | | | | | | | | BUG=none TEST=vistadual/intl2 is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3325003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@58222 0039d316-1c4b-4281-b951-d872f2087c98
* Update some expectations to allow more variance.chase@chromium.org2010-09-011-3/+3
| | | | | | | | | | | | | | - vista-release-dual-core/dhtml/times - vista-release-dual-core/intl1/times - xp-release-dual-core/moz/times BUG=none TEST=tests are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3349002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@58202 0039d316-1c4b-4281-b951-d872f2087c98
* Update expectations follow-on.chase@chromium.org2010-08-311-4/+4
| | | | | | | | | | | | | | | - mac-release-10.6/morejs/times - vista-release-dual-core/intl2/times - vista-release-dual-core/moz/times. - xp-release-dual-core/moz/vm_peak_r BUG=none TEST=perf is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3217017 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@58076 0039d316-1c4b-4281-b951-d872f2087c98