summaryrefslogtreecommitdiffstats
path: root/tools/perf_expectations
Commit message (Collapse)AuthorAgeFilesLines
* Update expectation improvements.chase@chromium.org2010-08-301-8/+8
| | | | | | | | | | | | | | | | | | | - linux-release-hardy/dhtml/times - linux-release-hardy/morejs/times - mac10.6/morejs/times - mac10.6/dhtml/times - vista-release-dual-core/morejs/times - xpdual/moz/total_byte_b - xpdual/moz/total_op_b - xpdual/startup/times BUG=none TEST=tests are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3270006 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@57835 0039d316-1c4b-4281-b951-d872f2087c98
* Update linux-hardy/intl*.chase@chromium.org2010-08-301-2/+2
| | | | | | | | | | | | | The regression from the WebKit roll looks worse than originally seen. BUG=none TEST=linux-release-hardy/intl* is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3248004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@57832 0039d316-1c4b-4281-b951-d872f2087c98
* Update perf expectations for xpdual/moz/vm_peak_b.chase@chromium.org2010-08-301-1/+1
| | | | | | | | | | | | | This vm_peak_b increase is still under investigation. Mark it as expected while that work happens. BUG=53619 TEST=xpdual/moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3286003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@57830 0039d316-1c4b-4281-b951-d872f2087c98
* Update intl expectations after WebKit roll.chase@chromium.org2010-08-281-10/+10
| | | | | | | | | | | | | | Regression appeared in r57724 (WebKit 66079:66240). Tony Chang identified it as caused by WebKit r66115. Update expectations for now. BUG=none TEST=intl steps are green TBR=tony@chromium.org Review URL: http://codereview.chromium.org/3226013 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@57769 0039d316-1c4b-4281-b951-d872f2087c98
* Update mac10.6/moz times expectation.chase@chromium.org2010-08-261-1/+1
| | | | | | | | | | | | | Looks like a regression introduced somewhere between r55576 and r55952. BUG=none TEST=mac10.6/moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3180030 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@57546 0039d316-1c4b-4281-b951-d872f2087c98
* Update xpdual/moz/vm_peak_r expectation.chase@chromium.org2010-08-231-1/+1
| | | | | | | | | | | | | This looks like a local system change after a reboot since t_ref changed, too. BUG=none TEST=xpdual/moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3190015 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@57091 0039d316-1c4b-4281-b951-d872f2087c98
* Update perf expectations to use new format.chase@chromium.org2010-08-201-55/+55
| | | | | | | | | | | | | | | | | | | | This updates the following systems to use the new improve/regress format: - linux-release - linux-release-hardy - mac10.5 - mac10.6 - vista-release-dual-core - vista-release-single-core - xp-release-dual-core - xp-release-single-core BUG=none TEST=perf steps run correctly Review URL: http://codereview.chromium.org/3148028 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@56872 0039d316-1c4b-4281-b951-d872f2087c98
* Widen variance window for linux-hardy/moz.chase@chromium.org2010-08-171-1/+1
| | | | | | | | | | BUG=none TEST=linux-hardy/moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3146017 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@56274 0039d316-1c4b-4281-b951-d872f2087c98
* Update linux/moz to use new perf format.chase@chromium.org2010-08-162-9/+23
| | | | | | | | | | | | | | | This is a test. If this test passes, I'll convert the rest of the measures. It includes a change to the expectations to account for this test's new performance. If it didn't include that change, the line would be improve: -9, regress: 9. BUG=none TEST=linux/moz is green Review URL: http://codereview.chromium.org/3115012 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@56267 0039d316-1c4b-4281-b951-d872f2087c98
* Edit one more perf expectation. Also potentially caused by 56044: WebKit ↵nsylvain@chromium.org2010-08-161-1/+1
| | | | | | | | merge 65180:65318 Review URL: http://codereview.chromium.org/3119015 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@56178 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust one more perf expectation that is randomly turning red.nsylvain@chromium.org2010-08-161-1/+1
| | | | | | Review URL: http://codereview.chromium.org/3108021 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@56177 0039d316-1c4b-4281-b951-d872f2087c98
* Fix redness in the tree by silencing all the perf tests that are failing.nsylvain@chromium.org2010-08-161-6/+6
| | | | | | | | | | | | | | | | Most of the errors look like it came from the V8 merge a while back, but the perf expectations were a little bit too strict. 2 new perf regressions, both fairly small: xp perf intl2: http://build.chromium.org/buildbot/perf/xp-release-dual-core/intl2/report.html?history=140&rev=55952 Blame: 55671 (ananta) xp perf intl1: http://build.chromium.org/buildbot/perf/xp-release-dual-core/intl1/report.html?history=100&rev=56174 Only 0.5%. Blame: Possibly 56044 (WebKit merge 65180:65318) Review URL: http://codereview.chromium.org/3121018 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@56176 0039d316-1c4b-4281-b951-d872f2087c98
* Perf expectations updates for xpdual.chase@chromium.org2010-08-121-5/+5
| | | | | | | | | | | | | | - xpdual/dhtml/times - dhtml speedup - xpdual/intl1/times - slowdown (unknown cause) - xpdual/moz results - new variability in results BUG=51863 TEST=xpdual/dhtml, intl1, and moz are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3172007 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@55833 0039d316-1c4b-4281-b951-d872f2087c98
* Revert "Convert mac10.6/dhtml/times to new expectations format."chase@chromium.org2010-08-112-23/+9
| | | | | | | | | | | | This reverts r55769. BUG=none TEST=mac10.6/dhtml passes TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3151009 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@55779 0039d316-1c4b-4281-b951-d872f2087c98
* Convert mac10.6/dhtml/times to new expectations format.chase@chromium.org2010-08-112-9/+23
| | | | | | | | | | | Update unit tests. BUG=none TEST=mac10.6/dhtml is orange Review URL: http://codereview.chromium.org/3180002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@55769 0039d316-1c4b-4281-b951-d872f2087c98
* Update xpdual/moz/total_byte_r.chase@chromium.org2010-08-101-1/+1
| | | | | | | | | | | | | Looks like this result can be flaky, so give it a new delta and var to keep the step green most of the time. BUG=none TEST=xpdual/moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3158003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@55623 0039d316-1c4b-4281-b951-d872f2087c98
* Update xp release dual core moz expectations.chase@chromium.org2010-08-101-1/+1
| | | | | | | | | | | | Recent red in vm_peak_b looks flaky to me. BUG=none TEST=xpdual moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3138003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@55595 0039d316-1c4b-4281-b951-d872f2087c98
* Fix some intl* expectations to use later data.chase@chromium.org2010-08-101-6/+6
| | | | | | | | | | | | | | | Updates: - mac 10.5 intl* - mac 10.6 intl* - linux-release-hardy intl* BUG=51664 TEST=mac and linux intl* are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3143003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@55589 0039d316-1c4b-4281-b951-d872f2087c98
* Update perf expectations after V8 roll.chase@chromium.org2010-08-101-10/+10
| | | | | | | | | | | | | | | | | | | | First V8 roll in r55389, was reverted, landed again in r55576. V8 rolled 5186:5214. Updates: - mac10.5 intl* - mac10.6 intl* - linux-release-hardy intl* - vista-release-dual-core intl* - xp-release-dual-core intl* BUG=51664 TEST=intl* results are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3133002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@55582 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust Mac intl2 expectations.chase@chromium.org2010-07-271-2/+2
| | | | | | | | | | BUG=50300 TEST=mac intl2 tests are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3027028 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@53748 0039d316-1c4b-4281-b951-d872f2087c98
* Update xpdual/morejs expectations.chase@chromium.org2010-07-231-1/+1
| | | | | | | | | | | | | | | xpdual/morejs times improved at 50331:50332. r50331 is WebKit roll (61498:61520) which is the most likely place for this to have improved. Account for new times results in expectations. BUG=none TEST=xpdual/morejs is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3061006 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@53426 0039d316-1c4b-4281-b951-d872f2087c98
* Update xpdual/moz expectations.chase@chromium.org2010-07-231-5/+5
| | | | | | | | | | | | | | Update the xpdual/moz results based on recent tests. A regression in total_byte_* between 53231:53236 is being tracked in issue 49992. BUG=49992 TEST=xpdual/moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2809073 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@53425 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust mac 10.5 startup expectations.chase@chromium.org2010-07-191-1/+1
| | | | | | | | | | | | | | After the most recent reboot, the startup results difference is ~30 ms. Adjust to keep the step green for now. BUG=none TEST=mac 10.5 startup is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3054001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@52935 0039d316-1c4b-4281-b951-d872f2087c98
* Update vista morejs.chase@chromium.org2010-07-191-1/+1
| | | | | | | | | | | | | Looks like we got faster around r50331 (WebKit roll 61498:61520). BUG=none TEST=vista morejs is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/3049002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@52926 0039d316-1c4b-4281-b951-d872f2087c98
* Update Vista intl expectations.chase@chromium.org2010-07-191-2/+2
| | | | | | | | | | | | | | | | | The current build got faster around r52818, but so did the reference build. Then the reference build got faster while the current build did not. So while it's a relative increase in perf results, it's an absolute decrease. Appears to be local machine changes that caused these changes. BUG=none TEST=vista intl steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2847060 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@52922 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust XP intl times results.chase@chromium.org2010-07-171-3/+3
| | | | | | | | | | | | | | A recent regression in intl times results is causing the XP perf bots to go red. I put a bug on file to track the regression, now let's green up the tree. BUG=49434 TEST=xp intl steps are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2832059 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@52834 0039d316-1c4b-4281-b951-d872f2087c98
* Update Mac 10.6 moz expectations.chase@chromium.org2010-07-031-1/+1
| | | | | | | | | | | | | Gradual increase of moz test results over time within variance. BUG=none TEST=mac10.6/moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2814048 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@51606 0039d316-1c4b-4281-b951-d872f2087c98
* Update dhtml times for xp and vista.chase@chromium.org2010-06-231-2/+2
| | | | | | | | | | | | | This got slower recently, possibly as a result of a WebKit roll in 50199 (roll from 61334:61360). BUG=47335 TEST=xpdual and vistadual dhtml are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2863020 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@50639 0039d316-1c4b-4281-b951-d872f2087c98
* Update xpdual/moz total_byte_b expectations.chase@chromium.org2010-06-221-1/+1
| | | | | | | | | | | | | | | | | Amit's change in r50386 loads chrome.dll to lower startup time. This causes a corresponding increase in read_byte_b on xpdual/moz (and other perf tests). This means total_byte_b goes up, which caused the step to turn red. Adjusting expectations for this measure will cause xpdual moz to go green again. BUG=44129 TEST=xpdual moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2815022 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@50535 0039d316-1c4b-4281-b951-d872f2087c98
* Revert 49425 - Adjust xpdual/moz/total_byte_b.jochen@chromium.org2010-06-141-1/+1
| | | | | | | | | | | | | | | | | | r49390 caused an increase in total_byte_b. This is an error because there's no listener for cookies in the page cycler yet the data is sent anyway. This should be fixed in a later change, possibly 2 weeks out. BUG=46275 TEST=xpdual moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2742005 TBR=chase@chromium.org Review URL: http://codereview.chromium.org/2822002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@49671 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust xpdual/moz/total_byte_b.chase@chromium.org2010-06-101-1/+1
| | | | | | | | | | | | | | | r49390 caused an increase in total_byte_b. This is an error because there's no listener for cookies in the page cycler yet the data is sent anyway. This should be fixed in a later change, possibly 2 weeks out. BUG=46275 TEST=xpdual moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2742005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@49425 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust Mac10.6 intl2 times expectations upwards.chase@chromium.org2010-06-081-1/+1
| | | | | | | | | | BUG=none TEST=mac10.6 intl2 times is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2714002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@49160 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust mac10.6 and vistadual intl2 times expectations.chase@chromium.org2010-05-271-2/+2
| | | | | | | | | | BUG=none TEST=mac10.6 intl2 and vistadual intl2 are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2302004 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48431 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust test expectations based on latest results.chase@chromium.org2010-05-271-6/+6
| | | | | | | | | | | | | | | | | | | | | On xpdual, adjust morejs times and moz vm_peak_r. The vm_peak_r change was in WebKit roll 58541:58626. On mac10.5, adjust intl1 times. On mac10.6, adjust moz and intl1 times. On linux-release-hardy, adjust intl2 times. All were improvements from their last expectations. BUG=none TEST=tests are green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2308002 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48412 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust xpdual moz expectations for some extra metrics.chase@chromium.org2010-05-271-3/+3
| | | | | | | | | | | | | This fixes expectations for 3 measures: times, total_op_r, and total_byte_r. BUG=44944 TEST=xpdual moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2224005 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48343 0039d316-1c4b-4281-b951-d872f2087c98
* Adjust xpdual moz total_byte_b expectations.chase@chromium.org2010-05-261-1/+1
| | | | | | | | | | | | | This test behavior changed in 47458:47478. It became more erratic in 47633:47650. BUG=44944 TEST=xpdual moz is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/2287001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@48285 0039d316-1c4b-4281-b951-d872f2087c98
* Repeat 10.6 perf regression suppression for 10.5.dpranke@chromium.org2010-05-051-1/+1
| | | | | | | | | | BUG=43276 TBR=chase TEST=none Review URL: http://codereview.chromium.org/1916003 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@46440 0039d316-1c4b-4281-b951-d872f2087c98
* The latest WebKit roll seems to have caused a perf regression on the pagedpranke@chromium.org2010-05-051-1/+1
| | | | | | | | | | | | | | cycler for 10.6 for the intl1 tests by 750ms. I have no idea how to debug this yet, but I need to leave the tree rolled-forward in order to have the mac bots running the fix in r58789. BUG=43276 TBR=chase TEST=none Review URL: http://codereview.chromium.org/1974001 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@46432 0039d316-1c4b-4281-b951-d872f2087c98
* Update Dromaeo expectations.chase@chromium.org2010-04-301-1/+2
| | | | | | | | | | BUG=none TEST=dromaeo is being measured TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1736027 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@46115 0039d316-1c4b-4281-b951-d872f2087c98
* Update expectations for recent performance.chase@chromium.org2010-04-291-3/+3
| | | | | | | | | | | | | | | Adjust Mac 10.6 intl1 expectations. Improvement maybe from WebKit roll and changes upstream around r45865. xp-dual/moz/total_byte_* regressed in r45424. BUG=42841,42882 TEST=xp-dual/moz/total_byte_* is green, Mac10.6 intl1 page cycler is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1759018 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@45997 0039d316-1c4b-4281-b951-d872f2087c98
* Fix some Mac 10.6 perf expectations.chase@chromium.org2010-04-151-2/+2
| | | | | | | | | | | | These 2 were generating false positives and negatives. BUG=none TEST=intl1 and dhtml remain green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1566046 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44703 0039d316-1c4b-4281-b951-d872f2087c98
* Increase vista dual intl* expectations.chase@chromium.org2010-04-141-2/+2
| | | | | | | | | | BUG=41343 TEST=vista intl* is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1559031 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44557 0039d316-1c4b-4281-b951-d872f2087c98
* Add more expectations for Mac 10.6.chase@chromium.org2010-04-141-1/+5
| | | | | | | | | BUG=36799 TEST=mac 10.6 tests are green Review URL: http://codereview.chromium.org/1613017 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44503 0039d316-1c4b-4281-b951-d872f2087c98
* Increase linux startup perf expectations.chase@chromium.org2010-04-141-1/+1
| | | | | | | | | | BUG=41485 TEST=linux startup perf is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1525033 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44494 0039d316-1c4b-4281-b951-d872f2087c98
* Update xpdual/moz/total_byte_* expectations.chase@chromium.org2010-04-131-2/+2
| | | | | | | | | | BUG=none TEST=xpdual moz step is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1613014 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44376 0039d316-1c4b-4281-b951-d872f2087c98
* Revert "Update expectations with automatically generated file."chase@chromium.org2010-04-131-171/+52
| | | | | | | | | | | | This reverts r44299. BUG=none TEST=perf steps return to normal TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1625012 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44353 0039d316-1c4b-4281-b951-d872f2087c98
* Update expectations with automatically generated file.chase@chromium.org2010-04-121-52/+171
| | | | | | | | | BUG=none TEST=perf steps are green Review URL: http://codereview.chromium.org/1582025 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44299 0039d316-1c4b-4281-b951-d872f2087c98
* Update dhtml linux results after tcmalloc revert.chase@chromium.org2010-04-091-1/+1
| | | | | | | | | | BUG=none TEST=linux perf page_cycler_dhtml is green TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1539029 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44141 0039d316-1c4b-4281-b951-d872f2087c98
* Webkit roll 57171:57243. This includes a perf regression.ojan@chromium.org2010-04-081-2/+2
| | | | | | | | I'm working on addressing that separately, but in the meantime, the webkit train must keep rolling. Review URL: http://codereview.chromium.org/1560022 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@44007 0039d316-1c4b-4281-b951-d872f2087c98
* Revert "Update expectations from generated values."chase@chromium.org2010-04-081-162/+52
| | | | | | | | | | | | | Reverts r43973. Found some good stuff to take a closer look at. BUG=none TEST=perf steps behave normally TBR=nsylvain@chromium.org Review URL: http://codereview.chromium.org/1525020 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@43981 0039d316-1c4b-4281-b951-d872f2087c98
generated by cgit v1.1 at 2025-02-12 17:01:19 +0000