summaryrefslogtreecommitdiffstats
path: root/tools/perf_expectations
Commit message (Collapse)AuthorAgeFilesLines
* Update expectations for a 0.02% size regression for chrome/chrome.John Abd-El-Malek2015-08-171-2/+2
| | | | Cr-Commit-Position: refs/heads/master@{#343634}
* Update sizesJohn Abd-El-Malek2015-08-171-2/+2
| | | | Cr-Commit-Position: refs/heads/master@{#343630}
* Update sizes expectations for Win XP chrome.dll.qyearsley2015-08-071-1/+1
| | | | | | | | BUG=517672 Review URL: https://codereview.chromium.org/1277813006 Cr-Commit-Position: refs/heads/master@{#342259}
* nacl-helper-bss dropped; re-establish the new norm to green the bots.avi2015-07-301-2/+2
| | | | | | | | | | BUG=none TEST=bots green TBR=miletus@chromium.org Review URL: https://codereview.chromium.org/1265973002 Cr-Commit-Position: refs/heads/master@{#341121}
* Updated linux size expectations for nacl_helper-data, nacl_helper-text and ↵oysteine2015-07-291-6/+6
| | | | | | | | | | | | | nacl_helper Expected improvement from https://codereview.chromium.org/1250043002 TBR=thestig BUG=514902 Review URL: https://codereview.chromium.org/1262033002 Cr-Commit-Position: refs/heads/master@{#340817}
* Update ChromiumFramework size expectations on Mac.mgiuca2015-07-211-1/+1
| | | | | | | | | | | | | | | | Nothing looks like a major regression, just gradual size creep. Expectations now based on the range r339374 -- r339494 (which looks relatively flat). Note: There is a big spike after r339494 which I don't want included in the expectation as it may be anomalous. BUG=512340 TBR=majidvp@chromium.org Review URL: https://codereview.chromium.org/1248653002 Cr-Commit-Position: refs/heads/master@{#339620}
* Make chrome textrels zero tolerance.chcunningham2015-07-201-1/+1
| | | | | | | | | | | | | | | | This way we can pin the number to exactly those contributed from ffmpeg. Otherwise, make_expectations will expand the range to allow for some larger default tolerance. Related change: https://crrev.com/334076 BUG=511290 TESTS=No further changes from make_expectations.py Review URL: https://codereview.chromium.org/1242833002 Cr-Commit-Position: refs/heads/master@{#339479}
* Update expectations again for Chromium.app, slightly wider range than in ↵gab2015-07-171-1/+1
| | | | | | | | | | | https://codereview.chromium.org/1239163002/. NOPRESUBMIT=True (http://crbug.com/511290) BUG=511392 Review URL: https://codereview.chromium.org/1237763003 Cr-Commit-Position: refs/heads/master@{#339314}
* Update mac Chromium.app size expectationsgab2015-07-171-1/+1
| | | | | | | | | | | Regressed in r339239:[blink]r199094, but is only organic growth. NOPRESUBMIT=True (because r334076 made textrel expectations non make-expectations.py but this CL is the wrong place to fix it). BUG=511265 Review URL: https://codereview.chromium.org/1239163002 Cr-Commit-Position: refs/heads/master@{#339262}
* Set textrels expectations to exactly the number contributed by ffmpeg.chcunningham2015-06-111-1/+1
| | | | | | | | | | | | | | | | | | | Chrome originally had 0 text relocations, but ffmpeg has always had a few (steadily decreasing). Since static linking ffmpeg, chrome's count has come to contain those from ffmpeg. Pinning the max/min to match the count from ffmpeg preserves our enforcement that chrome should have no wiggle room to contribute additional text relocations. This is a follow up cl to the expectations update I made upon landing ffmpeg static linking. https://codereview.chromium.org/1161633003 NOPRESUBMIT=true Review URL: https://codereview.chromium.org/1177233007 Cr-Commit-Position: refs/heads/master@{#334076}
* Update perf expectations since static linking ffmpeg.chcunningham2015-06-091-6/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | This updates bss sizes for the following: - linux-release-64/sizes/chrome-bss/bss - linux-release/sizes/chrome-bss/bss - mac-release/sizes/ChromiumFramework/ChromiumFramework - xp-release/sizes/chrome_child.dll/chrome_child.dll It also updates linux-release chrome-textrel count to take on the textrelocations that were previously part of ffmpegsumo.so. Since the introduction of textrel expectations (https://codereview.chromium.org/9187031), ffmpegsumo has been known to have textrelocations that are not trivial to remove. The good news is, the number of relocations has been steadily falling as we roll from upstream ffmpeg. While chrome/chrome_child have grown significantly, the net change (now that ffmpegsumo.dll is gone) is actually a savings of a few hundred KB due to dead code elimination in static linking. Static linking change: https://codereview.chromium.org/1141703002/ Bugs motivating the original static linking change: BUG=435455, 429131, 441908 Review URL: https://codereview.chromium.org/1161633003 Cr-Commit-Position: refs/heads/master@{#333462}
* Update sizes expectations since static linking ffmpeg.chcunningham2015-06-091-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | This updates bss sizes for the following: - linux-release-64/sizes/chrome-bss/bss - linux-release/sizes/chrome-bss/bss - mac-release/sizes/ChromiumFramework/ChromiumFramework - xp-release/sizes/chrome_child.dll/chrome_child.dll Change https://codereview.chromium.org/1141703002/ causes ffmpeg to be statically linked into chrome (or chrome_child on windows). While chrome/chrome_child have grown significantly, the net change (now that ffmpegsumo.dll is gone) is actually a savings of a few hundred KB due to dead code elimination in static linking. (Bugs motivating the original static linking change) BUG=435455, 429131, 441908 Committed: https://crrev.com/41c1b31dc7983a1dca627f9e00ee3977b75e5b6f Cr-Commit-Position: refs/heads/master@{#332938} Review URL: https://codereview.chromium.org/1161633003 Cr-Commit-Position: refs/heads/master@{#333436}
* Update sizes expectations for mac chromium.appzea2015-06-061-1/+1
| | | | | | | | | | | Sizes regression @ http://build.chromium.org/p/chromium/builders/Mac/builds/3230 Sizes changed from 159125504 to 159129600 with r333148:r33151 BUG=497447 Review URL: https://codereview.chromium.org/1152523008 Cr-Commit-Position: refs/heads/master@{#333189}
* Revert of Update sizes expectations since static linking ffmpeg. (patchset ↵thestig2015-06-051-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | #1 id:1 of https://codereview.chromium.org/1161633003/) Reason for revert: r332994 reverted the static linking ffmpeg CL and the size expectations is now red due to "improvement". Original issue's description: > Update sizes expectations since static linking ffmpeg. > > This updates bss sizes for the following: > - linux-release-64/sizes/chrome-bss/bss > - linux-release/sizes/chrome-bss/bss > - mac-release/sizes/ChromiumFramework/ChromiumFramework > - xp-release/sizes/chrome_child.dll/chrome_child.dll > > Change https://codereview.chromium.org/1141703002/ causes ffmpeg > to be statically linked into chrome (or chrome_child on windows). > > While chrome/chrome_child have grown significantly, the net change > (now that ffmpegsumo.dll is gone) is actually a savings of a few > hundred KB due to dead code elimination in static linking. > > (Bugs motivating the original static linking change) > BUG=435455, 429131, 441908 > > Committed: https://crrev.com/41c1b31dc7983a1dca627f9e00ee3977b75e5b6f > Cr-Commit-Position: refs/heads/master@{#332938} TBR=mkwst@chromium.org,zea@chromium.org,calamity@chromium.org,dalecurtis@chromium.org,chcunningham@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=435455, 429131, 441908 Review URL: https://codereview.chromium.org/1157993006 Cr-Commit-Position: refs/heads/master@{#333000}
* In make_expectations, ignore "rev" if cannot be parsed as an int.qyearsley2015-06-041-6/+7
| | | | | | | | BUG=492505 Review URL: https://codereview.chromium.org/1153333002 Cr-Commit-Position: refs/heads/master@{#332967}
* Update sizes expectations since static linking ffmpeg.chcunningham2015-06-041-4/+4
| | | | | | | | | | | | | | | | | | | | | | This updates bss sizes for the following: - linux-release-64/sizes/chrome-bss/bss - linux-release/sizes/chrome-bss/bss - mac-release/sizes/ChromiumFramework/ChromiumFramework - xp-release/sizes/chrome_child.dll/chrome_child.dll Change https://codereview.chromium.org/1141703002/ causes ffmpeg to be statically linked into chrome (or chrome_child on windows). While chrome/chrome_child have grown significantly, the net change (now that ffmpegsumo.dll is gone) is actually a savings of a few hundred KB due to dead code elimination in static linking. (Bugs motivating the original static linking change) BUG=435455, 429131, 441908 Review URL: https://codereview.chromium.org/1161633003 Cr-Commit-Position: refs/heads/master@{#332938}
* Update Mac sizes perf expectations, reduce tolerance to 1%tapted2015-04-271-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Mac Chromium.app sizes expectations were last updated after the switch to 64-bit which had a large increase (r305043 and http://crbug.com/435576). Later, there was a large drop for Chromium.app in r314575 due to the PDF plugin being combined into the ChromiumFramework. The perf expectations for ChromiumFramework were updated, but not Chromium.app. This has meant that large jumps are unlikely to affect the Mac sizes tree-closers, since they are absorbed into the gains from r314575. Instead, large jumps are getting picked up late because they are triaged from perf graphs rather than the Chrome waterfall. Chrome has been growing about 1MB per month on average. Set the tolerance to 1% (rather than 5%) for something likely to detect the recent large erroneous jumps. After this, Chromium.app will close the tree once it gets to 159,128kB. The prior threshold was 165,929kB. Chromium.app currently reports 157,589kB Also update ChromiumFramework. It's not out of whack, but it makes sense for it to share a common threshold tolerance with Chromium.app. BUG=468637 Review URL: https://codereview.chromium.org/1101133004 Cr-Commit-Position: refs/heads/master@{#327179}
* Update nacl-helper perf_expectations for the linux bot.jvoung2015-04-231-1/+1
| | | | | | | | | | | | | | Sizes step went red on build #61122, where nacl_helper is 8529744. http://build.chromium.org/p/chromium/builders/Linux/builds/61122 The previous build #61121 nacl_helper was 8529200 bytes: http://build.chromium.org/p/chromium/builders/Linux/builds/61121 BUG=480093 Review URL: https://codereview.chromium.org/1080393010 Cr-Commit-Position: refs/heads/master@{#326455}
* [sheriff] update perf_expectations to increase expected value of ↵dcaiafa2015-04-201-1/+1
| | | | | | | | | | xp-release/sizes/mini_installer.exe/mini_installer.exe BUG=478938 Review URL: https://codereview.chromium.org/1084123003 Cr-Commit-Position: refs/heads/master@{#325930}
* [sheriff]Update perf_expectations to increase expected value of linux-yoichio2015-04-201-1/+1
| | | | | | | | | | | | | release/sizes/chrome-data/data Update perf_expectations to increase expected value of linux-release/sizes/chrome- text/text BUG=478588 Review URL: https://codereview.chromium.org/1093993002 Cr-Commit-Position: refs/heads/master@{#325842}
* Update perf_expectations to increase expected value of ↵yoichio2015-04-171-1/+1
| | | | | | | | | | | | linux-release/sizes/chrome- text/text BUG=477957 Review URL: https://codereview.chromium.org/1090093003 Cr-Commit-Position: refs/heads/master@{#325627}
* Update perf_expectations to increase expected value of nacl_helper-text/textqyearsley2015-03-141-1/+1
| | | | | | | | BUG=467249 Review URL: https://codereview.chromium.org/1001883005 Cr-Commit-Position: refs/heads/master@{#320631}
* Update size expectations after Clang rollhans2015-03-051-2/+2
| | | | | | | | | | | Chrome size dropped significantly. nacl_helper grew a tiny bit. BUG=444089 NOTRY=true Review URL: https://codereview.chromium.org/984643002 Cr-Commit-Position: refs/heads/master@{#319278}
* Allowing size increase of nacl_helper.phoglund2015-02-251-1/+1
| | | | | | | | | | | | | | | | | | | It's pretty clear from the sizes graph (http://goo.gl/zdhb0b) that the cl https://codereview.chromium.org/905023005 causes an increase of 40k of nacl_helper on Linux x64. As per Chrome policy on which states that increases < 100k are alright. http://dev.chromium.org/developers/tree-sheriffs/perf-sheriffs says: "If sizes fails and the jump is <100k, update expections." TBR=bbudge CC=piman,llandwerlin,jam,wfh BUG=455409 Review URL: https://codereview.chromium.org/929483006 Cr-Commit-Position: refs/heads/master@{#318018}
* Size expectations updated to fix failing size checks.picksi2015-02-181-2/+2
| | | | | | | | | | Size bots have been failing since ~Feb 11th. The size of the incorrect binaries is being measured, this patch is a short term fix to keep the bots green while a longer term solution is arrived at. BUG=459260 Review URL: https://codereview.chromium.org/938573004 Cr-Commit-Position: refs/heads/master@{#316827}
* Update perf expectations:waffles2015-02-121-3/+3
| | | | | | | | | | | | chrome chrome-text chrome-data BUG=457454 Review URL: https://codereview.chromium.org/913143004 Cr-Commit-Position: refs/heads/master@{#315905}
* Update size expectation for nacl_helper-dataSami Kyostila2015-02-061-2/+2
| | | | | | | | | BUG=456109 R=alexclarke@chromium.org Review URL: https://codereview.chromium.org/880603005 Cr-Commit-Position: refs/heads/master@{#315030}
* Update size expectation for setup.exe after size improvementSami Kyostila2015-02-061-1/+1
| | | | | | | | R=primiano@chromium.org Review URL: https://codereview.chromium.org/875403007 Cr-Commit-Position: refs/heads/master@{#315026}
* Update sizes after switching 32-bit Linux to using the gold linker.thestig2015-02-051-2/+2
| | | | | | | | | | We should investigate why the binaries generated by gold are bigger. BUG=396333 Review URL: https://codereview.chromium.org/869043007 Cr-Commit-Position: refs/heads/master@{#314754}
* Update sizes after PDF plugin is merged with Chrome.jam2015-02-041-6/+6
| | | | | | | | BUG=453844 Review URL: https://codereview.chromium.org/896303002 Cr-Commit-Position: refs/heads/master@{#314612}
* Cleanup: Presubmit API is built into depot_tools.tfarina2015-01-311-1/+1
| | | | | | | | | | | | | Not in gcl, which probably these days nobody working on Chromium uses. BUG=None R=maruel@chromium.org TBR=maruel@chromium.org NOPRESUBMIT=true Review URL: https://codereview.chromium.org/887033002 Cr-Commit-Position: refs/heads/master@{#314039}
* Update perf expectations for major sizes progression.erg2015-01-131-2/+2
| | | | | | | | | BUG=none TBR=teravest Review URL: https://codereview.chromium.org/849733002 Cr-Commit-Position: refs/heads/master@{#311164}
* Perf: Update sizes expectation on Linux x64nhiroki2015-01-061-1/+1
| | | | | | | | | | | | | | chrome-text/text (0.09%) http://build.chromium.org/p/chromium/builders/Linux%20x64/builds/75733 Graph https://chromeperf.appspot.com/report?masters=Chromium&bots=chromium-rel-linux-64&tests=sizes%2Fchrome-text&rev=310080&checked=all NOTRY=true Review URL: https://codereview.chromium.org/836123004 Cr-Commit-Position: refs/heads/master@{#310082}
* Added chrome_child.dll to perf_expectations.json so thatbrucedawson2014-12-191-0/+1
| | | | | | | | | | size changes are monitored. BUG=443796 Review URL: https://codereview.chromium.org/818783002 Cr-Commit-Position: refs/heads/master@{#309254}
* Adjusted perf_expectations for Windows size improvements.brucedawson2014-12-191-3/+3
| | | | | | | | | | | Improvements range from 0.41% to 7.5% -- the 7.5% improvement in chrome.exe triggered a sizes failure. BUG=443793,441988 Review URL: https://codereview.chromium.org/816853002 Cr-Commit-Position: refs/heads/master@{#309134}
* Update sizes expectations for nacl_helper and nacl_helper-texttreib2014-12-171-2/+2
| | | | | | | | | | | | | Regression introduced in crrev.com/47fa83a338df4e285112337d6afe102786e29028 TBR=fmeawad@chromium.org NOTRY=true BUG=443130 Review URL: https://codereview.chromium.org/811043003 Cr-Commit-Position: refs/heads/master@{#308782}
* Fix mac sizes The mac build updated to build 64 bit binaries, so the sizesPete Williamson2014-11-201-2/+2
| | | | | | | | | | | changed about 5-15% for some binaries. BUG=435304 R=dtu@chromium.org Review URL: https://codereview.chromium.org/744223002 Cr-Commit-Position: refs/heads/master@{#305088}
* Retrying to update the Perf BSS expectations after rolling in VP9 dependencies.Per2014-11-041-1/+1
| | | | | | | | | | | | | | | | | | First attempt in https://codereview.chromium.org/701853003/ does not update Linux 64bit. The WebRtc roll in VP9 dependency https://codereview.chromium.org/703443004/. WebRtc submit: https://code.google.com/p/webrtc/source/detail?r=7588 "linux-release/sizes/chrome-bss/bss": {"reva": 302608, "revb": 302608, "type": "absolute", "better": "lower", "improve": 501584, "regress": 554384, "sha1": "63 34ce61"}, BUG=424235 TBR=andrewhayden@chromium.org,tommi@chromium.org Review URL: https://codereview.chromium.org/698313002 Cr-Commit-Position: refs/heads/master@{#302628}
* Update the Perf BSS expectations after rolling in VP9 dependencies.Per2014-11-041-1/+1
| | | | | | | | | | | | | | | | | The WebRtc roll in VP9 dependency https://codereview.chromium.org/703443004/. WebRtc submit: https://code.google.com/p/webrtc/source/detail?r=7588 "linux-release/sizes/chrome-bss/bss": {"reva": 302608, "revb": 302608, "type": "absolute", "better": "lower", "improve": 501584, "regress": 554384, "sha1": "63 34ce61"}, BUG=424235 R=tommi@chromium.org TBR=andrewhayden@chromium.org Review URL: https://codereview.chromium.org/701853003 Cr-Commit-Position: refs/heads/master@{#302616}
* Update perf expectations for nacl_helper-data after rf4ebb5cd04.reillyg2014-10-141-2/+2
| | | | | | | | | | | | | Update the perf expectations for nacl_helper-data to reflect the binary size improvements from the recent ICU work. BUG= TBR=maruel@chromium.org,govind@chromium.org NOTRY=true Review URL: https://codereview.chromium.org/655683002 Cr-Commit-Position: refs/heads/master@{#299410}
* Updating mac-release/sizes/Chromium.app/Chromium.appjwd2014-10-101-1/+1
| | | | | | | | | BUG=422450 TBR=govind@chromium.org Review URL: https://codereview.chromium.org/641183007 Cr-Commit-Position: refs/heads/master@{#299167}
* Perf Sheriffing: Update 32-bit Linux binary size expectations after r298755.thestig2014-10-101-2/+2
| | | | | | | | | BUG=421831 TBR=rtenneti@chromium.org Review URL: https://codereview.chromium.org/645703002 Cr-Commit-Position: refs/heads/master@{#299048}
* Update expectations due to improvement in mini_installer.exe size.mek2014-09-261-1/+1
| | | | | | | | TBR=erikwright Review URL: https://codereview.chromium.org/607683002 Cr-Commit-Position: refs/heads/master@{#296926}
* Update chrome-data/data sizes expectation.tdresser2014-09-181-1/+1
| | | | | | | | | | | linux-release-64/sizes/chrome-data/data: https://chromeperf.appspot.com/report?masters=Chromium&bots=chromium-rel-linux&tests=sizes%2Fchrome-data&checked=all&rev=295451 BUG=415523 TBR=bokan@chromium.org Review URL: https://codereview.chromium.org/578243005 Cr-Commit-Position: refs/heads/master@{#295557}
* Update expectations.tdresser2014-09-181-1/+1
| | | | | | | | | | | | linux-release-64/sizes/chrome/chrome : https://chromeperf.appspot.com/report?masters=Chromium&bots=chromium-rel-linux&tests=sizes%2Fchrome&checked=all&rev=295451 BUG=415523 TBR=bokan@chromium.org Review URL: https://codereview.chromium.org/583603003 Cr-Commit-Position: refs/heads/master@{#295510}
* Perf: Update size expectations on linux-relnhiroki2014-09-161-2/+2
| | | | | | | | | | | | | | | | | Regression are tiny: - nacl_helper/nacl_helper (0.04%) - nacl_helper-text/text (0.06%) http://build.chromium.org/p/chromium/builders/Linux/builds/53437 https://chromeperf.appspot.com/report?masters=Chromium&bots=chromium-rel-linux&tests=sizes%2Fnacl_helper&rev=294990&checked=all https://chromeperf.appspot.com/report?masters=Chromium&bots=chromium-rel-linux&tests=sizes%2Fnacl_helper-text&rev=294990&checked=all TBR=nhiroki@chromium.org NOTRY=true Review URL: https://codereview.chromium.org/571313002 Cr-Commit-Position: refs/heads/master@{#295017}
* Revert of Perf: Update size expectation for nacl_helper/nacl_helper on linux ↵nhiroki2014-09-161-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | (patchset #1 id:1 of https://codereview.chromium.org/575603003/) Reason for revert: I should have updated the expectation for linux-release (not linux-release-64). Original issue's description: > Perf: Update size expectation for nacl_helper/nacl_helper on linux > > Regression is tiny (0.04%). > > http://build.chromium.org/p/chromium/builders/Linux/builds/53433 > https://chromeperf.appspot.com/report?masters=Chromium&bots=chromium-rel-linux%2Cchromium-rel-xp&tests=sizes%2Fnacl_helper&rev=294900&checked=all > > TBR=nhiroki@chromium.org > NOTRY=true > > Committed: https://crrev.com/bd700c84bf9132a96e17e0ea724d1855a8d01740 > Cr-Commit-Position: refs/heads/master@{#294991} TBR= NOTREECHECKS=true NOTRY=true Review URL: https://codereview.chromium.org/574633002 Cr-Commit-Position: refs/heads/master@{#295016}
* Perf: Update size expectation for nacl_helper/nacl_helper on linuxnhiroki2014-09-161-1/+1
| | | | | | | | | | | | | | Regression is tiny (0.04%). http://build.chromium.org/p/chromium/builders/Linux/builds/53433 https://chromeperf.appspot.com/report?masters=Chromium&bots=chromium-rel-linux%2Cchromium-rel-xp&tests=sizes%2Fnacl_helper&rev=294900&checked=all TBR=nhiroki@chromium.org NOTRY=true Review URL: https://codereview.chromium.org/575603003 Cr-Commit-Position: refs/heads/master@{#294991}
* Perf: Update size expectation for chrome.dll on winnhiroki2014-09-161-1/+1
| | | | | | | | | | | | | | Regression is tiny (0.06%). http://build.chromium.org/p/chromium/builders/Win/builds/24362 https://chromeperf.appspot.com/report?masters=Chromiqum&bots=chromium-rel-xp&tests=sizes%2Fchrome.dll&checked=all&start_rev=294698&end_rev=294959 TBR=nhiroki@chromium.org NOTRY=true Review URL: https://codereview.chromium.org/575713002 Cr-Commit-Position: refs/heads/master@{#294990}
* Update xp-release/sizes/mini_installer.exe expectations.zeeshanq2014-09-121-1/+1
| | | | | | | | | | | | | | A 2MB+ regression was introduced but a cause cannot be identified. https://chromeperf.appspot.com/report?masters=Chromium&bots=chromium-rel-xp&tests=sizes%2Fmini_installer.exe&checked=mini_installer.exe&rev=294272 BUG=413191 NOTRY=true TBR=weitaosu,engedy Review URL: https://codereview.chromium.org/569453002 Cr-Commit-Position: refs/heads/master@{#294512}