// This file consists of lines with specifications of what // to expect from layout test cases. The test cases can be directories // in which case the expectations apply to all test cases in that // directory and any subdirectory. The format of the file is along the // lines of: // // fast/js/fixme.js = FAIL // fast/js/flaky.js = FAIL PASS // fast/js/crash.js = CRASH TIMEOUT FAIL PASS // // The format of a test line is as follows: // METADATA : relative/path/to/test.html = EXPECTATIONS // // Valid values for METADATA: // // BUG[0-9]+: See this bug for more information. Every test that isn't marked // WONTFIX should have a BUG annotation. // SKIP: Doesn't run the test. // SLOW: The test takes a long time to run, but does not timeout indefinitely. // DEFER: For tests we'll fix in the future. // WONTFIX: For tests that we never intend to pass on a given platform. // DEBUG: Expectations apply only to the debug build. // RELEASE: Expectations apply only to release build. // LINUX/WIN/WIN-XP/WIN-VISTA/MAC: Expectations apply only to these platforms. // // Valid values for EXPECTATIONS: // // PASS: Test should pass // CRASH: Test should crash // TIMEOUT: Test should timeout // IMAGE: Test will produce an incorrect image dump // TEXT: Test will produce incorrect text output (either full or simplified) // IMAGE+TEXT: Test will produce both incorrect text and images // FAIL: Test will produce either incorrect text, images, or both // // If a line contains multiple expectations, it is considered "flakey", // because it means that we're not producing consistent, reliable results. // // For example, // LINUX : media = PASS FAIL // // The above means that all the media tests are flaky, but only on Linux. // // Other examples: // // SKIP : fast/js/no-good.js = TIMEOUT PASS // DEBUG : fast/js/no-good.js = TIMEOUT PASS // DEBUG SKIP : fast/js/no-good.js = TIMEOUT PASS // LINUX DEBUG SKIP : fast/js/no-good.js = TIMEOUT PASS // BUG1234 DEBUG MAC : fast/js/no-good.js = TIMEOUT PASS // // Notes: // -A test cannot be both SLOW and TIMEOUT // -A test can be included twice, but not via the same path. // -If a test is included twice, then the more precise path wins. // -CRASH tests cannot be WONTFIX // ----------------------------------------------------------------- // SLOW TESTS // ----------------------------------------------------------------- BUG24182 SLOW : fast/js/regexp-overflow.html = PASS BUG24182 SLOW RELEASE : http/tests/misc/DOMContentLoaded-event.html = PASS BUG24182 SLOW LINUX DEBUG : http/tests/misc/DOMContentLoaded-event.html = PASS BUG24182 SLOW LINUX MAC RELEASE : http/tests/navigation/multiple-back-forward-entries.html = PASS BUG24182 SLOW LINUX DEBUG : http/tests/navigation/multiple-back-forward-entries.html = PASS BUG24182 SLOW : http/tests/xmlhttprequest/simple-cross-origin-progress-events.html = PASS BUG24182 SLOW WIN MAC : svg/custom/invisible-text-after-scrolling.xhtml = PASS BUG24182 SLOW : tables/mozilla/other/slashlogo.html = PASS BUG24182 SLOW WIN RELEASE : tables/mozilla/bugs/bug113235-1.html = PASS BUG24182 SLOW DEBUG : fast/js/toString-and-valueOf-override.html = PASS // This tests is normally <1 second, but occasionally takes >20s. BUG24182 SLOW WIN RELEASE : fast/dom/Window/webkitConvertPoint.html = PASS BUG24182 WIN RELEASE SLOW : http/tests/loading/redirect-methods.html = PASS BUG24182 WIN SLOW : svg/hixie/perf/007.xml = PASS BUG24182 WIN LINUX DEBUG : fast/backgrounds/size/contain-and-cover.html = PASS BUG24182 SLOW MAC RELEASE : dom/html/level2/html/HTMLImageElement01.html = PASS BUG24182 SLOW WIN RELEASE : http/tests/local/file-url-sent-as-referer.html = PASS BUG24182 SLOW WIN DEBUG : svg/carto.net/window.svg = PASS BUG24182 SLOW LINUX DEBUG : fast/xpath/4XPath/Borrowed/cz_20030217.html = PASS BUG24182 SLOW WIN MAC DEBUG : tables/mozilla/bugs/45621.html = PASS //BUG24852 started failing since webkit 49583 //BUG24182 SLOW WIN : css1/font_properties/font.html = PASS BUG24182 SLOW WIN : http/tests/security/xssAuditor/meta-tag-http-refresh-javascript-url.html = PASS BUG24182 SLOW WIN RELEASE : http/tests/security/cross-origin-css.html = PASS BUG24182 SLOW WIN RELEASE : fast/loader/local-CSS-from-local.html = PASS BUG24182 WIN RELEASE SLOW : http/tests/incremental/split-hex-entities.pl = PASS BUG24182 WIN RELEASE SLOW : http/tests/xmlhttprequest/XMLHttpRequestException.html = PASS BUG24182 WIN RELEASE SLOW : http/tests/xmlhttprequest/connection-error-sync.html = PASS BUG24182 WIN RELEASE SLOW : http/tests/loading/onload-vs-immediate-refresh.pl = PASS BUG24182 SLOW DEBUG : editing/selection/extend-selection.html = PASS BUG24182 SLOW WIN : fast/images/svg-as-background.html = PASS BUG24182 SLOW WIN : fast/backgrounds/svg-as-background-5.html = PASS BUG24182 SLOW DEBUG : svg/css/getComputedStyle-basic.xhtml = PASS BUG24182 WIN DEBUG SLOW: inspector/console-dirxml.html = PASS BUG24182 DEBUG SLOW : fast/dom/Window/window-function-frame-getter-precedence.html = PASS BUG24182 SLOW DEBUG : fast/frames/frame-limit.html = PASS BUG24182 SLOW : http/tests/cache/subresource-failover-to-network.html = PASS // Usually <1s in release, ~1s in debug, but occasionally >5s in release. BUG27335 WIN RELEASE : plugins/embed-attributes-setting.html = PASS TIMEOUT BUG27335 WIN DEBUG SLOW : plugins/embed-attributes-setting.html = PASS // --- collecting results for supported-xml-content-types.html --- // was slow, started to timeout BUG18702 MAC WIN : http/tests/xmlhttprequest/supported-xml-content-types.html = PASS TIMEOUT // ----------------------------------------------------------------- // SKIPPED TESTS // ----------------------------------------------------------------- // Since V8 is more interruptible than other engines, they use the standard // long-running-script mechanism to handle very-long-running regexps too. // See http://code.google.com/p/v8/issues/detail?id=287 WONTFIX SKIP : fast/js/regexp-overflow-too-big.html = TIMEOUT // XHTML tests. These tests seem like they work, but only because the // expected output expects to see JS errors. There is no point in running // these tests, because they are giving us a false sense of testing that isn't // really happening. Furthermore, since they appear to pass if we do try to // run them, we can't even list them as permanently expected to fail. BUG24185 WONTFIX SKIP : dom/xhtml = PASS // We do not want to support Legacy mac encodings on Windows/Linux. // On Mac, we can support them by building platform/text/mac, but // probably we don't want there, either. WONTFIX SKIP WIN LINUX : fast/encoding/char-encoding-mac.html = FAIL // Fails due to different window.close() rules. We need to decide whether we // ever expect to pass this. Now also timing out. BUG24189 WONTFIX SKIP : fast/dom/open-and-close-by-DOM.html = FAIL // Skip because of WebKit bug 18512. These bugs "poison" future tests, causing // all SVG objects with fill="red" to be rendered in green. WONTFIX SKIP : svg/custom/fill-SVGPaint-interface.svg = PASS WONTFIX SKIP : svg/custom/getPresentationAttribute.svg = PASS // WML is still an inprogress feature upstream. Chromium does not build // with WML support, so skip its tests. WONTFIX SKIP : wml = FAIL WONTFIX SKIP : http/tests/wml = FAIL WONTFIX SKIP : fast/wml = FAIL // These tests are based on the JSC JavaScript profiler. The V8 JavaScript // profiler is in development and will use a different approach than JSC and // most likely these tests will always be JSC specific. WONTFIX SKIP : fast/profiler = FAIL TIMEOUT // This test doesn't terminate because it contains exponential // regexps. It is safe to disable because we run the same tests // (sans the nonterminating ones) as part of the v8 tests. WONTFIX SKIP : fast/regex/test1.html = PASS // We use worker_uitests to run workers tests. Don't run them in test_shell. WONTFIX SKIP : fast/workers = PASS TIMEOUT FAIL WONTFIX SKIP : http/tests/workers = PASS TIMEOUT FAIL WONTFIX SKIP : http/tests/xmlhttprequest/workers = PASS TIMEOUT FAIL WONTFIX SKIP : http/tests/eventsource/workers = PASS TIMEOUT FAIL WONTFIX SKIP : websocket/tests/workers/ = PASS TIMEOUT FAIL // Page Cache - based tests. Chromium disables page cache because the WebKit page cache keeps previously // loaded pages alive in memory to be able to quickly substitute them when user clicks History buttons. // Chromium wants those to be separate navigations made via browser process to be able to make decision // on which renderer process to use for each of them. WONTFIX SKIP BUG19635 : fast/harness/use-page-cache.html = TIMEOUT FAIL WONTFIX SKIP BUG19635 : fast/dom/Window/timer-resume-on-navigation-back.html = TIMEOUT FAIL // Depends on page cache, as far as I can tell. WONTFIX SKIP BUG19635 : fast/events/pageshow-pagehide-on-back-cached.html = TIMEOUT FAIL WONTFIX SKIP BUG19635 : fast/events/pageshow-pagehide-on-back-cached-with-frames.html = TIMEOUT WONTFIX SKIP BUG19635 : media/restore-from-page-cache.html = TIMEOUT WONTFIX SKIP BUG19635 : loader/go-back-to-different-window-size.html = TIMEOUT TEXT // No support for WebGL yet BUG21852 SKIP : fast/canvas/webgl = FAIL // Tests that rely on cross-process MessagePorts. No point in running them in // test_shell, since we'd have to use a completely different implementation from // what is used in the browser. WONTFIX SKIP : fast/events/message-channel-gc-2.html = FAIL WONTFIX SKIP : fast/events/message-channel-gc-3.html = FAIL WONTFIX SKIP : fast/events/message-channel-gc-4.html = FAIL WONTFIX SKIP : fast/events/message-channel-gc.html = FAIL WONTFIX SKIP : fast/events/message-channel-listener-circular-ownership.html = FAIL WONTFIX SKIP : fast/events/message-port-clone.html = FAIL WONTFIX SKIP : fast/events/message-port-deleted-document.html = FAIL WONTFIX SKIP : fast/events/message-port-deleted-frame.html = FAIL WONTFIX SKIP : fast/events/message-port-inactive-document.html = FAIL WONTFIX SKIP : fast/events/message-port-no-wrapper.html = FAIL WONTFIX SKIP : fast/events/message-port.html = FAIL WONTFIX SKIP : fast/events/message-port-multi.html = FAIL WONTFIX SKIP : http/tests/security/MessagePort/event-listener-context.html = FAIL // Chrome does not support WebArchives (just like Safari for Windows), // although we might eventually want to on Mac. WONTFIX SKIP : webarchive/adopt-attribute-styled-body-webarchive.html = FAIL WONTFIX SKIP : webarchive/adopt-attribute-styled-node-webarchive.html = FAIL WONTFIX SKIP : webarchive/adopt-inline-styled-node-webarchive.html = FAIL // ----------------------------------------------------------------- // WONTFIX TESTS // ----------------------------------------------------------------- // This test is completely timing dependent. It is testing the time // between a key event and a search event. You cannot count on this // always being exactly the same. WONTFIX DEBUG : fast/forms/search-event-delay.html = PASS TEXT WONTFIX SLOW WIN RELEASE : fast/forms/search-event-delay.html = FAIL PASS WONTFIX SLOW MAC RELEASE : fast/forms/search-event-delay.html = FAIL PASS CRASH WONTFIX LINUX RELEASE : fast/forms/search-event-delay.html = FAIL PASS // Chrome uses different keyboard accelerators from those used by Safari, so // these tests will always fail. // TODO(pinkerton): these should probably pass on Mac since we want Emacs // keybindings but they currently do not. WONTFIX LINUX WIN DEBUG : editing/pasteboard/emacs-cntl-y-001.html = FAIL WONTFIX LINUX RELEASE : editing/pasteboard/emacs-cntl-y-001.html = FAIL WONTFIX SLOW WIN RELEASE : editing/pasteboard/emacs-cntl-y-001.html = FAIL WONTFIX : editing/pasteboard/emacs-ctrl-a-k-y.html = FAIL WONTFIX : editing/pasteboard/emacs-ctrl-k-y-001.html = FAIL WONTFIX : editing/input/emacs-ctrl-o.html = FAIL // Checks for very kjs-specific garbage collector behavior. // Would have to be implemented much differently to work in v8. WONTFIX : fast/dom/gc-10.html = FAIL // This fails because we're missing various useless apple-specific // properties on the window object. // This test also timeouts in Debug mode. BUG24187 WONTFIX SLOW DEBUG : fast/dom/Window/window-properties.html = FAIL BUG24187 WONTFIX SLOW WIN RELEASE : fast/dom/Window/window-properties.html = FAIL BUG24187 WONTFIX LINUX MAC RELEASE : fast/dom/Window/window-properties.html = FAIL // Safari specific test to ensure that JavaScript errors aren't logged when in // private browsing mode. WONTFIX : http/tests/security/cross-frame-access-private-browsing.html = FAIL // Chromium doesn't implement private browsing in the renderer. WONTFIX : plugins/private-browsing-mode.html = FAIL // We don't care about dashboard compatibility mode. WONTFIX SKIP : http/tests/xmlhttprequest/default-content-type-dashboard.html = FAIL WONTFIX SKIP : http/tests/xmlhttprequest/svg-created-by-xhr-disallowed-in-dashboard.html = FAIL WONTFIX : svg/custom/embedded-svg-disallowed-in-dashboard.xml = FAIL WONTFIX : svg/custom/manually-parsed-embedded-svg-disallowed-in-dashboard.html = FAIL WONTFIX : svg/custom/manually-parsed-svg-disallowed-in-dashboard.html = FAIL WONTFIX SKIP : svg/custom/svg-disallowed-in-dashboard-object.html = FAIL WONTFIX : fast/canvas/canvas-gradient-addStop-error.html = FAIL // Chrome uses different keyboard accelerators from those used by Safari, so // these tests will always fail. // TODO(ericroman): can the following 2 tests be removed from this list, since they pass? WONTFIX : fast/events/keydown-1.html = FAIL WONTFIX LINUX WIN : fast/events/option-tab.html = FAIL // Chrome does not support WebArchives. BUG10395 WONTFIX SKIP : webarchive/loading = FAIL TIMEOUT BUG10395 WONTFIX : webarchive = PASS BUG10395 WONTFIX : svg/webarchive = FAIL PASS BUG10395 WONTFIX : svg/custom/image-with-prefix-in-webarchive.svg = FAIL BUG10395 WONTFIX : svg/webarchive/svg-feimage-subresources.svg = IMAGE+TEXT BUG10395 WONTFIX SKIP : http/tests/webarchive = FAIL PASS BUG10395 WONTFIX SKIP : svg/webarchive/svg-cursor-subresources.svg = FAIL BUG10395 WONTFIX SKIP : webarchive/test-css-url-resources-in-stylesheets.html = FAIL BUG10395 WONTFIX SKIP : webarchive/test-css-url-resources-inline-styles.html = FAIL // We don't support ACCELERATED_COMPOSITING. Skipping because some tests in this // directory don't have pixel results. BUG15733 WONTFIX SKIP : compositing = FAIL PASS TIMEOUT // Run the Mac-specific platform tests, but only to check for crashes. WONTFIX : platform/gtk = FAIL PASS WONTFIX : platform/mac = FAIL PASS TIMEOUT WONTFIX : platform/mac-leopard = FAIL PASS WONTFIX : platform/mac-tiger = FAIL PASS WONTFIX : platform/qt = FAIL PASS WONTFIX SKIP : plugins/qt-qwidget-plugin.html = FAIL WONTFIX SKIP : platform/mac/fast/text/international/Geeza-Pro-vertical-metrics-adjustment.html = PASS WONTFIX LINUX MAC : platform/win = FAIL PASS // This is a Safari specific test to make WebKit behave like AppKit on the Mac. // We do not support it because PLATFORM(MAC) is not defined for the mac version. WONTFIX MAC : platform/mac/editing/deleting/backward-delete.html = FAIL // Ignored because we do not have OBJC bindings WONTFIX SKIP : editing/pasteboard/paste-RTFD.html = FAIL WONTFIX SKIP : editing/pasteboard/paste-TIFF.html = FAIL WONTFIX SKIP : plugins/jsobjc-dom-wrappers.html = FAIL WONTFIX SKIP : plugins/jsobjc-simple.html = FAIL WONTFIX SKIP : plugins/root-object-premature-delete-crash.html = FAIL WONTFIX SKIP : plugins/throw-on-dealloc.html = FAIL WONTFIX SKIP : plugins/undefined-property-crash.html = FAIL // Uses __apple_runtime_object WONTFIX SKIP : plugins/call-as-function-test.html = FAIL // Ignore test because it tries to load .pdf files in tags. WONTFIX LINUX WIN : fast/images/pdf-as-image-landscape.html = FAIL WONTFIX LINUX WIN : fast/images/pdf-as-image.html = FAIL WONTFIX LINUX WIN : fast/replaced/pdf-as-image.html = FAIL // These tests try to print a PDF file as the expected result. I don't think // we plan on supporting this anytime soon. WONTFIX SKIP : printing/media-queries-print.html = PASS WONTFIX SKIP : printing/compositing-layer-printing.html = PASS // Chrome doesn't call the willCacheResponse callback (a method // of ResourceHandleClient). That function is Mac-specific. WONTFIX SKIP : http/tests/misc/willCacheResponse-delegate-callback.html = FAIL // Checks for very kjs-specific garbage collector // behavior. Gc-9 is completely braindamaged; it tests that certain // properties are reset by the garbage collector. It looks to pass recently. WONTFIX : fast/dom/gc-9.html = FAIL // This test checks that ((new Error()).message is undefined, which is // a direct contradiction of the javascript spec 15.11.4.3 which // says that it must be a string. WONTFIX : fast/js/kde/evil-n.html = FAIL // This test checks that properties of arguments arrays are non-enumerable // which is incorrect according to the ES5 spec. WONTFIX : fast/js/kde/function.html = FAIL // This test is broken. The regular expression used contains an error // which kjs swallows and returns false, which is the expected result, // but for which we issue a syntax error. WONTFIX : fast/js/code-serialize-paren.html = FAIL // These tests check for a kjs-specific extension, that source file // name and line numbers are available as properties on exception // objects. We handle error positions differently. WONTFIX : fast/js/exception-linenums-in-html-1.html = FAIL WONTFIX : fast/js/exception-linenums-in-html-2.html = FAIL WONTFIX : fast/js/exception-linenums.html = FAIL WONTFIX : fast/js/exception-expression-offset.html = FAIL // These tests rely on specific details of decompilation of // functions. V8 always returns the source code as written; there's // no decompilation or pretty printing involved except for // certain "native" functions where the V8 output does not include // newline characters. This is working as intended and we don't care // if the tests pass or fail. (It should probably simply be re-baselined.) WONTFIX : fast/js/function-names.html = FAIL // This test relies on KJS specific implementation // (window.GCController.getJSObjectCount), which we have no intention of // supporting. WONTFIX SKIP : fast/dom/Window/timeout-released-on-close.html = FAIL // These tests expect a tiff decoder, which we don't have. WONTFIX LINUX WIN : fast/images/embed-image.html = FAIL WONTFIX LINUX WIN : fast/images/object-image.html = FAIL // Safari has a unique handling of the BOM characters among browsers. // There is a strong suspicion that this is a security problem, so we // follow the rest of the browsers on this one. WONTFIX : fast/js/removing-Cf-characters.html = FAIL // These tests fail in all but the PST/PDT time zone. // Another reason for failure is that, for compatability, we don't obey // the ECMA standard on DST exactly. We use the OS's facilities to // convert to local time for dates within the UNIX 32-bit epoch, // and follow the ECMA rules for dates outside that range. // The ECMA rules say to use current DST rules for all dates, // and that all dates that are separated by an exact multiple of // 28 years must behave exactly the same. // OS local time services are more accurate than this ECMA rule, // which is a discrepancy. WONTFIX SKIP : fast/js/date-DST-time-cusps.html = PASS FAIL WONTFIX SKIP : fast/js/date-big-setdate.html = PASS FAIL // The following tests fail because of difference in how the test shell // navigation controller tracks navigations as compared to how the Mac // implementation does it. WONTFIX : http/tests/history/redirect-200-refresh-0-seconds.pl = FAIL WONTFIX : http/tests/history/redirect-js-location-replace-0-seconds.html = FAIL WONTFIX DEBUG : http/tests/history/redirect-js-location-replace-2-seconds.html = FAIL WONTFIX LINUX MAC RELEASE : http/tests/history/redirect-js-location-replace-2-seconds.html = FAIL WONTFIX SLOW WIN RELEASE : http/tests/history/redirect-js-location-replace-2-seconds.html = FAIL WONTFIX : http/tests/history/redirect-js-location-replace-before-load.html = FAIL WONTFIX : http/tests/history/redirect-meta-refresh-0-seconds.html = FAIL // This test expects weird behavior of __defineGetter__ on the // window object. It expects variables introduced with 'var x = value' // to behave differently from variables introduced with 'y = value'. // This just seems wrong and should have very low priority. // Agreed, not required for Beta, we can debate this with WebKit post Beta // (eseidel, 4/25) // Ignore this until we see evidence that we need to support it. WONTFIX : fast/dom/getter-on-window-object2.html = FAIL // V8 doesn't stable sort and we currently have no intention of // changing this. It is tracked by: // http://code.google.com/p/v8/issues/detail?id=90 WONTFIX : fast/js/comparefn-sort-stability.html = FAIL WONTFIX : fast/js/sort-stability.html = FAIL // We have no indication that anyone misses this and have currently no // intention of implementing it. WONTFIX : fast/js/function-dot-arguments.html = FAIL // This is a Safari specific test used to document the set of global // constructors they expose and the exact way they are printed. Not // important. WONTFIX : fast/js/global-constructors.html = FAIL // This test is not reliable. The behavior depends on exactly how the // stack limit is reached. We're happy with our behavior on this test // as long as we don't crash. WONTFIX : fast/js/global-recursion-on-full-stack.html = FAIL // Our DOM Storage implementation doesn't use WebKit's private browsing feature (even for incognito mode). BUG30081 : storage/domstorage/localstorage/private-browsing-affects-storage.html = CRASH FAIL WONTFIX : storage/domstorage/sessionstorage/private-browsing-affects-storage.html = FAIL // These tests propagate auth credentials back to the renderer, which we // don't want to do. WONTFIX BUG21840 DEBUG : http/tests/loading/basic-auth-resend-wrong-credentials.html = FAIL WONTFIX BUG21840 LINUX RELEASE : http/tests/loading/basic-auth-resend-wrong-credentials.html = FAIL WONTFIX BUG21840 SLOW WIN RELEASE : http/tests/loading/basic-auth-resend-wrong-credentials.html = FAIL WONTFIX BUG21840 MAC RELEASE : http/tests/loading/basic-auth-resend-wrong-credentials.html = FAIL TIMEOUT WONTFIX BUG21840 WIN DEBUG : http/tests/loading/basic-credentials-sent-automatically.html = FAIL TIMEOUT WONTFIX BUG21840 SLOW WIN RELEASE : http/tests/loading/basic-credentials-sent-automatically.html = FAIL WONTFIX BUG21840 LINUX MAC : http/tests/loading/basic-credentials-sent-automatically.html = FAIL // This checks the IDN behavior of WebKit/WebKit on Mac, not WebKit/WebCore or // WebKit/JavaScriptCore. Chrome doesn't use WebKit/WebKit, and Chrome's IDN // security model is different from it. BUG21814 WONTFIX SKIP: fast/encoding/idn-security.html = FAIL // Our implementation of global history is completely different, and // these tests are irrelevant. BUG23748 WONTFIX : http/tests/globalhistory = FAIL // DataGrid was pulled from HTML5 spec, unlikely to re-emerge in the current form. BUG17585 WONTFIX : fast/dom/HTMLDataGridElement = FAIL // We are not going to support submitting a form to about:* pages. // For more details, see discussions at issue 20570. BUG20570 WONTFIX : fast/forms/get-forms-to-about-blank.html = FAIL // xhtml mp tests were added in http://trac.webkit.org/changeset/43865 and are // skipped on all platforms upstream. // We are not planning to support these. BUG12254 WONTFIX SKIP : fast/xhtmlmp = FAIL // wap css tests were added in http://trac.webkit.org/changeset/43887 and are // skipped on all platforms upstream. // We are not planning to support these. BUG12310 WONTFIX SKIP : fast/wcss = FAIL // This test requires LayoutTestController.setCacheModel, which we don't implement // because we can't emulate the cahcing behaviors it expects. WONTFIX : fast/dom/HTMLScriptElement/nested-execution.html = FAIL // Touch events are not supported. WONTFIX SKIP : fast/events/touch = FAIL // Deletion UI is a Mail-ism. We don't need to worry about this. WONTFIX SKIP : editing/deleting/deletionUI-single-instance.html = FAIL IMAGE WONTFIX SKIP : fast/dom/Element/id-in-deletebutton.html = TEXT // Tests for FAST_MOBILE_SCROLLING. We don't use it. WONTFIX BUG32663 WIN LINUX : fast/fast-mobile-scrolling/fixed-position-element.html = IMAGE+TEXT WONTFIX BUG32663 WIN LINUX : fast/fast-mobile-scrolling/no-fixed-position-elements.html = IMAGE+TEXT WONTFIX BUG32663 MAC : fast/fast-mobile-scrolling/fixed-position-element.html = IMAGE WONTFIX BUG32663 MAC : fast/fast-mobile-scrolling/no-fixed-position-elements.html = IMAGE // ----------------------------------------------------------------- // CHROME REWRITTEN TESTS // ----------------------------------------------------------------- // These tests have been rewritten, with the original being ignored, // because they rely on being able to shadow the 'top' variable on the // global object. For security we disallow shadowing of top. WONTFIX : editing/selection/click-before-and-after-table.html = FAIL // We're taking a different approach on this test than Webkit does, related to // whether we create a window via a plugin when target is _blank. BUG24186 WONTFIX SKIP : plugins/get-url-with-blank-target.html = FAIL // Dashboard-related test WONTFIX SKIP : platform/mac/fast/css/dashboard-region-parser.html = FAIL // Not a test? WONTFIX SKIP : http/tests/incremental/pause-in-script-element.pl = FAIL // This tests for an arbitrary limit set in JSCRE to terminate regular // expressions with an exponential matching behavior. Since the V8 // regular expression engine can be preempted from the outside, we do not // need to limit the execution this way. Firefox also keeps running // on this one. WONTFIX : fast/regex/slow.html = TIMEOUT // Test to verify legacy MAC encodings. We don't want to support them and // have to skip this test. WONTFIX SKIP : fast/encoding/char-decoding-mac.html = FAIL // WebKit QT Build-specific tests WONTFIX SKIP : platform/qt/view/fixed-layout-size.html = FAIL // These don't have pixel results and rely on ObjC bindings. Don't run until they have pixel results. WONTFIX SKIP : platform/mac/editing/pasteboard/dataTransfer-set-data-file-url.html = FAIL WONTFIX SKIP : http/tests/security/dataTransfer-set-data-file-url.html = FAIL // The issue is which global object to use as the implicit // receiver for cross-frame calls. Currently, IE, Firefox and Chrome // agree and only Safari is doing it this way. BUG5053 WONTFIX : fast/frames/cross-site-this.html = FAIL // This tests a Safari incompatibility. This test should fail since // it contains syntax errors that JSC for some reason choose not to // throw. V8 follows the spec. WONTFIX : fast/js/reparsing-semicolon-insertion.html = FAIL // These tests relate to transform/3d which is a work in progress and is not // even run by the WebKit folk. They should be enabled whenever WebKit begins // testing them by default. The bug to re-enable is: // http://code.google.com/p/chromium/issues/detail?id=8455 WONTFIX SKIP : transforms/3d = FAIL // Copying with no selection is sometimes supposed to work // Also skipped by Apple on Windows (rdar://problem/5015941) BUG20404 : editing/execCommand/copy-without-selection.html = FAIL // This is a faulty test and need to change so it works on Windows. // onload race condition due to poorly designed test. // Works fine when run stand-alone. Not needed for Beta. // Also skipped by Apple on Windows, due to intermittent failure // (rdar://5313536) // started WIN only, since r30442 fails on all platforms BUG10270 : fast/dom/frame-loading-via-document-write.html = FAIL // ----------------------------------------------------------------- // LIGHTTPD // ----------------------------------------------------------------- // This are failing for different reasons under our new lighttpd configuration // TODO(deanm): Address all of these via lighttpd if possible, otherwise fork. // Maybe flaky and need to be forked? // LightTPD doesn't accept unknown HTTP methods BUG18978 SKIP : http/tests/xmlhttprequest/methods-lower-case.html = TIMEOUT CRASH BUG18978 DEBUG : http/tests/xmlhttprequest/methods-async.html = TIMEOUT TEXT BUG18978 LINUX MAC RELEASE : http/tests/xmlhttprequest/methods-async.html = TIMEOUT TEXT BUG18978 WIN RELEASE : http/tests/xmlhttprequest/methods-async.html = TIMEOUT TEXT BUG18978 WIN SLOW : http/tests/xmlhttprequest/access-control-basic-allow-preflight-cache-invalidation-by-method.html = FAIL // LightTPD doesn't accept unknown HTTP methods and passes CGIs a Content-Type // even when a request didn't send the header. BUG18978 WIN SLOW : http/tests/xmlhttprequest/methods.html = FAIL BUG18978 LINUX : http/tests/xmlhttprequest/methods.html = FAIL BUG18978 MAC : http/tests/xmlhttprequest/methods.html = FAIL TIMEOUT // Another lighttpd quirk. BUG8941 WIN SLOW : http/tests/xmlhttprequest/web-apps/013.html = FAIL BUG8941 LINUX SLOW : http/tests/xmlhttprequest/web-apps/013.html = PASS BUG8941 MAC DEBUG SLOW : http/tests/xmlhttprequest/web-apps/013.html = FAIL BUG8941 MAC RELEASE : http/tests/xmlhttprequest/web-apps/013.html = FAIL TIMEOUT BUG8941 WIN : http/tests/xmlhttprequest/web-apps/012.html = FAIL // ----------------------------------------------------------------- // TEXT // ----------------------------------------------------------------- // This class of test fails because of size differences in text runs. // Mostly this is because of international text rendering differences. // Incrorect results, in incorrect international font metrics. BUG20521 LINUX WIN : fast/text/atsui-multiple-renderers.html = FAIL BUG20521 LINUX WIN : fast/text/atsui-pointtooffset-calls-cg.html = FAIL TIMEOUT BUG20521 LINUX WIN : fast/text/atsui-rtl-override-selection.html = FAIL // This test checks that we hack around a bug in helvetica. We fail to. BUG20519 LINUX WIN : fast/text/wide-zero-width-space.html = FAIL // More missing international text overides, not needed for Beta. // Capitalization results match Safari, even if "not fully correct" BUG20547 LINUX WIN : fast/text/capitalize-boundaries.html = FAIL // Different button line-heights, our behavior looks wrong. BUG20551 LINUX WIN : fast/replaced/table-percent-height.html = FAIL BUG20551 LINUX WIN : fast/replaced/table-percent-height-text-controls.html = FAIL // ----------------------------------------------------------------- // URL // ----------------------------------------------------------------- // Form submission (GET) on non-standard url does not append a query. // Defering these tests as the expected behavior is wonky, and shouldn't affect // existing apps one way or another. // Implicit expectation in this test is that you can "set query" on a data URL, // and it should replace the first "?" substring. This makes absolutely no // sense. BUG24203 : fast/events/stopPropagation-submit.html = FAIL // ----------------------------------------------------------------- // PENDING TESTS (forked to pending/, need to be sent upstream) // ----------------------------------------------------------------- // These tests don't work with fast timers due to setTimeout // races. See https://bugs.webkit.org/show_bug.cgi?id=21536 BUG24195 WIN LINUX : fast/repaint/bugzilla-6473.html = IMAGE+TEXT BUG24195 MAC : fast/repaint/bugzilla-6473.html = IMAGE // ----------------------------------------------------------------- // Tests deferred until we provide support for a particular feature. // ----------------------------------------------------------------- // ----------------------------------------------------------------- // Tests requiring features not currently in test_shell. // ----------------------------------------------------------------- // These layout tests to see if link colors change after visiting a page. They // does this by using layoutTestController.keepWebHistory() to turn on a // temporary web history. layoutTestController.keepWebHistory() is not // implemented in test shell. // This is a test tool problem, not a Chrome problem. BUG21888 : fast/history/clicked-link-is-visited.html = FAIL BUG21888 : fast/history/subframe-is-visited.html = FAIL // Implement layoutTestController.display() BUG8630 WIN LINUX : fast/repaint/body-background-image.html = FAIL // Relies on text metrics to pass. Rework to be meaningful for ports other than platform/mac. BUG8630 WIN LINUX : fast/repaint/overflow-outline-repaint.html = FAIL BUG8630 WIN LINUX : fast/backgrounds/solid-color-context-restore.html = FAIL BUG8630 WIN LINUX : fast/dynamic/containing-block-change.html = FAIL BUG8630 LINUX : fast/forms/listbox-clip.html = IMAGE+TEXT BUG8630 WIN LINUX RELEASE : fast/overflow/hidden-scrollbar-resize.html = FAIL BUG8630 LINUX WIN DEBUG : fast/overflow/hidden-scrollbar-resize.html = FAIL BUG8630 WIN LINUX RELEASE : fast/reflections/inline-crash.html = FAIL BUG8630 LINUX WIN DEBUG : fast/reflections/inline-crash.html = FAIL BUG8630 WIN LINUX : fast/text/font-initial.html = FAIL BUG8630 LINUX : svg/custom/use-detach.svg = FAIL PASS BUG18772 LINUX : fast/backgrounds/001.html = FAIL // Need to implement layoutTestController.addUserScript. BUG21113 : userscripts/script-run-at-end.html = FAIL // Need a setAuthorAndUserStylesEnabled method in // layoutTestController. Now we have preference to enable/disable user // styles(not work now), we still need to add a preference to enable/disable // styles of both author and user. // Deferring, we don't support user-controlled UA stylesheets (in beta) // Actually, gonna SKIP because it causes an additional error message in: // fast/css/display-none-inline-style-change-crash.html somehow // the message is dumped after the #EOF, which causes an additional // error in the header of the following test. BUG24197 SKIP : fast/css/disabled-author-styles.html = FAIL // ----------------------------------------------------------------- // Other // ----------------------------------------------------------------- // Pixeltest failure: Form control metrics incorrect BUG10273 LINUX : http/tests/navigation/javascriptlink-frames.html = FAIL // Mac Safari under certain circumstances automatically places // a caret in editable document even when none was requested programatically. // We don't intend to copy this feature (at least not for Beta). BUG20844 LINUX WIN RELEASE : editing/selection/designmode-no-caret.html = FAIL BUG20844 LINUX WIN DEBUG : editing/selection/designmode-no-caret.html = FAIL // Directionality of mixed-direction text in selected choice should // match that in the ; various failures, some tests may simply need new // baselines, others have more problems. BUG10473 LINUX : fast/forms/placeholder-pseudo-style.html = FAIL BUG10473 LINUX : fast/forms/placeholder-set-value.html = FAIL BUG10473 LINUX : fast/forms/search-display-none-cancel-button.html = FAIL BUG10473 LINUX : fast/forms/search-placeholder-value-changed.html = FAIL BUG10473 LINUX : fast/forms/searchfield-heights.html = FAIL BUG10473 LINUX : fast/replaced/width100percent-searchfield.html = FAIL // This test isn't just slow -- sometimes it times out indefinitely. BUG27569 MAC WIN DEBUG : http/tests/xmlhttprequest/redirect-cross-origin-tripmine.html = TIMEOUT PASS BUG27569 LINUX MAC WIN RELEASE : http/tests/xmlhttprequest/redirect-cross-origin-tripmine.html = TIMEOUT PASS BUG9613 WIN LINUX : fast/dom/clientWidthAfterDocumentIsRemoved.html = IMAGE+TEXT BUG9613 MAC : fast/dom/clientWidthAfterDocumentIsRemoved.html = TEXT // Merge WebKit 42133:42199 regressions BUG20570 LINUX : fast/events/context-no-deselect.html = FAIL // These tests were affected by rolling out WebKit i8n patches. // Was only WIN, also fail on LINUX since merge 43346:43361 BUG9768 LINUX WIN : fast/forms/select-initial-position.html = FAIL // Was only WIN, also fail on LINUX since merge 43346:43361 BUG9768 LINUX WIN : fast/forms/select-visual-hebrew.html = FAIL // Was only WIN, also fail on LINUX since merge 43346:43361 BUG9768 LINUX WIN : fast/forms/visual-hebrew-text-field.html = FAIL // Linux looks ok, rebaselined. BUG9768 WIN : fast/text/cg-fallback-bolding.html = FAIL BUG9768 WIN : fast/text/international/001.html = FAIL BUG9768 WIN : fast/text/international/002.html = FAIL BUG9768 WIN : fast/text/international/003.html = FAIL BUG9768 WIN : fast/text/international/wrap-CJK-001.html = FAIL // Merge WebKit 42200:42244 regressions BUG9786 : fast/dom/Window/dom-access-from-closure-iframe.html = FAIL BUG9786 : fast/dom/Window/dom-access-from-closure-window.html = FAIL BUG9786 WIN DEBUG : http/tests/security/cross-frame-access-history-prototype.html = FAIL BUG9786 SLOW WIN RELEASE : http/tests/security/cross-frame-access-history-prototype.html = FAIL BUG9786 LINUX MAC : http/tests/security/cross-frame-access-history-prototype.html = FAIL BUG9786 : http/tests/security/cross-frame-access-location-prototype.html = FAIL BUG9786 : http/tests/security/cross-frame-access-document-direct.html = TIMEOUT BUG10479 MAC : svg/hixie/perf/001.xml = FAIL BUG10479 MAC : svg/hixie/perf/002.xml = FAIL BUG9798 SLOW WIN DEBUG : fast/dom/Window/slow_unload_handler.html = PASS BUG9798 LINUX DEBUG SLOW : fast/frames/calculate-round.html = CRASH PASS // Was flaky. Became a consistent failure. BUG9798 WIN DEBUG : fast/replaced/border-radius-clip.html = FAIL BUG9798 SLOW WIN RELEASE : fast/replaced/border-radius-clip.html = FAIL BUG9798 MAC WIN : http/tests/loading/preload-img-test.html = TIMEOUT PASS BUG9798 WIN DEBUG : http/tests/local/style-access-before-stylesheet-loaded.html = FAIL PASS BUG9798 LINUX MAC : http/tests/misc/BOM-override-script.html = TIMEOUT PASS BUG9798 WIN DEBUG : http/tests/misc/redirect-with-quotes.php = TIMEOUT PASS BUG9798 WIN DEBUG : http/tests/misc/refresh-headers.php = TIMEOUT PASS BUG9798 MAC RELEASE : http/tests/misc/refresh-headers.php = TIMEOUT PASS BUG9798 WIN : http/tests/security/cross-frame-access-protocol-explicit-domain.html = FAIL PASS BUG9798 WIN DEBUG : http/tests/security/cross-frame-access-protocol.html = FAIL PASS BUG9798 RELEASE : http/tests/security/dataURL/xss-DENIED-from-data-url-in-foreign-domain-subframe.html = TIMEOUT PASS BUG9798 MAC RELEASE : http/tests/security/xssAuditor/javascript-link-HTML-entities.html = TIMEOUT PASS BUG9798 MAC WIN RELEASE : http/tests/xmlhttprequest/access-control-basic-allow-preflight-cache-timeout.html = PASS TIMEOUT BUG9798 MAC DEBUG : http/tests/xmlhttprequest/access-control-basic-allow-preflight-cache-timeout.html = PASS TIMEOUT BUG9798 SLOW WIN DEBUG : http/tests/xmlhttprequest/basic-auth.html = PASS BUG9798 RELEASE : http/tests/xmlhttprequest/basic-auth.html = TIMEOUT PASS BUG9798 MAC DEBUG : http/tests/xmlhttprequest/basic-auth.html = TIMEOUT PASS BUG9798 MAC RELEASE : http/tests/xmlhttprequest/encode-request-url-2.html = TIMEOUT PASS BUG9798 MAC RELEASE : http/tests/xmlhttprequest/null-auth.php = TIMEOUT PASS BUG9797 BUG9798 WIN RELEASE SLOW : http/tests/xmlhttprequest/state-after-network-error.html = PASS // Occasionally times out. Not just slow. BUG9798 MAC RELEASE : http/tests/xmlhttprequest/state-after-network-error.html = TIMEOUT PASS BUG9797 LINUX DEBUG : svg/carto.net/colourpicker.svg = FAIL BUG9798 LINUX RELEASE : svg/carto.net/colourpicker.svg = FAIL BUG9798 SLOW LINUX : svg/custom/invisible-text-after-scrolling.xhtml = FAIL BUG9798 MAC : svg/custom/use-instanceRoot-as-event-target.xhtml = FAIL BUG9798 LINUX RELEASE : tables/mozilla/bugs/45621.html = FAIL BUG9798 LINUX DEBUG SLOW : tables/mozilla/bugs/45621.html = FAIL //also BUG24868 (crash) BUG9798 LINUX DEBUG : transitions/mask-transitions.html = FAIL PASS BUG9798 LINUX : transitions/shorthand-border-transitions.html = FAIL PASS BUG9798 SLOW LINUX RELEASE : transitions/transition-timing-function.html = PASS // This test definitely times out (i.e. is not just slow). BUG9798 MAC WIN RELEASE : http/tests/xmlhttprequest/small-chunks-response-text.html = PASS TIMEOUT BUG9798 SLOW LINUX RELEASE : http/tests/xmlhttprequest/small-chunks-response-text.html = PASS BUG9798 MAC RELEASE : http/tests/xmlhttprequest/web-apps/003.html = PASS TIMEOUT BUG9798 LINUX DEBUG : fast/forms/listbox-scroll-after-options-removed.html = CRASH PASS BUG9798 LINUX DEBUG : fast/multicol/float-multicol.html = IMAGE PASS BUG9798 LINUX WIN DEBUG : svg/custom/js-update-transform-addition.svg = CRASH PASS BUG9798 MAC RELEASE : editing/selection/drag-in-iframe.html = FAIL PASS BUG9798 LINUX : svg/custom/use-property-changes-through-svg-dom.svg = FAIL BUG9798 LINUX : svg/custom/js-update-transform-changes.svg = FAIL // Occasionally times out. Not just slow. BUG9798 WIN DEBUG : http/tests/loading/redirect-methods.html = TIMEOUT PASS BUG9798 MAC DEBUG : plugins/geturl-replace-query.html = TEXT PASS // This test got considerably more flaky for DEBUG when we switched from // lighttpd to apache on the linux bots. For RELEASE, this was not flaky until // we sharded the http. BUG9798 LINUX : http/tests/multipart/invalid-image-data.html = PASS IMAGE // New tests or failures from WebKit merge 42324:42364. Re-baselined on // Windows. Probably just need the same on other platforms. BUG9962 LINUX : fast/block/positioning/fixed-positioning-scrollbar-bug.html = FAIL BUG9962 MAC : fast/js/function-apply-aliased.html = FAIL // Regressions from WebKit merge 43264:42403, unknown cause(s) BUG10055 MAC : fast/events/updateLayoutForHitTest.html = FAIL // New tests from WebKit Merge 42609:42671 BUG10760 LINUX : fast/forms/input-text-scroll-left-on-blur.html = FAIL BUG10760 LINUX : fast/inline/25277-2.html = FAIL BUG10760 LINUX : fast/inline/25277.html = FAIL BUG10760 LINUX : svg/custom/marker-child-changes.svg = PASS FAIL BUG10760 LINUX : svg/custom/marker-viewBox-changes.svg = FAIL // New failures from WebKit Merge 42671:42725 BUG10861 MAC DEBUG : http/tests/plugins/post-url-file.html = PASS FAIL // New failures from WebKit merge 42725:42805 // WebKit change http://trac.webkit.org/changeset/42785 // added a test which submits a form and then uses history.back() // to go back. in test_shell history.back() does not go back, // so the test timeouts. BUG11001 LINUX MAC WIN : http/tests/history/back-to-post.php = TIMEOUT // Need Linux rebaselines from WebKit Merge 42805:42932 BUG11123 LINUX : editing/inserting/4960120-1.html = FAIL BUG11123 LINUX : fast/forms/textarea-scrollbar.html = FAIL BUG11123 LINUX : fast/forms/textarea-scrolled-type.html = FAIL // Regressions from WebKit Merge 42932:42994 due to text metric changes. BUG11251 WIN DEBUG : fast/forms/textarea-width.html = FAIL BUG11251 SLOW WIN RELEASE : fast/forms/textarea-width.html = FAIL BUG11251 WIN LINUX RELEASE : fast/forms/text-control-intrinsic-widths.html = FAIL BUG11251 LINUX WIN DEBUG : fast/forms/text-control-intrinsic-widths.html = FAIL BUG11251 WIN LINUX : svg/custom/svg-fonts-in-text-controls.html = FAIL BUG11251 WIN LINUX : fast/forms/textarea-metrics.html = FAIL // Unimplemented test shell features causing editing tests to fail // We don't draw the spelling markers at all in test shell. BUG11577 WIN LINUX : editing/spelling/inline_spelling_markers.html = FAIL BUG11577 LINUX : editing/spelling/spellcheck-attribute.html = FAIL BUG11577 WIN LINUX : editing/spelling/spelling-linebreak.html = FAIL // Regresssions from WebKit Merge 43114:43242 that just need to be re-baselined. BUG11483 LINUX : fast/forms/input-text-double-click.html = FAIL BUG11483 LINUX : svg/text/foreignObject-repaint.xml = FAIL // Regressions from WebKit merge 43242:43321. These just need to re-baselining: BUG24229 LINUX : fast/forms/select-dirty-parent-pref-widths.html = FAIL BUG24229 LINUX : svg/transforms/animated-path-inside-transformed-html.xhtml = FAIL BUG24229 LINUX : svg/transforms/text-with-pattern-inside-transformed-html.xhtml = FAIL BUG24229 LINUX : svg/transforms/text-with-pattern-with-svg-transform.svg = FAIL // TODO(erg): Attempted to rebaseline these tests as part of the above // 43346:43361 rebaseling from http://trac.webkit.org/changeset/43355. Turned // tree red. May be more involved then just rebaselining. BUG11613 LINUX : editing/deleting/5168598.html = FAIL BUG11613 LINUX : editing/inserting/5607069-2.html = FAIL // This needs to be rebaselined. See http://trac.webkit.org/changeset/43378 BUG11669 LINUX : fast/layers/remove-only-this-layer-update.html = FAIL // Passes in Chrome, fails in test_shell BUG11795 : http/tests/misc/favicon-as-image.html = FAIL // Already baselined for chromium-win, may need to be done for mac/linux as well. BUG11796 LINUX : fast/forms/search-styled.html = FAIL // Need LINUX/Mac rebaselines after WebKit Update 437150:43770 BUG12053 MAC : editing/execCommand/outdent-blockquote-test1.html = FAIL BUG12053 MAC : editing/execCommand/outdent-blockquote-test2.html = FAIL BUG12053 MAC : editing/execCommand/outdent-blockquote-test3.html = FAIL BUG12053 MAC : editing/execCommand/outdent-blockquote-test4.html = FAIL // Details for all of these are in the bugs. BUG12361 WIN SLOW : http/tests/cookies/double-quoted-value-with-semi-colon.html = FAIL BUG12361 LINUX MAC DEBUG : http/tests/cookies/double-quoted-value-with-semi-colon.html = FAIL BUG12361 LINUX RELEASE : http/tests/cookies/double-quoted-value-with-semi-colon.html = FAIL BUG12361 SLOW MAC RELEASE : http/tests/cookies/double-quoted-value-with-semi-colon.html = FAIL // WebKit 44438:44544 BUG13721 LINUX : fast/dynamic/positioned-movement-with-positioned-children.html = FAIL BUG14207 LINUX : tables/mozilla/bugs/bug28341.html = FAIL BUG32231 MAC DEBUG : tables/mozilla/bugs/bug28341.html = IMAGE // Newly added test http://trac.webkit.org/changeset/44816 BUG18733 WIN SLOW : http/tests/xmlhttprequest/cross-origin-no-authorization.html = FAIL BUG18733 MAC DEBUG : http/tests/xmlhttprequest/cross-origin-no-authorization.html = FAIL TIMEOUT BUG18733 LINUX MAC RELEASE : http/tests/xmlhttprequest/cross-origin-no-authorization.html = FAIL BUG18733 LINUX DEBUG : http/tests/xmlhttprequest/cross-origin-no-authorization.html = FAIL BUG14832 : editing/selection/user-drag-element-and-user-select-none.html = FAIL // WebKit 45017:45086 BUG15217 : fast/js/dictionary-no-cache.html = FAIL BUG15217 MAC : fast/js/switch-behaviour.html = FAIL // WebKit 45086:45111 BUG15270 MAC LINUX RELEASE : fast/js/excessive-comma-usage.html = TEXT BUG15270 MAC LINUX DEBUG SLOW : fast/js/excessive-comma-usage.html = FAIL BUG15270 WIN : fast/js/excessive-comma-usage.html = CRASH FAIL // Flaky for a while; also related to BUG17974 BUG15267 WIN LINUX : transitions/cancel-transition.html = PASS FAIL // WebKit 45431:45444 BUG10384 MAC : fast/events/frame-tab-focus.html = FAIL BUG11613 LINUX : fast/forms/tabbing-input-iframe.html = FAIL BUG11613 LINUX RELEASE : fast/overflow/scrollRevealButton.html = FAIL BUG11613 LINUX DEBUG : fast/overflow/scrollRevealButton.html = FAIL // WebKit tests regressions 20529:20532 BUG16675 MAC : fast/dynamic/flash-replacement-test.html = FAIL // This started crashing regularly as a result of r28798 (see bug 24720). BUG16675 MAC DEBUG : plugins/return-error-from-new-stream-callback-in-full-frame-plugin.html = PASS FAIL // WebKit merge 42738:45840 // New test, needs baseline. BUG16690 SKIP MAC : fast/text/international/khmer-selection.html = FAIL // WebKit merge 42738:45840 // New tests, need baseline. BUG16240 WIN DEBUG : http/tests/cache/subresource-expiration.html = TIMEOUT BUG16240 MAC WIN RELEASE : http/tests/cache/subresource-expiration.html = TIMEOUT BUG16240 MAC DEBUG : http/tests/cache/subresource-expiration.html = PASS TIMEOUT BUG14752 LINUX SLOW : http/tests/cache/subresource-expiration.html = PASS // Failure since WebKit merge 45873:45916 BUG17015 MAC : editing/pasteboard/4242293-1.html = FAIL BUG17015 MAC : editing/pasteboard/4242293.html = FAIL BUG17015 MAC : editing/pasteboard/4944770-1.html = FAIL BUG17015 MAC : editing/pasteboard/drag-drop-modifies-page.html = FAIL BUG17015 MAC : editing/pasteboard/paste-text-001.html = FAIL BUG17015 MAC : editing/pasteboard/paste-text-012.html = FAIL BUG17015 MAC : editing/pasteboard/paste-text-013.html = FAIL BUG17015 MAC : editing/pasteboard/paste-text-014.html = FAIL BUG17015 MAC : editing/selection/4895428-1.html = FAIL BUG17015 MAC : editing/selection/4895428-4.html = FAIL BUG17015 MAC : editing/selection/contains-boundaries.html = FAIL BUG17015 MAC : fast/lists/drag-into-marker.html = FAIL // New tests with WebKit merge 46288:46363 BUG18116 : fast/dom/constructed-objects-prototypes.html = TEXT BUG18116 : fast/dom/prototype-inheritance-2.html = TEXT // New in WebKit r52559 BUG18116 : svg/custom/global-constructors.html = TEXT // Flaky. Timing? BUG18584 LINUX WIN : animations/change-one-anim.html = FAIL PASS BUG18584 WIN DEBUG : animations/play-state.html = FAIL PASS BUG18584 WIN LINUX DEBUG : transitions/shorthand-transitions.html = FAIL PASS BUG18584 WIN DEBUG : animations/combo-transform-translate+scale.html = FAIL PASS BUG18584 LINUX : animations/combo-transform-translate+scale.html = FAIL PASS // Flaky crashes BUG18656 MAC RELEASE : fast/dom/Window/window-lookup-precedence.html = FAIL BUG18656 MAC DEBUG : fast/dom/Window/window-lookup-precedence.html = FAIL // Test failures caused by re-enabling skia asserts. BUG18896 LINUX WIN DEBUG : svg/batik/paints/gradientLimit.svg = TIMEOUT FAIL // Test failures from WebKit merge 46894 to 46977 BUG26737 : fast/js/prototypes.html = FAIL // WebKit roll r47417:47528 BUG19766 LINUX : fast/replaced/width100percent-menulist.html = FAIL // Fails due to textInputController.setInputMethod not implemented for Mac. BUG19665 MAC : platform/mac/editing/input/hangul-enter-confirms-and-sends-keypress.html = FAIL BUG19665 MAC : platform/mac/editing/input/kotoeri-enter-to-confirm-and-newline.html = FAIL // WebKit 47777:47790 - getOwnPropertyDescriptor BUG20345 : fast/js/getOwnPropertyDescriptor.html = FAIL // Failures from Webkit merger 51724 -> 51772 BUG20345 : http/tests/security/cross-frame-access-getOwnPropertyDescriptor.html = TEXT BUG10480 LINUX : editing/selection/move-by-line-001.html = FAIL // MessageEvent.initMessageEvent() does not set the source attribute. BUG23607 : fast/events/init-events.html = FAIL // The linux layout result in build bot shows the changed method does not // executed. BUG21141 LINUX : fast/forms/select-double-onchange.html = FAIL BUG21141 LINUX RELEASE : fast/forms/select-script-onchange.html = FAIL BUG21141 LINUX DEBUG : fast/forms/select-script-onchange.html = FAIL // Flaky, not clear as of when. BUG21411 WIN LINUX DEBUG : svg/dom/SVGScriptElement/script-load-and-error-events.svg = TEXT PASS // WebKit 48217:48239 // Fails because we don't support layoutTestController.addUserStyleSheet(). BUG21439 : userscripts/simple-stylesheet.html = FAIL // WK roll to 48371 BUG21841 MAC DEBUG : plugins/destroy-during-npp-new.html = CRASH PASS BUG21841 WIN DEBUG : plugins/destroy-during-npp-new.html = CRASH PASS BUG25616 WIN : fast/overflow/overflow-float-stacking.html = FAIL // Flaky. The width of containing RenderBlocks sometimes becomes larger BUG21958 MAC : svg/hixie/error/012.xml = FAIL // WebKit merge 48500:48585, newly implemented Object.defineProperty. BUG22526 : fast/js/Object-create.html = FAIL BUG22526 : fast/js/Object-defineProperties.html = FAIL BUG22526 : fast/js/Object-defineProperty.html = FAIL BUG22526 : http/tests/security/xss-DENIED-defineProperty.html = FAIL // WebKit merge 48500:48585, due to newly added support for MathML. BUG22554 SKIP : mathml = FAIL // WebKit update 48796:48820 BUG23956 WIN LINUX : fast/dom/Element/getBoundingClientRect.html = FAIL BUG23956 WIN LINUX : fast/dom/Range/getBoundingClientRect.html = FAIL BUG23956 WIN LINUX : fast/dom/Range/getClientRects.html = FAIL BUG24126 : fast/dom/HTMLInputElement/size-attribute.html = FAIL // Started happening somewhere around http://trac.webkit.org/changeset/48989. BUG23955 LINUX MAC : fast/css/last-of-type-pseudo-class.html = FAIL // Fails since WebKit merge 49321:49372 BUG24331 LINUX : svg/text/text-tselect-02-f.svg = FAIL // WebKit update: 49190:49206 BUG_JPARENT LINUX DEBUG SLOW : fast/frames/calculate-fixed.html = PASS // Started failing for no apparent reason at r28124, and IMAGE+TEXT diffs started at r51875 BUG23972 LINUX : fast/forms/form-element-geometry.html = TEXT // Flaky timeouts first appearing at r27764 (webkit 48947) BUG9798 RELEASE : http/tests/cookies/multiple-cookies.html = TIMEOUT PASS // WebKit update: 49213:49221 BUG24063 : fast/dom/Window/window-postmessage-clone.html = FAIL // Got slow with V8 update to 1.3.15. Debug logging perhaps? BUG24182 DEBUG SLOW : fast/forms/input-implicit-length-limit.html = PASS BUG24182 DEBUG SLOW : fast/forms/input-maxlength.html = PASS // Failing at WebKit Linux (dbg)(3) build 7795 BUG24119 LINUX DEBUG : tables/mozilla/bugs/bug1220.html = PASS FAIL // WebKit roll 49405:49413 BUG28409 : http/tests/xmlhttprequest/logout.html = FAIL BUG24862 LINUX : fast/replaced/border-radius-clip.html = FAIL // WebKit roll 49583:49597 BUG24930 MAC DEBUG : editing/selection/editable-html-element.html = FAIL PASS // WebKit Roll 49597:49640 BUG24966 SLOW MAC DEBUG : fast/frames/calculate-fixed.html = PASS // WebKit Roll 49640:49684 BUG26253 SLOW WIN RELEASE : http/tests/navigation/reload-subframe-object.html = PASS BUG25202 LINUX WIN : svg/W3C-SVG-1.1/masking-path-02-b.svg = FAIL BUG25208 LINUX WIN : svg/W3C-SVG-1.1/masking-path-05-f.svg = FAIL BUG_JEREMY MAC : fast/frames/onlyCommentInIFrame.html = FAIL // WebKit Roll 49684:49761 BUG26042 DEBUG : http/tests/security/mixedContent/insecure-plugin-in-iframe.html = PASS TEXT BUG26042 LINUX RELEASE : http/tests/security/mixedContent/insecure-plugin-in-iframe.html = PASS TEXT // WebKit Roll 49809:49830 // New test flakiness is being observed. BUG26045 MAC RELEASE : fast/frames/frame-set-same-src.html = CRASH PASS BUG26045 LINUX DEBUG : fast/frames/frame-set-same-src.html = CRASH PASS // Incorrect baseline removed. BUG25433 WIN LINUX : css2.1/t040103-ident-03-c.html = IMAGE // WebKit roll 49961:49992 // Added in http://trac.webkit.org/changeset/49990 BUG25884 WIN LINUX : fast/dom/Document/CaretRangeFromPoint/caretRangeFromPoint-in-zoom-and-scroll.html = FAIL BUG26344 LINUX DEBUG : fast/text/atsui-partial-selection.html = CRASH BUG26344 LINUX DEBUG : platform/mac/editing/deleting/backward-delete.html = CRASH // WebKit roll 50073:50101 // Test added by Ryosuke: http://trac.webkit.org/changeset/50090 BUG25889 MAC DEBUG : fast/forms/select-empty-option-height.html = PASS TIMEOUT // More fallout from the above roll. BUG25955 LINUX DEBUG : fast/forms/textarea-placeholder-set-value.html = PASS CRASH BUG_JORLOW LINUX : fast/multicol/column-rules-stacking.html = FAIL // randomly started to be flaky on r30451 (revision had only a check-in of text_expectations.txt) BUG26195 MAC DEBUG : plugins/netscape-plugin-map-data-to-src.html = PASS TEXT BUG26195 MAC DEBUG : plugins/netscape-plugin-setwindow-size.html = PASS TEXT BUG26195 MAC DEBUG : plugins/netscape-plugin-setwindow-size-2.html = PASS TEXT // ==== WebKit roll 50258:50313 ==== BUG26291 MAC : fast/text/atsui-multiple-renderers.html = IMAGE BUG26291 MAC : fast/text/drawBidiText.html = IMAGE BUG26291 MAC : transforms/2d/hindi-rotated.html = IMAGE // Flaky since at least WebKit 50258. BUG9798 WIN DEBUG : media/video-empty-source.html = IMAGE PASS BUG32098 : fast/dom/defaultView.html = TEXT PASS BUG9798 WIN RELEASE : http/tests/navigation/no-referrer-reset.html = TIMEOUT PASS // Webkit 50667:50696 (Lighttpd related?) BUG28417 WIN : http/tests/xmlhttprequest/xmlhttprequest-setrequestheader-no-value.html = TEXT // more test flakiness BUG27334 MAC RELEASE : http/tests/misc/xhtml.php = PASS TIMEOUT BUG27334 MAC : http/tests/security/xssAuditor/object-embed-tag.html = PASS BUG27334 MAC RELEASE : http/tests/xmlhttprequest/re-login-async.html = PASS TIMEOUT BUG27334 MAC DEBUG : plugins/netscape-destroy-plugin-script-objects.html = PASS TEXT BUG27334 MAC DEBUG : plugins/netscape-invoke-failure.html = PASS TEXT // more test flakiness BUG27418 SLOW WIN RELEASE : http/tests/cookies/simple-cookies-max-age.html = PASS BUG27418 SLOW WIN RELEASE : http/tests/misc/url-in-utf16le.html = PASS BUG27418 MAC RELEASE : http/tests/security/xssAuditor/script-tag-with-source-double-quote.html = PASS TIMEOUT BUG27418 MAC RELEASE : http/tests/security/xssAuditor/javascript-link-ampersand.html = PASS TIMEOUT BUG27418 MAC DEBUG : http/tests/security/xssAuditor/post-from-iframe.html = PASS TIMEOUT BUG27418 SLOW MAC RELEASE : http/tests/security/xssAuditor/post-from-iframe.html = PASS BUG27418 MAC DEBUG : http/tests/plugins/interrupted-get-url.html = PASS TEXT BUG27418 MAC RELEASE SLOW : http/tests/plugins/interrupted-get-url.html = PASS BUG27418 MAC DEBUG : plugins/getintidentifier-special-values.html = PASS TEXT BUG27418 MAC DEBUG : plugins/netscape-construct.html = PASS TEXT BUG27418 MAC DEBUG : plugins/netscape-invoke-browserfuncs.html = PASS TEXT BUG27418 MAC DEBUG : plugins/netscape-get-property-return-value.html = PASS TEXT BUG27418 MAC DEBUG : plugins/netscape-throw-exception.html = PASS TEXT BUG27418 MAC DEBUG : plugins/get-url-that-the-resource-load-delegate-will-disallow.html = PASS TEXT BUG27418 MAC DEBUG : plugins/netscape-identifier-conversion.html = PASS TEXT BUG27418 MAC DEBUG : plugins/open-and-close-window-with-plugin.html = PASS TEXT // The following upstream patches add -Webkit-color-correction support: // http://trac.webkit.org/changeset/50760 // http://trac.webkit.org/changeset/50852 // The ColorSpace was only implemented for CG, more port implementation // required in order for Chromium to support color correction. BUG28005 : fast/css/color-correction-backgrounds-and-text.html = FAIL BUG28005 : fast/css/color-correction-on-backgrounds.html = FAIL BUG28005 : fast/css/color-correction-on-text.html = FAIL BUG28005 : fast/css/color-correction.html = FAIL BUG28005 MAC : fast/css/color-correction-on-box-shadow.html = IMAGE BUG28005 WIN LINUX : fast/css/color-correction-on-box-shadow.html = IMAGE+TEXT BUG28005 MAC : fast/css/color-correction-on-text-shadow.html = IMAGE BUG28005 WIN LINUX : fast/css/color-correction-on-text-shadow.html = IMAGE+TEXT // May also be related to r50760, but not as confident. BUG27551 WIN : fast/css/shadow-multiple.html = IMAGE // WebKit merge 50756:50820, possibly due to WebKit r50808/r50786 and Chromium r31715 BUG27553 WIN MAC : fast/text/atsui-partial-selection.html = IMAGE // WebKit merge 50840:50929 BUG27555 : media/media-fullscreen-inline.html = TIMEOUT BUG27555 : media/media-fullscreen-not-in-document.html = TIMEOUT BUG22700 WIN LINUX : fast/canvas/canvas-shadow.html = TEXT // Failures from merge 50972:51042 // The test requires DRT/Test Shell to support error page handling. BUG27850 : fast/history/back-forward-reset-after-error-handling.html = TEXT // Need to update chromium so the web frame delegate is informed when window objects // in isolated worlds are cleared. BUG27849 : http/tests/security/isolatedWorld/didClearWindowObject.html = TEXT // Failures from merge 51062:51075 BUG28034 MAC : http/tests/security/XFrameOptions/x-frame-options-deny.html = PASS FAIL // TODO(michaeln): BUG29748 restore expectation to PASS FAIL after linux is rebaselined // BUG28040 WIN LINUX DEBUG : fast/body-propagation/overflow/004.html = PASS FAIL BUG28040 WIN LINUX DEBUG : fast/body-propagation/overflow/004.html = PASS FAIL IMAGE BUG28041 MAC : storage/domstorage/clear.html = PASS FAIL BUG28074 MAC : http/tests/loading/redirect-with-no-location-crash.html = PASS TIMEOUT BUG28077 MAC : plugins/netscape-invoke-default.html = PASS FAIL BUG28079 LINUX : http/tests/misc/uncacheable-script-repeated.html = PASS TIMEOUT BUG28092 WIN : http/tests/xmlhttprequest/redirect-cross-origin-post.html = PASS FAIL BUG28095 MAC : http/tests/cookies/simple-cookies-expired.html = PASS TIMEOUT // Need to add Chromium localized strings for the feature. Upstream r51172 BUG28264 : fast/forms/validationMessage.html = FAIL // Video Captions are added upsteram (r51191), need to implement. BUG28301 : media/media-captions.html = TIMEOUT // New tests, seems proper drawing method is not implemented in Skia. Upstream r51212. BUG28317 : fast/css/color-correction-on-background-image.html = FAIL BUG28317 : fast/css/color-correction-untagged-images.html = FAIL // Started failing with move from Lighttpd to Apache. // Since we have some bots on Lighttpd and some on Apache, mark it as flaky for // now. Once we decide on one or the other, then we can address these tests. BUG_OJAN MAC LINUX : http/tests/loading/text-content-type-with-binary-extension.html = TEXT BUG_OJAN MAC : http/tests/xmlhttprequest/web-apps/012.html = TEXT BUG_OJAN LINUX : http/tests/xmlhttprequest/cache-override.html = TEXT // Started failing when we started sharding the http and fast directories. // Likely it's because this test depends on some other http test running before // it that no longer does (or vice versa, some other test running before it // is causing it to fail). // Failed only in Release until the 52554->52633 WebKit merge. BUG9798 LINUX : http/tests/security/clipboard/clipboard-file-access.html = TEXT PASS // These tests time out *and* are slow. The test should be fixed to not timeout, // then should be marked as SLOW/PASS. BUG2844 : http/tests/appcache/cyrillic-uri.html = TIMEOUT PASS CRASH BUG2844 : http/tests/appcache/fail-on-update.html = TIMEOUT PASS TEXT BUG2844 : http/tests/appcache/offline-access.html = TIMEOUT PASS CRASH BUG2844 : http/tests/appcache/update-cache.html = TIMEOUT PASS // These tests sometimes pass and sometimes have a text difference due // to chromium's appcache being async. BUG2844 WIN RELEASE : http/tests/appcache/top-frame-3.html = TEXT PASS BUG2844 MAC LINUX : http/tests/appcache/top-frame-3.html = TEXT PASS BUG2844 WIN RELEASE : http/tests/appcache/top-frame-4.html = TEXT PASS BUG2844 MAC LINUX : http/tests/appcache/top-frame-4.html = TEXT PASS // These fail because chromium's appcache is async but webkit's is not. BUG2844 SKIP : http/tests/appcache/idempotent-update.html = FAIL BUG2844 SKIP : http/tests/appcache/top-frame-2.html = FAIL // This test fails because there is no setAppCacheMaximumSize API yet. BUG2844 SKIP : http/tests/appcache/max-size.html = FAIL // Flakiness documented around Webkit Roll 51681:51711 BUG2844 SKIP : http/tests/appcache/404-manifest.html = TIMEOUT PASS BUG2844 SKIP : http/tests/appcache/404-resource.html = TIMEOUT PASS BUG2844 SKIP : http/tests/appcache/foreign-iframe-main.html = TIMEOUT PASS BUG2844 SKIP : http/tests/appcache/non-html.xhtml = TIMEOUT PASS // New tests. Failures from merge 51253:51310. // Needs to implement NPN_reloadPlugins and add reloadPluginNoPages & reloadPluginAndPages // to plugin object. BUG29018 : plugins/reloadplugins-no-pages.html = TEXT BUG29018 : plugins/reloadplugins-and-pages.html = TIMEOUT // New tests. Failures from merge 51210:51325. BUG28646 : editing/selection/transformed-selection-rects.html = FAIL // New failures from merge 51412:51455. BUG28916 MAC : editing/pasteboard/paste-xml.xhtml = IMAGE+TEXT // Flaky test from r51224:r51237 roll. BUG28918 DEBUG : storage/domstorage/localstorage/iframe-events.html = CRASH PASS // New failures from WebKit r51534:r51576 BUG29157 WIN LINUX MAC : svg/animations/animVal-basics.html = TIMEOUT // New failures from WebKit r51577 BUG29164 WIN LINUX MAC : fast/frames/sandboxed-iframe-plugins.html = TEXT // New failures from WebKit merge 51581:51584 BUG29167 MAC : plugins/window-open.html = TEXT PASS BUG29167 MAC : fast/dom/replaceChild.html = IMAGE PASS // Failure from WebKit merge 51607:51613 (51608 is the cause) BUG29239 : fast/css/variables/misplaced-import-test.html = FAIL // Failures from WebKit merge 51618:51642 BUG29344 MAC LINUX : svg/text/text-text-07-t.svg = FAIL // Failures from WebKit merge 51642:51681 // Skip these tests since they all timeout and add ~1 minute to cycle time! BUG29393 SKIP DEFER : fast/loader/stateobjects = TIMEOUT BUG29944 WIN : websocket/tests/unicode.html = TEXT PASS // Failures introduced by USE_NEW_BUILDER in Skia. BUG_SENORBLANCO WIN LINUX : fast/canvas/set-colors.html = TEXT // Failures from WebKit merge 51711:51724 BUG32003 : fast/js/string-property-deletion.html = TEXT BUG31998 LINUX : svg/carto.net/selectionlist.svg = IMAGE PASS BUG31997 DEBUG WIN : fast/body-propagation/overflow/004-xhtml.xhtml = IMAGE+TEXT PASS BUG29943 WIN : websocket/tests/send.html = TEXT PASS // Regression from Webkit merge 51772 -> 51784 BUG_AJWONG MAC LINUX : storage/domstorage/quota.html = CRASH PASS BUG_AJWONG : http/tests/appcache/resource-redirect-2.html = TIMEOUT PASS // Webkit Roll to r51875 BUG29748 LINUX : css1/basic/containment.html = IMAGE BUG29748 LINUX : css1/box_properties/padding_right.html = IMAGE BUG29748 LINUX : css1/font_properties/font_size.html = IMAGE BUG29748 LINUX : fast/block/float/nested-clearance.html = IMAGE BUG29748 LINUX : fast/block/positioning/051.html = IMAGE BUG29748 LINUX : fast/block/positioning/055.html = IMAGE BUG29748 LINUX : fast/forms/select-change-listbox-size.html = IMAGE BUG29748 LINUX : fast/frames/iframe-scrolling-attribute.html = IMAGE BUG29748 LINUX : fast/frames/onlyCommentInIFrame.html = IMAGE BUG29748 LINUX : fast/multicol/positioned-with-constrained-height.html = IMAGE BUG29748 LINUX : fast/repaint/overflow-scroll-delete.html = IMAGE BUG29748 LINUX : http/tests/navigation/error404-frames.html = IMAGE BUG29748 LINUX : http/tests/navigation/post-frames.html = IMAGE BUG29748 LINUX : http/tests/navigation/postredirect-frames.html = IMAGE BUG29748 LINUX : media/video-controls-rendering.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug137388-2.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug2479-1.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug2479-4.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug29314.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug2997.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug32205-2.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug3977.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug43854-1.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug44505.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug650.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug73321.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug96334.html = IMAGE BUG29748 LINUX : tables/mozilla/bugs/bug96343.html = IMAGE BUG29748 LINUX : tables/mozilla/core/captions.html = IMAGE BUG29748 LINUX : tables/mozilla/core/cell_heights.html = IMAGE BUG29748 LINUX : tables/mozilla/marvin/backgr_simple-table-column.html = IMAGE BUG29748 LINUX : tables/mozilla/marvin/backgr_simple-table-row.html = IMAGE BUG29748 LINUX : tables/mozilla/marvin/x_table_bgcolor_rgb.xml = IMAGE BUG29748 LINUX : tables/mozilla/other/nestedTables.html = IMAGE BUG29748 LINUX : tables/mozilla/other/test3.html = IMAGE BUG29748 LINUX : tables/mozilla/other/wa_table_thtd_rowspan.html = IMAGE BUG29748 LINUX : tables/mozilla/other/wa_table_tr_align.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug10140.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug1055-2.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug106966.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug22122.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug2479-5.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug80762-2.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug89315.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug91057.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/core/backgrounds.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/core/captions1.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/core/col_span2.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/marvin/backgr_border-table-row-group.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/marvin/backgr_position-table-cell.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/marvin/backgr_position-table-column-group.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/marvin/backgr_position-table-row.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/marvin/table_overflow_dirty_reflow_row.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/other/empty_cells.html = IMAGE BUG29748 LINUX : tables/mozilla_expected_failures/other/test4.html = IMAGE BUG29748 WIN DEBUG : fast/forms/input-align-image.html = IMAGE+TEXT PASS // More Webkit Roll to r51875 BUG29737 MAC : svg/W3C-SVG-1.1/filters-blend-01-b.svg = IMAGE+TEXT BUG29737 MAC : svg/W3C-SVG-1.1/filters-color-01-b.svg = IMAGE+TEXT BUG29737 MAC : svg/W3C-SVG-1.1/filters-comptran-01-b.svg = IMAGE+TEXT BUG29737 MAC : svg/W3C-SVG-1.1/filters-gauss-01-b.svg = IMAGE+TEXT BUG29737 MAC : svg/W3C-SVG-1.1/filters-morph-01-f.svg = IMAGE+TEXT CRASH BUG29737 MAC : svg/W3C-SVG-1.1/filters-offset-01-b.svg = IMAGE+TEXT BUG29737 MAC : svg/batik/filters/feTile.svg = IMAGE+TEXT BUG29737 MAC : svg/custom/empty-merge.svg = IMAGE+TEXT IMAGE BUG29737 MAC : svg/custom/feComponentTransfer-Discrete.svg = IMAGE+TEXT IMAGE BUG29737 MAC : svg/custom/feComponentTransfer-Gamma.svg = IMAGE+TEXT BUG29737 MAC : svg/custom/feComponentTransfer-Linear.svg = IMAGE+TEXT IMAGE BUG29737 MAC : svg/custom/feComponentTransfer-Table.svg = IMAGE+TEXT BUG29737 MAC : svg/custom/text-filter.svg = IMAGE+TEXT BUG29737 MAC : svg/filters/feComposite.svg = IMAGE+TEXT BUG29737 MAC : svg/filters/feDisplacementMap.svg = IMAGE+TEXT TEXT PASS BUG29737 MAC : svg/filters/feGaussianBlur.svg = IMAGE+TEXT BUG29737 MAC : svg/filters/feTile.svg = IMAGE+TEXT BUG29737 MAC : svg/filters/shadow-on-filter.svg = IMAGE+TEXT BUG29737 MAC : svg/filters/feMerge-wrong-input.svg = TEXT BUG29737 MAC : svg/custom/use-elementInstance-event-target.svg = IMAGE BUG29737 MAC : svg/filters/big-sized-filter.svg = IMAGE+TEXT BUG29737 MAC : svg/filters/filterRes.svg = IMAGE+TEXT BUG29737 MAC : svg/W3C-SVG-1.1/struct-image-02-b.svg = IMAGE BUG29737 MAC : svg/filters/sourceAlpha.svg = IMAGE+TEXT // More Webkit Roll to r51875 BUG32425 : svg/dom/operatorAttribute.html = TEXT BUG32432 LINUX DEBUG : svg/filters/feComposite.svg = TIMEOUT PASS // WebKit Roll to r51915 BUG29930 : fast/loader/input-element-page-cache-crash.html = TIMEOUT PASS // Was first marked as (WIN: TEXT, LINUX: TEXT, MAC: IMAGE+TEXT) by // roll r51875, and then after http://trac.webkit.org/changeset/51936 the // shadows broke so IMAGE failure was added to WIN/LINUX. BUG30048 BUG29737 : svg/filters/shadow-on-rect-with-filter.svg = IMAGE+TEXT // New tests courtesy of: http://trac.webkit.org/changeset/51936: BUG30048 : svg/css/composite-shadow-example.html = IMAGE BUG30048 : svg/css/composite-shadow-with-opacity.html = IMAGE // Broke with http://trac.webkit.org/changeset/51939 BUG30049 : platform/win/editing/selection/doubleclick-should-not-expand-across-lines.html = TEXT MISSING // Flaky. BUG30180 : fast/text/international/hindi-whitespace.html = IMAGE PASS // evan's fix rolled out in http://trac.webkit.org/changeset/52071 due to compat issues. BUG30343 LINUX : fast/css/large-number-round-trip.html = TEXT // These tests got very flaky (failing 8/10 runs!) after // http://src.chromium.org/viewvc/chrome?view=rev&revision=34610 // The only relevant change there is that we now sort tests purely // lexicographically instead of putting the http tests first. This is a good // thing because it matches upstream. The regressions are likely due to timing // issues because the http tests moved from one debug shard to another. // Likely, moving Windows to using Apache2 will fix this as the Linux/Mac builds // did not get flaky here and moving to Apache made the appcache tests less // flaky on those platforms. BUG25977 WIN MAC DEBUG : http/tests/appcache/access-via-redirect.php = TIMEOUT PASS FAIL BUG25977 WIN DEBUG : http/tests/appcache/auth.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/crash-when-navigating-away-then-back.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/different-scheme.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/empty-manifest.html = TIMEOUT PASS // This test is slow on windows, but sometimes times out indefinitely. // See if this improves when we move to apache. BUG25977 WIN : http/tests/appcache/fallback.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/local-content.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/main-resource-hash.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/manifest-containing-itself.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/manifest-parsing.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/manifest-redirect-2.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/manifest-redirect.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/manifest-with-empty-file.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/wrong-content-type.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/wrong-signature.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/online-whitelist.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/top-frame-1.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/whitelist-wildcard.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/resource-redirect.html = TIMEOUT PASS BUG25977 WIN : http/tests/appcache/xhr-foreign-resource.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/simple.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/reload.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/wrong-signature-2.html = TIMEOUT PASS BUG25977 WIN DEBUG : http/tests/appcache/top-frame-4.html = TIMEOUT TEXT PASS BUG25977 WIN DEBUG : http/tests/appcache/top-frame-3.html = TIMEOUT TEXT PASS // Flaky ASSERTION FAILED: currentThread() == m_openingThread // This test is flaky since this file is added. BUG30543 : storage/domstorage/localstorage/enumerate-with-length-and-key.html = CRASH PASS // Flaky. BUG9798 WIN LINUX : fast/loader/javascript-url-encoding-2.html = TIMEOUT PASS BUG9798 RELEASE : fast/loading/subframe-removes-itself.html = TEXT PASS BUG9798 LINUX MAC : fast/loader/invalid-charset-on-script-crashes-loader.html = TIMEOUT PASS BUG9798 MAC RELEASE : fast/borders/block-mask-overlay-image.html = TEXT PASS // Flaky since SVG filters turned on BUG29737 LINUX : svg/filters/feDisplacementMap.svg = TEXT PASS // WebKit update 52293->52323 BUG31253 : http/tests/security/xss-DENIED-assign-location-href-javascript.html = TEXT // WebKit update 52323->52366 BUG30826 WIN : platform/win/fast/events/panScroll-imageMap-noHref-scroll.html = TEXT BUG30826 WIN DEBUG : platform/win/fast/events/panScroll-event-fired.html = PASS TEXT TIMEOUT // Flaky BUG30930 LINUX : tables/mozilla/bugs/bug15933.html = IMAGE PASS BUG31026 MAC DEBUG : http/tests/appcache/crash-when-navigating-away-then-back.html = PASS CRASH // WebKit update 52372->52454 BUG30938 MAC : fast/backgrounds/svg-as-background-6.html = IMAGE BUG30939 : svg/filters/filter-clip.svg = IMAGE+TEXT // Webkit roll 52198->52205 // Newly added test in r52202 BUG30939 : svg/filters/filter-source-position.svg = IMAGE+TEXT // WebKit roll 52468->52535 BUG31991 WIN LINUX : fast/text/international/bidi-layout-across-linebreak.html = TEXT BUG31252 : http/tests/security/listener/xss-inactive-closure.html = TEXT // WebKit roll 52633 -> 52667 // On Linux, sometimes the text dump matches. Not sure why. BUG_DIMICH LINUX : svg/custom/resource-invalidate-on-target-update.svg = IMAGE+TEXT IMAGE BUG31623 WIN: http/tests/appcache/remove-cache.html = PASS TEXT TIMEOUT // WebKit roll 52769 -> 52793 BUG31642 WIN MAC DEBUG: svg/W3C-SVG-1.1/animate-elem-30-t.svg = CRASH PASS BUG31642 LINUX DEBUG: svg/W3C-SVG-1.1/animate-elem-30-t.svg = IMAGE+TEXT CRASH // WebKit roll 52852 -> 52867 BUG32018 : websocket/tests/frame-lengths.html = PASS TIMEOUT BUG32018 DEBUG : websocket/tests/simple-stress.html = PASS TEXT // Flaky crash BUG31794 WIN MAC : storage/domstorage/localstorage/enumerate-storage.html = CRASH PASS // Flaky BUG31803 LINUX : editing/inserting/12882.html = IMAGE PASS // from http://trac.webkit.org/changeset/53078 BUG32154 LINUX DEBUG : fast/text/find-kana.html = CRASH // from http://trac.webkit.org/changeset/53086 BUG32153 : svg/dynamic-updates/SVGTextElement-svgdom-rotate-prop.html = TEXT // a bunch of tests broken before the flakiness fix, i will deal with these // after the major flakiness goes away BUG32155 : fast/js/Object-getOwnPropertyNames.html = TEXT BUG32155 : http/tests/security/cross-frame-access-enumeration.html = TIMEOUT BUG32157 : storage/multiple-databases-garbage-collection.html = CRASH PASS // New flakiness? BUG32144 WIN RELEASE : svg/webarchive/svg-script-subresouces.svg = CRASH TEXT PASS BUG32145 WIN : animations/3d/transform-origin-vs-functions.html = TEXT PASS BUG32149 WIN RELEASE : fast/dom/Document/early-document-access.html = TIMEOUT PASS BUG32195 : fast/repaint/renderer-destruction-by-invalidateSelection-crash.html = IMAGE+TEXT PASS BUG32201 LINUX DEBUG : fast/text/atsui-spacing-features.html = IMAGE+TEXT // Expectations from roll to 53171:53194 BUG32206 LINUX MAC : storage/database-lock-after-reload.html = PASS FAIL CRASH BUG32235 LINUX DEBUG : svg/W3C-SVG-1.1/filters-diffuse-01-f.svg = PASS TEXT // Errors from roll from 53207:53246 BUG32396 LINUX : storage/transaction-error-callback.html = TEXT PASS BUG32398 MAC : svg/custom/resource-invalidate-on-target-update.svg = IMAGE PASS // Bugs from rolling from 53275:53289 BUG32307 WIN : fast/css/non-standard-checkbox-size.html = IMAGE+TEXT BUG32308 DEBUG : fast/frames/cached-frame-counter.html = TIMEOUT // WebKit roll: 53290:53313 BUG32339 LINUX : fast/dom/Window/window-lookup-precedence.html = TEXT PASS // New flakyness ? BUG32306 MAC DEBUG: svg/hixie/error/004.xml = CRASH PASS BUG32516 WIN : tables/mozilla_expected_failures/core/backgrounds.html = CRASH PASS BUG32518 WIN : editing/unsupported-content/list-delete-001.html = CRASH PASS BUG32572 WIN : svg/hixie/mixed/003.xml = CRASH PASS // WebKit roll: 53314:53340 BUG53331 MAC : fast/gradients/simple-gradients.html = FAIL BUG53331 MAC : fast/gradients/border-image-gradient.html = FAIL BUG53331 : fast/gradients/border-image-gradient-sides-and-corners.html = FAIL // WebKit roll 53341:53451 BUG32670 LINUX : fast/css/zoom-body-scroll.html = TEXT BUG32671 WIN LINUX MAC : fast/dom/Window/timer-null-script-execution-context.html = TEXT BUG32673 WIN LINUX : fast/forms/textarea-scrollbar-height.html = TEXT BUG32674 WIN LINUX MAC : http/tests/security/setDomainRelaxationForbiddenForURLScheme.html = TEXT BUG32675 LINUX : fast/repaint/trailing-floats-root-line-box-overflow.html = IMAGE BUG32676 WIN LINUX MAC : http/tests/appcache/destroyed-frame.html = CRASH // WebKit roll 53452:53511 BUG32664 WIN DEBUG : http/tests/security/view-source-no-refresh.html = TIMEOUT BUG32665 WIN DEBUG : media/video-source-error-no-candidate.html = TIMEOUT BUG32695 WIN : transitions/shorthand-border-transitions.html = TEXT // Flaky tests found during the roll. BUG32679 LINUX DEBUG : http/tests/navigation/lockedhistory-iframe.html = TEXT PASS BUG32680 LINUX DEBUG : svg/filters/big-sized-filter.svg = IMAGE+TEXT TIMEOUT PASS BUG32682 LINUX DEBUG : svg/W3C-SVG-1.1/filters-conv-01-f.svg = TEXT PASS BUG32683 LINUX DEBUG : svg/css/glyph-orientation-rounding-test.xhtml = TEXT PASS BUG32684 WIN DEBUG : inspector/timeline-layout.html = TEXT PASS BUG32685 WIN DEBUG : storage/statement-error-callback.html = TEXT PASS BUG32686 WIN DEBUG : fast/block/margin-collapse/block-inside-inline/006.html = CRASH PASS BUG32687 WIN DEBUG : storage/close-during-stress-test.html = CRASH PASS BUG32688 MAC DEBUG : fast/lists/inlineBoxWrapperNullCheck.html = TEXT PASS BUG32689 MAC DEBUG : http/tests/security/mixedContent/about-blank-iframe-in-main-frame.html = TEXT PASS BUG32690 MAC DEBUG : plugins/plugin-remove-subframe.html = TEXT PASS BUG32691 MAC DEBUG : svg/batik/text/textEffect.svg = TEXT PASS BUG32692 MAC DEBUG : svg/custom/visibility-override-filter.svg = TEXT PASS BUG32693 MAC DEBUG : svg/dom/SVGRectElement/rect-modify-rx.svg = TEXT PASS BUG32666 MAC DEBUG : svg/custom/use-detach.svg = IMAGE PASS BUG_DPRANKE WIN : fast/media/lifetime.html = PASS TIMEOUT BUG_DPRANKE WIN : storage/domstorage/sessionstorage/delete-removal.html = PASS CRASH // WebKit roll 53585 -> 53655 BUG32863 WIN LINUX MAC : websocket/tests/url-no-trailing-slash.html = TEXT BUG32864 WIN LINUX MAC : plugins/mouse-events-fixedpos.html = TEXT // WebKit roll 53655 -> 53704 BUG32898 WIN LINUX MAC : fast/loader/history-forward-in-head.html = TEXT BUG32900 WIN LINUX : http/tests/misc/slow-loading-mask.html = IMAGE+TEXT