diff options
author | pamg@google.com <pamg@google.com@0039d316-1c4b-4281-b951-d872f2087c98> | 2008-12-09 20:29:09 +0000 |
---|---|---|
committer | pamg@google.com <pamg@google.com@0039d316-1c4b-4281-b951-d872f2087c98> | 2008-12-09 20:29:09 +0000 |
commit | 618cba91ca65ff2d2fb69f4145ac126ebd43608d (patch) | |
tree | 7d39e26531bddcf1948370ecad6e4cf8a1700c25 | |
parent | ec64941566dd392c05f1f382b0a79a8d4b2435f9 (diff) | |
download | chromium_src-618cba91ca65ff2d2fb69f4145ac126ebd43608d.zip chromium_src-618cba91ca65ff2d2fb69f4145ac126ebd43608d.tar.gz chromium_src-618cba91ca65ff2d2fb69f4145ac126ebd43608d.tar.bz2 |
Update README to describe new test-file format.
BUG=none
TEST=none
Review URL: http://codereview.chromium.org/13631
git-svn-id: svn://svn.chromium.org/chrome/trunk/src@6616 0039d316-1c4b-4281-b951-d872f2087c98
-rw-r--r-- | webkit/tools/layout_tests/test_lists/README | 58 |
1 files changed, 28 insertions, 30 deletions
diff --git a/webkit/tools/layout_tests/test_lists/README b/webkit/tools/layout_tests/test_lists/README index 985ebe2..19b9b73 100644 --- a/webkit/tools/layout_tests/test_lists/README +++ b/webkit/tools/layout_tests/test_lists/README @@ -1,33 +1,31 @@ -The files in this directory are read by the -run_webkit_tests.py script and used to determine which tests to run -and which failures to consider regressions. - -If we *never* expect to pass these tests (e.g. test for Apple's objective-c -API), then add them to tests_ignore.txt. If we expect that we might ever want to -pass the test, first file a bug, then add it to tests_fixable.txt. - -Tests can have the following metatdata associated with them (optional): -DEFER : We don't expect to pass them in the current release. -SKIP : We don't want to run them (perhaps because they take too long). - -Tests have a build-type (required): -V8 # The test only fails in V8 build. -KJS # The test only fails in KJS build. - -Tests can also have expections (required): -PASS -FAIL -TIMEOUT -CRASH - -The format of a test is as follows: -BUILD_TYPE # METADATA : TEST = EXPECTATIONS - -For example -V8 # DEFER : LayoutTests/media = PASS | FAIL - -The above means that in the V8 build, all the media tests are flaky and -we'll defer fixing them for a future release. +The files in this directory are read by the run_webkit_tests.py script +and used to determine which tests to run and which failures to +consider regressions. + +If we *never* expect to pass a test (e.g. a test for Apple's Objective-C API), +then add it to tests_ignore.txt. If we might ever want to pass the test, first +file a bug, then add it to tests_fixable.txt. + +Tests can have any combination of the following metadata associated with +them (optional): + SKIP : We don't want to run the test (perhaps because it hangs). + DEBUG : Expectations apply only to the Debug build. + RELEASE : Expectations apply only to the Release build. + LINUX/WIN/MAC: Expectations apply only to the listed platform(s). + +Tests can also have one or more expectations (required): + PASS + FAIL + TIMEOUT + CRASH + +The format of a test line is as follows: +METADATA : relative/path/to/test.html = EXPECTATIONS + +For example, +LINUX : LayoutTests/media = PASS FAIL + +The above means that all the media tests are flaky, but only on Linux. Note that tests_fixable.txt and tests_ignored.txt aren't allowed to share any lines. Except for skipped tests, all tests are run. In calculating success |