summaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorpamg@google.com <pamg@google.com@0039d316-1c4b-4281-b951-d872f2087c98>2008-12-09 20:29:09 +0000
committerpamg@google.com <pamg@google.com@0039d316-1c4b-4281-b951-d872f2087c98>2008-12-09 20:29:09 +0000
commit618cba91ca65ff2d2fb69f4145ac126ebd43608d (patch)
tree7d39e26531bddcf1948370ecad6e4cf8a1700c25
parentec64941566dd392c05f1f382b0a79a8d4b2435f9 (diff)
downloadchromium_src-618cba91ca65ff2d2fb69f4145ac126ebd43608d.zip
chromium_src-618cba91ca65ff2d2fb69f4145ac126ebd43608d.tar.gz
chromium_src-618cba91ca65ff2d2fb69f4145ac126ebd43608d.tar.bz2
Update README to describe new test-file format.
BUG=none TEST=none Review URL: http://codereview.chromium.org/13631 git-svn-id: svn://svn.chromium.org/chrome/trunk/src@6616 0039d316-1c4b-4281-b951-d872f2087c98
-rw-r--r--webkit/tools/layout_tests/test_lists/README58
1 files changed, 28 insertions, 30 deletions
diff --git a/webkit/tools/layout_tests/test_lists/README b/webkit/tools/layout_tests/test_lists/README
index 985ebe2..19b9b73 100644
--- a/webkit/tools/layout_tests/test_lists/README
+++ b/webkit/tools/layout_tests/test_lists/README
@@ -1,33 +1,31 @@
-The files in this directory are read by the
-run_webkit_tests.py script and used to determine which tests to run
-and which failures to consider regressions.
-
-If we *never* expect to pass these tests (e.g. test for Apple's objective-c
-API), then add them to tests_ignore.txt. If we expect that we might ever want to
-pass the test, first file a bug, then add it to tests_fixable.txt.
-
-Tests can have the following metatdata associated with them (optional):
-DEFER : We don't expect to pass them in the current release.
-SKIP : We don't want to run them (perhaps because they take too long).
-
-Tests have a build-type (required):
-V8 # The test only fails in V8 build.
-KJS # The test only fails in KJS build.
-
-Tests can also have expections (required):
-PASS
-FAIL
-TIMEOUT
-CRASH
-
-The format of a test is as follows:
-BUILD_TYPE # METADATA : TEST = EXPECTATIONS
-
-For example
-V8 # DEFER : LayoutTests/media = PASS | FAIL
-
-The above means that in the V8 build, all the media tests are flaky and
-we'll defer fixing them for a future release.
+The files in this directory are read by the run_webkit_tests.py script
+and used to determine which tests to run and which failures to
+consider regressions.
+
+If we *never* expect to pass a test (e.g. a test for Apple's Objective-C API),
+then add it to tests_ignore.txt. If we might ever want to pass the test, first
+file a bug, then add it to tests_fixable.txt.
+
+Tests can have any combination of the following metadata associated with
+them (optional):
+ SKIP : We don't want to run the test (perhaps because it hangs).
+ DEBUG : Expectations apply only to the Debug build.
+ RELEASE : Expectations apply only to the Release build.
+ LINUX/WIN/MAC: Expectations apply only to the listed platform(s).
+
+Tests can also have one or more expectations (required):
+ PASS
+ FAIL
+ TIMEOUT
+ CRASH
+
+The format of a test line is as follows:
+METADATA : relative/path/to/test.html = EXPECTATIONS
+
+For example,
+LINUX : LayoutTests/media = PASS FAIL
+
+The above means that all the media tests are flaky, but only on Linux.
Note that tests_fixable.txt and tests_ignored.txt aren't allowed to share any
lines. Except for skipped tests, all tests are run. In calculating success