How to run the tests

This page tells you how to score the i18n tests and send in the results so that they can be added to the results summary pages.

Follow the steps below:

  1. Click on the button Score.
    You will see a new Show results button appear. You can ignore this for now. You should also find the following buttons at the top of the page: Pass, Fail, Partial, Skip, and a pulldown selector.

  2. Select a browser using the pulldown selector.
    You should select the name of the browser on which you are currently running the tests. If you select, say, Firefox, this will be appropriate for any version of the Firefox browser and on any platform. Those details will be captured by the test runner. That said, we prefer to limit testing to recent versions of a browser (but only released versions, not nightlies). Note that we have separate entries for browsers such as Chrome and Opera, even though they use the same engine, since there are often differences in feature support.
    If you don't see the name of the browser you want to test, select Other, but be sure to let us know what browser this is when sending in your results (see below). Note that we have limited space, so we only want to test browsers with high distribution levels or special relevance to a particular international market (see something like StatCounter for ideas).

  3. Once you are looking at the test or the first of the tests you want to score, click on Pass, Fail, Partial or Skip to record the outcome of the test.
    Partial is used where the test is composed of smaller items, and only some of those fail (eg. testing for all the codes in a codepage).
    The test runner will automatically move to the next test in its list when you click on one of those buttons. (You can go to specific tests using the pull-down selector at the top right of the page.)

  4. Once you have provided results for all the tests you want to, click on the Show results button at the bottom of the page.
    A text box will open below the button, containing a summary of the results. It is already highlighted to make copying easier.

  5. Take a copy of the results and mail them to Richard Ishida (ishida@w3.org).
    Richard will integrate the results into the appropriate results page.
    If you selected Other from the browser selector, please indicate in the email what browser this is for. (If it is a new browser, Richard will need to add some details to the test results code.) Note that if you are planning to test a new browser it may be best to contact Richard before scoring the tests, just in case.