Building Test cases list

Hi,

I have started to add in a number of our test cases a "description"
file, which is a simple plain text description of what's the test case
is supposed to illustrate, e.g.:
http://dev.w3.org/2007/mobileok-ref/test/data/ROOT/ExternalResourcesTest/2/description

The goal is to be able to generate a full list of our test cases à la:
http://dev.w3.org/2007/mobileok-ref/test/list.xml
which will be used to generate a report on our coverage with the
checker, that will serve as a basis for the approval of the checker as a
reference implementation (per my ACTION-609).

While reviewing the already described test cases, I found quite a few
cases where the expected results were in discordance with what the test
case was supposed to illustrate - I'm hoping to automate the discovery
of these discordances even further once we have these descriptions
uniformly done. I fixed a number of those, but for instance, I found a
bug in our implementation of MEASURES that isn't fixed yet:
http://www.w3.org/Bugs/Public/show_bug.cgi?id=5369

I plan to continue on adding these descriptions during this week - but
feel free to beat me to it ;). In any case, please do add such a
description file when adding new test cases to the test suite.

Dom

Received on Tuesday, 15 January 2008 17:16:21 UTC