W3C

- DRAFT -

WoT Testing

29 Nov 2018

Attendees

Present
Kaz_Ashimura, Michael_McCool, Dave_Raggett, Ege_Korkan, Taki_Kamiya, Tomoaki_Mizushima
Regrets
Chair
McCool
Scribe
TK

Contents


<scribe> Scribe: TK

<scribe> ScribeNick: taki

Status

McCool: I did merge changes on main in TD.
... including scripts in main repo.
... goal is making progress.

McCool is showing report.html

McCool: I merged PRs.

<McCool> https://github.com/w3c/wot-thing-description/pull/294

McCool: One is 294.
... and 309. Scripts to merge test results.

<McCool> https://github.com/w3c/wot-thing-description/pull/309

McCool: updated report was also checked in.
... panasonic, intel and siemens descriptions are available.

Dave: mine is available. I put it into a directory.

McCool: I will grab it and merge it.

Dave: Thanks.

McCool: I made the report.html at the top level. I moved around files.
... Dave has 2. Client and hub

<kaz> https://w3c.github.io/wot-thing-description/testing/report.html

Dave: an implementation report from W3C/ERCIM as part of the F-Interop work.

McCool: Impl.csv lists all implementations.

Dave: ERCIM is the appropriate name as contributor according to the agreement.

McCool is adding impl-ercim-arena-client and impl-ercim-arena-webhub to the csv.

<kaz> https://w3c.github.io/wot-thing-description/testing/report.html

Kaz: Can we use GitHub rendered version?

McCool switching to w3c.github.io rendered version....

McCool adding a rendered version to README.md

McCool: We need to go through the assertion list
... How to test each assertion

McCool is editing testspec.html...

McCool showing "Test Specifications"...

McCool: td-vocabulary. generic assertion.
... TD needs to be valid.
... What the client expects. Client needs to detect errors.

Dave: It is syntax test, then.

McCool: There are many sub-assertions.
... Security syntax is more complicated.

McCool is editing td-vocab in testspec.html....

Dave: What about behaviour?

Kaz: From process's viewpoint, implementability of the specification needs to be tested. Datamodel and syntax of TD instead of behaviours.

Dave: I disagree. Syntax is one. Behaviour needs to be tested as well.

McCool: The list contains both.

Kaz: TD spec is about data-model. Theoretically, CR-exit criteria is vocabulary and syntax.

McCool: Let's get syntax stuff done in the list first.
... We need to discuss them one by one.
... td-unique-identifiers.
... name-value pairs, all ids must be unique.

Ege: We can test it with a JSON-Schema rule.
... with "unique" (or similar) constraint.

McCool: A specialized JSON schema will be written that checks this condition.

Ege: The JSON Schema can also check other assertions.

<kaz> Kaz: btw, I was wondering about the relationship between this Appendix A (test specifications) and the main assertion table

<kaz> McCool: the text within Appendix A will be brought back to the assertion table. the point here at Appendix A is "test specification text"

McCool: td-jsonld-keywords.
... this is about "MAY"

Ege: @context cannot be a number, for example.
... It has to be JSON-LD keywords.
... @context has to be string.
... It cannot be numbers, booleans, etc.

Dave: The spec should say TD is a valid JSON-LD.

McCool: "td-context" restricts it.
... "td-context" can be considered as a parent.

Ege: TD should be validated by JSON-LD checker.

Kaz: Given the spec text (section 6.1.1) which caused this assertion, we should say something like:
[[
The root object of a TD instance MAY include the @context name from JSON-LD 1.1.
and
If it includes @context, the value MUST be (or MUST include) "http://www.w3.org/ns/td".
]]

Dave: We should collect comments and take it to TD meeting.

McCool: td-string-type.
... for example, type associated in tables. data model value serialized to JSON string.

Ege: "type", "number", etc.

McCool: This is a bit ambiguous.

McCool is looking at TD spec. contentType has Type string.

McCool: contentType value is string.

<kaz> https://w3c.github.io/wot-thing-description/

Dave: JSON names are strings as well.

McCool: assertion needs to re-worded.
... should probably be "vocabulary terms that identify values that use simple types..."
... this rule may be included in more general rules.
... values associated with vucabulary terms MUST have the given type...
... same same applies to td-integer-type etc. as well.
... We agree that we can validate with JSON-Schema, right?

Ege: Yes.

McCool: td-context. if you have it, it MUST be of the value "http://www.w3.org/ns/td".
... assertion should be revised that way.
... the value can be an array, and one of the value MUST be that.
... assuming this is what is meant, it can be checked with JSON schema.
... we should prototype 4 or 5 of this kind of tests.

Dave: What does this have to do with implementation report?

McCool: we check each implementation against each test.
... each implementation shows pass/fail/no-impl.
... generator collects all of them.

<kaz> kaz: we should be clear that schema itself is not part of the TD spec

<kaz> McCool: right

McCool: I did my part on test merger.
... We can show ambiguities etc to TD meeting.

Ege: I will do my part.

McCool: 3 or 4 cases will be enough before the meeting.
... We meet again next week.

<kaz> [adjourned]

Summary of Action Items

Summary of Resolutions

[End of minutes]

Minutes manually created (not a transcript), formatted by David Booth's scribe.perl version 1.154 (CVS log)
$Date: 2018/12/02 08:23:04 $