W3C

– DRAFT –
WoT Testfest - Day 3

05 October 2022

Attendees

Present
Daniel_Peintner, Ege_Korkan, Fady_Salama, Kaz_Ashimura, Kunihiko_Toumura, Michael_Lagally, Michael_McCool, Sebastian_Kaebisch, Tomoaki_Mizushima
Regrets
-
Chair
McCool
Scribe
Ege, kaz

Meeting minutes

Agenda

<kaz> agenda for today

McCool: anything to add?

PRs

PR 417

McCool: there is a pr but it is still failing

<kaz> PR 417 - adding TD with async action

<kaz> Validation errors

McCool: the errors are difficult to understand

Ege: it seems that the json is invalid

McCool: we can merge it once that is fixed

PR 409

<kaz> PR 409 - Change procedure to include Consumers

McCool: I have thought about this, I think that we do not have time

Lagally: how was behavior testing done in TD?

McCool: we are over our deadline

McCool: we can add this to our new charter

Ege: my question is about how to handle the Consumer implementations
… how to manage actions, etc.
… we've not had discussion on how to test WoT Profile
… so wondering how to tackle this point

McCool: we do not do testing for security
… so that should be cleaned up

Ege: I think that profile spec should not be tested like we test the TD. Profile has specific assertions on the consumer behavior

Lagally: I understand the concerns. How should we do it though? A concrete proposal would be appreciated

kaz: I'd like to suggest again that we should clarify our policy on how to test Profile and Architecture first to avoid this kind of discussion repeatedly everyday

<sebastian> +1

McCool: do we agree that we should clarify testing of profiles

Ege: I can say that we have never tested profiles in a plugfest. There were some TDs submitted but I do not remember people using these TDs and experimenting with them
… I agree with kaz that we should clarify that
… and this PR was my proposal on how to test profiles

McCool: We can add another column to indicate whether an implementation is a producer or consumer

Lagally: that sounds good

Lagally: I think we can have 2 producer and 2 consumer implementations and do pairwise and cross pairwise testing

Lagally: that should satisfy the requirements

McCool: that sounds good, also for TD spec this makes sense

<mlagally> I agree that we also should apply the same methodology to TD testing

<kaz> McCool's comments for PR 409

Ege: the implementation descriptions do not say something about whether they are profile implementations (producer or consumer)

McCool: yes, we were not clear about that terminology

McCool: we should test profiles in a matrix but that might complicated with multiple profiles

kaz: I agree

Ege: did you merge the ditto PR?

McCool: yes, so that I can prepare for this meeting

PR 420

<kaz> wot-architecture PR 849 - Oct 2022 Testfest Updates to Implementation Report

<kaz> Draft Implementation Report

<kaz> PR 420 - Reorganize Files

McCool: I have reorganized the files via PR 420 Reorganize Files
… I had to change the ids of some TDs

TD Implementation Report

<kaz> wot-thing-description PR 1706 - Oct 2022 Testfest Updates to Implementation Report

<kaz> Draft Implementation Report

McCool: some tm optional features are fixed

Ege: for the tm versioning, I have created a PR to fix it in the TD spec. I will propagate the changes to the playground once merged

<kaz> merged https://github.com/w3c/wot-thing-description/pull/1709

McCool: there are two assertions that seem to be broken

McCool: ege can you fix all the "all red" assertions

McCool: we have some assertion that have a single implementation

McCool: we need someone to put name in the basic security

McCool: you can see how to do it at intel nodejs implementation

<kaz> Intel's node.js implementation

Daniel: I can look into our examples and add it

McCool: we can leave the uri scheme to the PR transition, I can do it

McCool: we need client flow for oauth2

McCool: we also need the device flow but that is an odd one
… I do not care if we lose it

<kaz> PR 849 - Oct 2022 Testfest Updates to Implementation Report

<kaz> Draft Implementation Report

McCool: we are missing half of the implementations

McCool: I think we can spend half of the call tomorrow to go over the red ones

<kaz> node-wot TDs

Ege: I think that we need more and different submissions from people if we are going to test individual things instead of codebases

Daniel: we need to clarify the perspective before answering the questions
… also suppliying manual.csv for each thing would be too complicated

<kaz> Architecture Results of node-wot.csv

Lagally: I have fixed the problems in the PRs before, so they can be merged

McCool: I will merge PR 417 and 421

<kaz> PR 417 - adding TD with async action

<kaz> PR 421 - Schema Fixes to WoTWebThing+problemDetails.td.jsonld

McCool: I will update the reports accordingly

<kaz> [adjourned]

Minutes manually created (not a transcript), formatted by scribe.perl version 192 (Tue Jun 28 16:55:30 2022 UTC).

Diagnostics

Succeeded: i|anything|-> https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf#Agenda_05.10.2022 agenda for today|

Succeeded: i|the err|-> https://github.com/w3c/wot-testing/actions/runs/3189290875/jobs/5202929352 Validation errors|

Succeeded: i|have t|-> https://github.com/w3c/wot-testing/pull/409 PR 409 - Change procedure to include Consumers|

Succeeded: s/ack//

Succeeded: i/my question/scribenick: kaz/

Succeeded: i/we do not/scribenick: Ege/

Succeeded: i/I'd/scribenick: kaz/

Succeeded: s/kaz: I have mentioned on Monday that we should clarify the procedure for testing profile and architecture//

Succeeded: s/topic: PR 409/subtopic: PR 409/

Succeeded: s/topic: Architecture Implementation Report/topic: PRs/

Succeeded: s/topic: Architecture Implementation Report/topic: PRs/

Succeeded: s/topic: PRs/topic: Architecture Implementation Report/

Succeeded: i|I have reorganized the files|-> https://github.com/w3c/wot-architecture/pull/849 wot-architecture PR 849 - Oct 2022 Testfest Updates to Implementation Report|

Succeeded: i|I have reorganized the files|-> https://cdn.statically.io/gh/w3c/wot-architecture/b7f2c34e43be57fc30761073b9e15f8342a790fc/testing/report11.html Draft Implementation Report|

Succeeded: i|some tm optional|-> https://github.com/w3c/wot-thing-description/pull/1706 wot-thing-description PR 1706 - Oct 2022 Testfest Updates to Implementation Report|

Succeeded: i|some tm optional|-> https://cdn.statically.io/gh/w3c/wot-thing-description/1d08866097e9347b8f01a885fb1a82e73a3758f4/testing/report11.html Draft Implementation Report|

Succeeded: s|merged https://github.com/w3c/wot-thing-description/pull/1709||

Succeeded: i|there are two|merged https://github.com/w3c/wot-thing-description/pull/1709|

Succeeded: s/topic: Architecture Implementation Report/@@@/

Succeeded: s/topic: Architecture Implementation Report/subtopic: PR 420/

Succeeded: i|we are missing half|-> https://github.com/w3c/wot-architecture/pull/849 PR 849 - Oct 2022 Testfest Updates to Implementation Report|

Succeeded: i|we are missing half|-> https://cdn.statically.io/gh/w3c/wot-architecture/b7f2c34e43be57fc30761073b9e15f8342a790fc/testing/report11.html Draft Implementation Report|

Succeeded: i|I have reorganized the files|-> https://github.com/w3c/wot-testing/pull/420 PR 420 - Reorganize Files|

Maybe present: dp, ek, kaz, ml, mm