13:57:09 <RRSAgent> RRSAgent has joined #wot-pf
13:57:09 <RRSAgent> logging to https://www.w3.org/2022/10/06-wot-pf-irc
13:57:39 <kaz> meeting: WoT Testfest - Day 4
14:01:39 <kaz> present+ Kaz_Ashimura, Michael_McCool, Ege_Korkan, Michael_Lagally
14:01:43 <McCool_> McCool_ has joined #wot-pf
14:02:20 <mlagally> mlagally has joined #wot-pf
14:02:48 <Ege> Ege has joined #wot-pf
14:04:13 <kaz> present+ Kunihiko_Toumura
14:04:14 <ktoumura> ktoumura has joined #wot-pf
14:05:00 <kaz> agenda: https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf#Agenda_06.10.2022
14:05:09 <kaz> present+ Tomoaki_Mizushima
14:06:59 <kaz> chair: McCool
14:07:43 <cris_> cris_ has joined #wot-pf
14:08:17 <kaz> present+ Cristiano_Aguzzi
14:08:25 <kaz> scribenick: cris_
14:08:32 <cris_> topic: Tooling issue
14:09:05 <cris_> ege: I implemented two assertions and they were all red, but it should not
14:09:21 <cris_> mc: I updated the implementation reports but I didn't update the tool
14:10:09 <cris_> ege: I opened a PR to not diverge from the tool
14:10:26 <cris_> mc: ok, but the tool does not need this PR to work correctly
14:10:29 <cris_> ege: correct
14:11:27 <cris_> mc: I feel uncomfortable merging because it goes in the TD repo
14:11:39 <cris_> ... but it is not critical and we can wait
14:11:51 <kaz> i|I opened a PR|-> https://github.com/w3c/wot-thing-description/pull/1715 wot-thing-description PR 1715 - Add model and prohibit instance in tm schema|
14:11:53 <cris_> ... let's wait for Sebastian
14:12:49 <kaz> i/I implemented two/subtopic: Two new assertions: tm-versioning-2 and tm-tmOptional-resolver/
14:12:53 <mlagally> q+
14:13:27 <kaz> i|https|topic: wot-thing-description PR 1715|
14:13:35 <kaz> rrsagent, make log public
14:13:46 <kaz> rrsagent, draft minutes
14:13:46 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:14:46 <cris_> ml: question about " problem, I created a PR with some quotes
14:14:54 <cris_> ... we can look it later
14:15:17 <cris_> ... should I fix it? or should I wait for tool updates?
14:15:40 <kaz> s/" problem/problem on [["]] (quotation)/
14:15:48 <cris_> mc: let's wait for Ege
14:16:03 <cris_> topic: PRs
14:16:26 <Mizushima> Mizushima has joined #wot-pf
14:16:26 <cris_> mc: I already merge a bunch to update the implementation report
14:16:42 <cris_> subtopic: PR 422
14:17:01 <kaz> rrsagent, draft minutes
14:17:01 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:17:19 <cris_> mc: I merged but I suspected to see updates in the assertions covered but they aren't
14:17:40 <cris_> ege: it should be recognized
14:18:04 <cris_> subtopic: PR 423
14:18:21 <cris_> mc: profile implementation, the first result of manual.csv of profiles
14:18:33 <cris_> ... we have some inputs
14:18:42 <cris_> ml: still working on the other manual.csv
14:18:50 <cris_> subtopic: PR 424
14:19:13 <cris_> mc: contribution from Toumura-san for Arch and Discovery
14:19:22 <cris_> ... I updated the implementation reports of both
14:19:39 <cris_> subtopic: PR 426
14:19:46 <cris_> mc: Ege fixed some old assertions
14:19:48 <kaz> i/question about problem/subtopic: problems with quotation/
14:19:57 <cris_> ege: quite weird
14:20:18 <cris_> ... I hope that the reference that I used is updated
14:20:38 <kaz> i|merged but I|-> https://github.com/w3c/wot-testing/pull/422 PR 422 - additional operations on async actions|
14:20:38 <cris_> subtopic: PR 429
14:20:52 <cris_> mc: it updates an old manual csv from the last TestFest
14:21:05 <kaz> i|profile imp|-> https://github.com/w3c/wot-testing/pull/423 PR 423 - WoT Profile implementation report for WebThings Gateway|
14:21:08 <kaz> rrsagent, draft minutes
14:21:08 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:22:11 <kaz> i|contribution from T|-> https://github.com/w3c/wot-testing/pull/424 PR 424 - Minor report updates for architecture/discovery|
14:22:17 <cris_> subtopic: PR 428
14:22:26 <cris_> mc: did a bunch of re-organizations
14:22:42 <kaz> i|Ege fixed some old|-> https://github.com/w3c/wot-testing/pull/426 PR 426 - sync template for architecture|
14:22:49 <cris_> ... renamed directories to be consistent
14:23:14 <kaz> i|it updates an old|-> https://github.com/w3c/wot-testing/pull/429 PR 429 - Update manual.csv|
14:23:16 <kaz> rrsagent, draft minutes
14:23:16 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:23:49 <kaz> i|did a bunch|-> https://github.com/w3c/wot-testing/pull/428 PR 428 - October 6 testfest updates|
14:23:51 <kaz> rrsagent, draft minutes
14:23:51 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:24:56 <cris_> ... in general I didn't add new stuff but I clarified some titles
14:25:23 <cris_> ... not yet finished
14:26:06 <cris_> ... should I merge it right now and we can do updates later?
14:26:34 <cris_> cris: +1 for merging right now
14:26:53 <cris_> mc: feel free to make PR to improve descriptions and titles
14:27:05 <cris_> subtopic: PR 425
14:27:08 <cris_> mc: big PR
14:27:38 <cris_> ... but it contains duplicated files because we said that TDs can be used both in Profile testing and TD testing
14:28:39 <cris_> ml: in the candidates folder you can see Original and Processed. The original you can see TDs from past testfest
14:28:52 <cris_> ... Processed is the result of running processTD.sh
14:29:08 <cris_> ... which adds profile identifiers
14:29:16 <cris_> ... it is a starting point
14:29:36 <cris_> ... it adds a lot of input material to be used a dataset for validation
14:30:05 <cris_> q+
14:30:30 <cris_> ml: there are many duplicates
14:30:45 <cris_> mc: we can just look were we have gaps
14:30:54 <cris_> ml: basically this is just a preparation
14:31:10 <cris_> mc: I'm incline to merge this PR even if duplicates TDs
14:31:20 <McCool_> q?
14:31:23 <McCool_> ack m
14:31:53 <kaz> i|big PR|-> https://github.com/w3c/wot-testing/pull/425 PR 425 - 2022.09.plug+testfest profile validation 1|
14:31:57 <kaz> rrsagent, draft minutes
14:31:57 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:32:02 <cris_> ege: it is weird that my submission it is use for Profile test
14:32:18 <cris_> ... I actually asked to do this thing an year ago
14:32:41 <cris_> ... it is late to use this approach
14:32:51 <cris_> ... you can do it offline
14:32:54 <cris_> ... and provide the result
14:32:56 <kaz> s/were we have/where we have/
14:32:59 <cris_> ... the motiviations are not clear
14:33:45 <cris_> ml: why are you concerned about the ownership of TDs used in the testing?
14:33:58 <cris_> ege: I never claimed to support Profiles
14:34:10 <cris_> s/I never/I've never/
14:34:24 <McCool_> q+
14:34:28 <kaz> s/concerned/concerned?/
14:35:28 <cris_> cris: why do we copy all the previous TDs in the original?
14:35:55 <cris_> ml: I'm not concerned about the number of files in a git repository
14:36:32 <cris_> mc: regarding Ege's point we can ask people if they let other to use their TDs
14:36:52 <cris_> ml: ok, what is the process?
14:36:59 <cris_> mc: we can do reverse permission
14:37:06 <Ege> Ege has joined #wot-pf
14:37:07 <cris_> ... ask people if they have any objections
14:37:29 <cris_> ... but how do we ask to people that are not inside the group anymore
14:37:33 <kaz> q+
14:37:40 <cris_> ... btw you can use Intel's TDs
14:37:41 <ktoumura> +q
14:37:42 <Ege> q+
14:37:43 <kaz> ack c
14:37:43 <cris_> ack c
14:37:47 <kaz> ack m
14:37:51 <McCool_> ack mc
14:38:34 <mlagally> q+
14:38:44 <cris_> kaz: actually to avoid this kind of discussions I suggest we clarify how to test Profile spec.
14:39:05 <McCool_> q+
14:39:26 <McCool_> q++
14:39:31 <McCool_> qq+
14:40:27 <cris_> mc: profiles have a set of assertions that differ from TDs
14:41:33 <cris_> ... profiles covers a set of best practices that are not covered in the TD
14:41:52 <cris_> ... that is true for arch there are a lot of assertions that are duplicated
14:41:55 <cris_> kaz: I agree
14:42:09 <McCool_> ack mc
14:42:11 <mlagally> q?
14:42:13 <McCool_> ack mc
14:42:13 <Zakim> McCool_, you wanted to react to mc
14:42:52 <cris_> toumura: my implementation does not comply with Profile
14:43:01 <cris_> ... it uses different status codes
14:43:19 <cris_> ... it may cause some problems for testing
14:43:50 <kaz> s/I agree/I agree, and that's why I've been suggesting we clarify which assertions from the Architecture spec and the Profiles spec to be covered by which test results, i.e., some by the results under Architecture and Profiles directly and some by referencing the TD results./
14:43:52 <kaz> ack k
14:44:00 <kaz> ack kaz
14:44:05 <kaz> q- +
14:44:15 <kaz> qq+ mlagally
14:44:19 <kaz> ack ml
14:44:25 <kaz> ack ml
14:44:25 <Zakim> mlagally, you wanted to react to kaz
14:44:30 <kaz> q+ mlagally
14:44:44 <cris_> ml: people get the wrong impression that in the processed folder there are already profile complaints TDs
14:44:48 <cris_> ... it is a process
14:44:54 <kaz> rrsagent, draft minutes
14:44:54 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:44:58 <cris_> ... they are not yet complaint indeed
14:45:09 <McCool_> q?
14:45:16 <McCool_> ack ml
14:45:23 <cris_> ... we can close this whole thing and I will come back with the schema
14:46:37 <cris_> ege: most of TDs that are there are not Profile complaint
14:46:51 <cris_> ... unless they are doing bare minimum stuff
14:47:11 <cris_> ... before doing schema we should first check if they are profile compliant
14:47:18 <cris_> mc: we can always use null
14:47:28 <cris_> ... and say that we are not sure
14:47:30 <cris_> q?
14:47:32 <cris_> ack E
14:47:47 <kaz> s/complaint/compliant/
14:47:48 <cris_> mc: PR closed without merging
14:47:50 <kaz> s/complaint/compliant/
14:47:53 <kaz> rrsagent, draft minutes
14:47:53 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:48:22 <kaz> s/mlagally, you wanted to react to kaz//
14:48:32 <kaz> s/McCool_, you wanted to react to mc//
14:48:41 <kaz> rrsagent, draft minutes
14:48:41 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
14:49:06 <cris_> topic: implementation reports
14:49:18 <cris_> subtopic: Architecture report
14:49:26 <cris_> mc: re-run things
14:49:36 <cris_> ... some issues are now solved
14:49:40 <cris_> ... got new results
14:50:52 <kaz> i|re-run things|-> https://github.com/w3c/wot-architecture/pull/849 wot-architecture PR 849 - Oct 2022 Testfest Updates to Implementation Report|
14:51:21 <cris_> ... we have 13 at risk items
14:51:29 <kaz> i|re-run things|-> https://cdn.statically.io/gh/w3c/wot-architecture/b7f2c34e43be57fc30761073b9e15f8342a790fc/testing/report11.html rendered draft Implementation for Architecture|
14:51:33 <cris_> ... not bad
14:52:02 <cris_> ... a lot of these assertions may be turned to informative
14:52:44 <cris_> ... I am worried about DTLS assertions
14:52:55 <cris_> ... the other ones are not so critical
14:54:38 <cris_> ... any other comments?
14:54:52 <cris_> ml: we already discussed
14:56:16 <cris_> mc: there are couple of PII related assertions that should be already satisfied by TDD implementations
14:56:29 <cris_> ... we are making progress
14:56:50 <cris_> subtopic: Thing Description report
14:58:08 <cris_> mc: we still have two not implemented assertions in security
14:58:20 <Ege> q+
14:58:21 <cris_> ... another one is about processor
14:58:55 <cris_> ... playground is all null, is that ok?
15:00:32 <kaz> rrsagent, draft minutes
15:00:32 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
15:01:21 <cris_> ege: maybe the test case is implented wrong for URI variables in sec scheme
15:01:40 <cris_> mc: we should have more cancelaction and queryaction
15:01:48 <cris_> ege: found bug
15:01:49 <cris_> ... fixing
15:02:11 <cris_> mc: query all actions is not included in any implementation
15:02:23 <kaz> i|we still|-> https://github.com/w3c/wot-thing-description/pull/1706 wot-thing-description PR 1706 - Oct 2022 Testfest Updates to Implementation Report|
15:02:53 <kaz> i|we still|-> https://cdn.statically.io/gh/w3c/wot-thing-description/1d08866097e9347b8f01a885fb1a82e73a3758f4/testing/report11.html rendered version of the Implementation Report for TD|
15:02:55 <kaz> rrsagent, draft minutes
15:02:55 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz
15:03:33 <kaz> q+
15:03:35 <cris_> mc: I have to re-run the tool
15:03:41 <kaz> ack e
15:04:02 <cris_> ... we can look at the results tomorrow
15:05:11 <kaz> ack k
15:05:44 <cris_> [adjourned]
15:05:47 <kaz> kaz: question about the Playground. Is Playground an actual implementation for Architecture and Thing Description?
15:05:55 <kaz> mm: let's revisit that tomorrow
15:06:01 <kaz> s/[adjourned]//
15:06:04 <kaz> [adjourned]
15:06:15 <kaz> rrsagent, draft minutes
15:06:15 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/06-wot-pf-minutes.html kaz