11:56:07 <RRSAgent> RRSAgent has joined #wot-pf
11:56:07 <RRSAgent> logging to https://www.w3.org/2022/10/03-wot-pf-irc
11:57:04 <mlagally> mlagally has joined #wot-pf
12:02:39 <kaz> meeting: WoT Testfest - Day 1
12:03:07 <ktoumura> ktoumura has joined #wot-pf
12:03:07 <kaz> present+ Kaz_Ashimura, Michael_McCool, Andrea_Cimmino, Kunihiko_Toumura, Michael_Lagally, Tomoaki_Mizushima
12:03:17 <Mizushima> Mizushima has joined #wot-pf
12:06:26 <kaz> present+ Geun-Hyung Kim
12:06:34 <McCool> McCool has joined #wot-pf
12:07:19 <cris_> cris_ has joined #wot-pf
12:07:26 <kaz> present+ Cristiano_Aguzzi, Daniel_Peintner
12:09:05 <dape> dape has joined #wot-pf
12:09:49 <kaz> rrsagent, make log public
12:09:54 <kaz> rrsagent, draft minutes
12:09:54 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/03-wot-pf-minutes.html kaz
12:10:56 <kaz> scribenick: cris_
12:11:00 <cris_> topic: agenda
12:11:16 <cris_> mc: I want to review the organization
12:11:45 <cris_> ml: maybe we should talk about implementations too
12:11:52 <cris_> mc: yes, implementation descriptions
12:12:06 <McCool> https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf#Agenda_03.10.2022
12:12:22 <cris_> topic: organization
12:12:33 <kaz> agenda: https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf#Agenda_03.10.2022
12:12:53 <cris_> mc: the goal of this test fest is to complete the implementation reports for TD 1.1, Discovery, and Architecture 1.1
12:13:05 <kaz> i|the goal|-> https://github.com/w3c/wot-testing/tree/main/events/2022.07.Online Testfest organization|
12:13:13 <kaz> s/test fest/testfest/
12:13:17 <cris_> ... I want to focus on Architecture especially
12:14:15 <cris_> ... then we have profile, but let's deal with that later
12:14:54 <cris_> ... the readme misses a section about how to contribute for TD 1.1 and Architecture
12:15:06 <cris_> ... I'm adding such a section right now
12:15:33 <kaz> s/07/09/
12:15:49 <cris_> ... for architecture we don't need TDs but a csv with manual assertions
12:15:57 <kaz> rrsagent, draft minutes
12:15:57 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/03-wot-pf-minutes.html kaz
12:16:40 <cris_> mc: any more instractions ?
12:17:04 <cris_> ml: they look good, but we don't have a directory for manual.csv files
12:17:08 <cris_> mc: let's create it
12:17:13 <cris_> ml: I'll do it
12:17:33 <cris_> mc: for TD, we do the usual
12:19:31 <cris_> ... for discovery is different
12:19:34 <cris_> I'll do it later
12:19:53 <cris_> s/I'll/... I'll/
12:20:29 <cris_> ml: directory created
12:20:38 <cris_> mc: ok, but we need an example
12:20:57 <cris_> ... moreover there is no readme
12:21:30 <cris_> ml: it should be the latest version of the assertion list
12:24:10 <cris_> mc: we should probably have a similar structure of data directory, and we are going to copy over daily the results
12:24:47 <cris_> ... the problem is that when copy and paste the results the assertion list might get updated
12:24:56 <dape> q+
12:25:16 <cris_> .... thus people have to keep the assertion order to help check for diffs
12:25:36 <dape> ack dape
12:26:01 <cris_> topic: PRs
12:26:14 <cris_> daniel: I fixed node-wot manual csv
12:26:20 <kaz> i|PRs|-> https://github.com/w3c/wot-testing/blob/main/data/input_2022/Architecture/Results/node-wot.csv McCool skims node-wot.csv|
12:26:24 <cris_> ... now it uses pass instead of impl
12:26:31 <cris_> mc: merged
12:26:56 <cris_> ml: I also created a README file
12:27:00 <cris_> mc: ok merged
12:27:11 <cris_> subtopic: PR 413
12:27:23 <cris_> ml: it contains TDs from Webthings
12:27:30 <cris_> ... it going in the current test fest
12:27:39 <kaz> i|I fixed node-wot|subtopic: PR 412|
12:27:54 <cris_> mc: it is a profile result?
12:27:57 <kaz> i|I fixed node-wot|-> https://github.com/w3c/wot-testing/pull/412 PR 412 - change "impl" to "pass"|
12:27:57 <cris_> ml: yes TDs?
12:28:08 <cris_> s/TDs?//
12:28:19 <kaz> i|I also created|subtopic: PR 414|
12:28:20 <cris_> mc: we have a problem
12:28:23 <cris_> ... validation fails
12:28:32 <kaz> i|I also created|-> https://github.com/w3c/wot-testing/pull/414 PR 414 - Create README.md|
12:28:37 <cris_> ml: let's look into it
12:29:05 <kaz> i|it contains|-> https://github.com/w3c/wot-testing/pull/413 PR 413 - 2022.09.plug+testfest prepare 3|
12:29:48 <cris_> ... there is a well-known problem, the tool is trying to validate a file that I removed
12:30:04 <cris_> mc: did you use git rm ?
12:30:09 <cris_> ml: I think yes
12:30:30 <cris_> q+
12:30:50 <kaz> i|let's look into|-> https://github.com/w3c/wot-testing/actions/runs/3173589627/jobs/5169371427 Validate TDs for PR 413|
12:30:57 <cris_> ack c
12:32:24 <cris_> cris: have you verified that the file was actully removed in the commit log?
12:32:27 <cris_> ml: checked
12:32:42 <cris_> mc: ok let's look at it later
12:32:51 <cris_> subtopic: PR 411
12:33:06 <ryuichi_> ryuichi_ has joined #wot-pf
12:33:24 <cris_> mc: toumura-san has set up a VLAN for local lan tests
12:33:31 <kaz> i|toumura|-> https://github.com/w3c/wot-testing/pull/411 PR 411 - Add Slack & VLAN information for 2022 October testfest|
12:33:33 <cris_> ... is anybody planning to use it?
12:33:42 <cris_> toumura: not me
12:33:56 <cris_> mc: maybe we can discuss this on slack
12:35:18 <cris_> mc: merged
12:35:33 <cris_> subtopic: PR 410
12:35:54 <cris_> ml: documenting what W3C testing actually requires
12:36:49 <cris_> mc: I don't disagree with the statement but is under profile section, but it is a generic rule. We should move it in a appropriate section
12:36:55 <cris_> ... merged
12:37:03 <cris_> subtopic: PR 409
12:37:20 <cris_> mc: it requires a discussion with ege
12:37:25 <kaz> i|documenting|-> https://github.com/w3c/wot-testing/pull/410 PR 410 - Clarification on W3C specification testing|
12:37:25 <cris_> s/ege/Ege/
12:38:05 <kaz> i|it requires|-> https://github.com/w3c/wot-testing/pull/409 PR 409 - Change procedure to include Consumers|
12:38:52 <cris_> mc: if profile guarantee out-of-box interoperability we need a more strict check, but I always intended that Profile is about **improve** out-of-the-box interoperability
12:39:21 <cris_> ... therefore we can be more forgiving
12:39:27 <cris_> ml: we need to sort this out
12:40:25 <cris_> mc: I rather not change testing procedures for TD
12:41:40 <cris_> ml: anything can be a thing
12:41:43 <cris_> mc: not really
12:41:59 <cris_> ... a broswer can be a consumer but it might not be a thing
12:42:08 <cris_> ml: it requires a longer discussion
12:42:52 <cris_> mc: back to the PR I won't merge it because we need Ege to discuss it
12:43:05 <cris_> subtopic: PR 413 - second pass
12:43:25 <cris_> ml: still failing for a deleted file
12:43:37 <cris_> mc: mmm I think this is a bug of testing tool
12:44:31 <cris_> ... merged
12:44:42 <kaz> i|still failing|-> https://github.com/w3c/wot-testing/pull/413 PR 413 - 2022.09.plug+testfest prepare 3|
12:45:16 <cris_> topic: organization - back
12:46:53 <cris_> mc: adding a new readme under TD folder
12:48:42 <cris_> ... there is a broken link
12:49:46 <cris_> ... ok now we have a copy of manual template in the TD folder
12:51:01 <cris_> ... we need a description of what the different status labels mean
12:51:10 <cris_> ... we already have the description in other places
12:51:18 <cris_> ... I'll move it
12:56:29 <cris_> ... created a PR and merged
12:56:46 <cris_> ... I hope that it improves the situation
12:56:58 <kaz> s/topic: organization - back/subtopic: PR 415/
12:57:02 <cris_> ... I'll review the directory structure offline
12:57:19 <kaz> i|adding a new readme|-> phttps://github.com/w3c/wot-testing/pull/415 PR 415 - Update README.md - improve general instructions|
12:59:20 <cris_> ... we'll wait for tomorrow for profile implementation discussion
12:59:48 <kaz> i/we'll wait for/topic: Schedule/
13:00:06 <kaz> i|we'll|Monday - Setup
13:00:06 <kaz> Tuesday and Wednesday - Gathering test inputs and validation data; gathering implementation descriptions
13:00:06 <kaz> Thursday - Updates to Implementation Reports; interoperability testing, especially for Profiles
13:00:06 <kaz> Friday - Cleanup|
13:00:13 <kaz> ]]
13:00:29 <kaz> rrsagent, draft minutes
13:00:29 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/03-wot-pf-minutes.html kaz
13:00:54 <kaz> chair: McCool
13:00:55 <kaz> rrsagent, draft minutes
13:00:55 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/03-wot-pf-minutes.html kaz
13:02:34 <kaz> [adjourned]
13:02:36 <kaz> rrsagent, draft minutes
13:02:36 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/03-wot-pf-minutes.html kaz
15:01:07 <Zakim> Zakim has left #wot-pf