11:56:36 <RRSAgent> RRSAgent has joined #wot-pf
11:56:36 <RRSAgent> logging to https://www.w3.org/2022/10/04-wot-pf-irc
11:59:03 <kaz> meeting: WoT Testfest - Day 2
11:59:08 <kaz> present+ Kaz_Ashimura
11:59:09 <mlagally> mlagally has joined #wot-pf
12:01:42 <kaz> present+ Michael_Lagally, Michael_McCool, Tomoaki_Mizushima
12:01:56 <Mizushima> Mizushima has joined #wot-pf
12:02:34 <kaz> present+ Kunihiko_Toumura
12:02:55 <ktoumura> ktoumura has joined #wot-pf
12:05:36 <kaz> present+ Ege_Korkan
12:05:56 <mlagally> zakim, who is on the call?
12:05:56 <Zakim> Present: Kaz_Ashimura, Michael_Lagally, Michael_McCool, Tomoaki_Mizushima, Kunihiko_Toumura, Ege_Korkan
12:05:58 <McCool> McCool has joined #wot-pf
12:06:05 <mlagally> scribenick: mlagally
12:06:28 <mlagally> Topic: Agenda
12:06:41 <mlagally> 1. review PRS and merge as appropriate
12:06:55 <mlagally> 2. Implementation repotrts
12:07:03 <mlagally> s/PRS/PRs/
12:07:27 <mlagally> s/repotrts/reports/
12:07:33 <kaz> q?
12:07:59 <cris_> cris_ has joined #wot-pf
12:07:59 <kaz> chair: McCool
12:08:02 <mlagally> 3. How to test profiles?
12:08:07 <kaz> present+ Cristiano_Aguzzi
12:08:15 <kaz> agenda: https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf#Agenda_04.10.2022
12:08:25 <kaz> i|review PR|-> https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf#Agenda_04.10.2022 Agenda for today|
12:08:41 <mlagally> mmc: Want to add all new test data under events/Online ...09
12:09:21 <mlagally> ... will copy over input data to In putData. If you need name changes, please change in both places.
12:09:27 <mlagally> topic: PR review
12:10:19 <kaz> subtopic: PR 374
12:10:28 <kaz> -> https://github.com/w3c/wot-testing/pull/374 PR 374 - TUM manual.csv
12:10:30 <mlagally> ... that's an old PR, still WIP
12:10:42 <kaz> s/... that's/mmc: that's/
12:10:43 <mlagally> ege: will checkwith Fady
12:10:53 <kaz> s/checkwith/check with/
12:11:03 <mlagally> s/checkwith/check with/
12:11:53 <mlagally> subtopic: PR #416
12:12:16 <mlagally> ml: This is a TD with additional response for problem details
12:12:49 <mlagally> mmc: this is a testcase for TD and for Profile
12:13:28 <Fady> Fady has joined #wot-pf
12:13:59 <mlagally> ... we also need this under "Profile"
12:14:20 <mlagally> ml: Will also create and merge a PR which puts it under Profile
12:14:33 <kaz> i|This is a|-> https://github.com/w3c/wot-testing/pull/416 PR 416 - adding TD with a problem details response|
12:14:54 <mlagally> subtopic: PR #417
12:15:07 <kaz> -> https://github.com/w3c/wot-testing/pull/417 PR 417 - adding TD with async action
12:15:09 <kaz> q?
12:15:12 <kaz> q+ Ege
12:15:15 <kaz> ack Ege
12:15:46 <kaz> present+ Fady_Salama
12:15:48 <kaz> q+
12:18:20 <kaz> rrsagent, make log public
12:18:24 <kaz> rrsagent, draft minutes
12:18:24 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:19:45 <kaz> (discussion on the type of "status")
12:20:33 <mlagally> < discussion between Ege, ML, MMC about validation>
12:20:40 <kaz> mmc: (adds suggestions to WoTWebThing+problemDetails+actionStatus.td.jsonld within PR 417)
12:21:37 <mlagally> mmc: We need a JSON Schema which does strict checks
12:22:52 <mlagally> ege: Jsonschema is also permissive - you can try with correct and incorrect schemas
12:23:05 <mlagally> mmc: we should make our tooling stricter
12:23:25 <mlagally> ege: I can write a small script for the TD to generate a strict version
12:24:03 <mlagally> ege: we don't have all features of JSON Schema in a TD
12:24:06 <kaz> q?
12:28:29 <mlagally> (discussion on href with anyURL)
12:29:16 <Ege> Ege has joined #wot-pf
12:29:44 <mlagally> kaz: for the technical discussion, JSON schema could be used as part of the necessary validation, if it is useful and usable
12:30:01 <mlagally> ... however if we want to really validate, we need a better mechanism
12:30:12 <McCool> q?
12:30:14 <kaz> ack k
12:30:41 <mlagally> mmc: JSONSchema is not very powerful, we talked about other means for tests
12:30:44 <kaz> s/however/however,/
12:30:51 <mlagally> ... don't completely trust the validator
12:31:02 <mlagally> ... the PR is a useful testcase - let'S keep it open
12:31:07 <kaz> s/really validate/really validate the inputted TD strictly/
12:31:30 <kaz> s/let'S/let's/
12:32:20 <kaz> s/JSONSchema/kaz: second point, please use q+ on IRC to manage the speakers :)/
12:32:26 <mlagally> subtopic: #409
12:32:36 <kaz> rrsagent, draft minutes
12:32:36 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:32:59 <mlagally> mmc: This is a suggestion to have results for consumers
12:33:06 <kaz> i|This is a|-> https://github.com/w3c/wot-testing/pull/409 PR 409 - Change procedure to include Consumers|
12:33:09 <mlagally> ... This would be useful for TDs as well
12:33:31 <mlagally> ... I have already split up implementations for things and consumers
12:33:32 <mlagally> q+
12:33:51 <mlagally> ege: I mentioned we should test it during the last testing call
12:33:58 <kaz> q+ Ege
12:33:59 <kaz> ack e
12:34:05 <mlagally> ... I was asked to create a PR in the last testing call
12:34:26 <mlagally> mmc: it would be much cleaner if we had two CSV files
12:34:33 <mlagally> ... do we have time to do it
12:34:52 <Ege> q+
12:35:13 <mlagally> ... It may need a bit more thought to split up the assertions
12:35:19 <kaz> q?
12:36:06 <kaz> ack ml
12:36:40 <kaz> ml: splitting the assertion into two would be too much
12:36:49 <kaz> ... we're now talking about Consumers
12:36:57 <mlagally> ... currently everything in Profile is only manually testes
12:37:19 <kaz> i/splitting/scribenick: kaz/
12:37:26 <kaz> s/currently/scribenick: mlagally/
12:37:30 <mlagally> ml: The TD has assertions on Consumers, how were these tested?
12:37:31 <kaz> rrsagent, draft minutes
12:37:31 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:37:36 <McCool> q?
12:37:51 <mlagally> ege: This is tested in the TD via manual assertion?
12:38:03 <mlagally> s/?//
12:39:02 <McCool> q+
12:39:03 <mlagally> ... we have neither done a plugfest on Profiles, the Profile has constraints on the consumer
12:39:06 <kaz> i/The TD has as/scribenick: mlagally/
12:39:16 <kaz> rrsagent, draft minutes
12:39:16 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:39:30 <mlagally> ... we have to test interop of the spec.
12:39:44 <mlagally> ... how do we want to test Profiles?
12:39:46 <mlagally> q+
12:40:06 <mlagally> ... I could just provide manual.csv, but how to be sure?
12:40:25 <kaz> s/scribenick: mlagally everything/currently everything/
12:40:29 <kaz> rrsagent, draft minutes
12:40:29 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:40:36 <mlagally> mmc: So far we trust submitters of manual.csv, there's always more testing that could be done
12:40:53 <mlagally> ... I don't want to add additional testing given the time constraints
12:41:24 <kaz> s/subtopic: #409/subtopic: PR 409/
12:41:25 <kaz> rrsagent, draft minutes
12:41:25 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:41:26 <Ege> q+
12:41:32 <mlagally> ... there's some discussion to defer REC publication of the Profile
12:41:53 <McCool> ack e
12:41:55 <McCool> ack m
12:41:55 <mlagally> ... We may consider the "Profile" feature of the TD at risk
12:42:01 <McCool> ack m
12:42:52 <kaz> i|in Profile is only man|scribenick: mlagally|
12:42:54 <kaz> rrsagent, draft minutes
12:42:54 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:44:57 <mlagally> mmc: Let's keep the PR open dand rediscuss next time
12:45:16 <kaz> s/ dand / and /
12:45:31 <mlagally> topic: Implementation Report
12:46:04 <mlagally> mmc: I have a PR #849, will update it in the description as we go.
12:46:12 <kaz> i|Implementation Report|subtopic: PR 374 - revisited|
12:46:18 <mlagally> ... It has a link to a rendered version
12:46:43 <kaz> i|Implementation Report|mmc: Fady, could you update the TUM manual.csv for the Testfest 09?|
12:46:53 <kaz> i|Implementation Report|fady: will do|
12:47:12 <mlagally> ... we have 13 implementation descriptions, some need some work
12:47:21 <mlagally> ... will poke people to fill some blanks
12:47:48 <mlagally> ... we got some new results for Architecture - We still could get 8 more results
12:47:55 <kaz> i|PR #849|-> https://github.com/w3c/wot-architecture/pull/849 wot-architecture PR 849 - Oct 2022 Testfest Updates to Implementation Report|
12:48:02 <kaz> rrsagent, draft minutes
12:48:02 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:48:02 <Ege> q+ I have asked Ditto implementation to provide the manual.csv for architecture
12:48:19 <Ege> q+ to I have asked Ditto implementation to provide the manual.csv for architecture
12:48:22 <Ege> q?
12:48:46 <kaz> q+
12:49:13 <kaz> i|Fady|scribenick: kaz|
12:49:24 <kaz> i|I have a PR|scribenick: mlagally|
12:49:26 <kaz> rrsagent, draft minutes
12:49:26 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:49:32 <mlagally> ...Some responses should be checked again, e.g. in the security considerations for use of encryption in public networks
12:49:34 <kaz> q?
12:50:01 <mlagally> ... Please take a look offline and review your responses
12:50:14 <McCool> https://github.com/w3c/wot-architecture/pull/849
12:50:27 <kaz> q-
12:50:28 <McCool> https://cdn.statically.io/gh/w3c/wot-architecture/ac5c7191e3ebf09fef282ed19fabe107fbc2ac02/testing/report11.html
12:50:43 <kaz> s/https/-> https/
12:51:07 <kaz> s/html/html Draft Implementation for Architecture by Statically/
12:51:09 <mlagally> mmc: I also did the TD, there's a couple of new things
12:51:42 <mlagally> ... around JSON pointers
12:51:42 <kaz> rrsagent, draft minutes
12:51:42 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:51:47 <kaz> q?
12:52:08 <mlagally> ... I18n is a bit tricky -
12:52:31 <kaz> ack e
12:52:31 <Zakim> Ege, you wanted to I have asked Ditto implementation to provide the manual.csv for architecture
12:52:33 <mlagally> ege: You don't have to ping ditto, I already talked to them
12:53:05 <kaz> @@@move Ege's comments before TD implementation report
12:53:16 <kaz> q?
12:53:53 <kaz> i|wot-architecture PR|subtopic: Architecture|
12:54:06 <kaz> i|I also did the TD|subtopic: TD
12:54:10 <kaz> rrsagent, draft minutes
12:54:10 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:55:10 <kaz> i|I also did the TD|-> https://github.com/w3c/wot-thing-description/pull/1706 wot-thing-description PR 1706 - Oct 2022 Testfest Updates to Implementation Report|
12:56:28 <mlagally> mmc: (Reviews details of the implementation report)
12:56:47 <kaz> q+ Ege
12:56:50 <cris_> q+
12:56:55 <mlagally> mmc: Thing model seems to be missing input
12:57:03 <mlagally> ege: perhaps an old version?
12:57:17 <cris_> ack c
12:57:25 <mlagally> mmc: Will run the scripts today, let's see if the problem goes away
12:57:34 <cris_> q+
12:57:47 <kaz> ack e
12:57:48 <kaz> ack c
12:58:42 <kaz> q+
12:58:57 <mlagally> cris: tm-versioning-1 and tm-versioning-2 should be manual
12:59:25 <McCool> https://cdn.statically.io/gh/w3c/wot-discovery/0c2a7ea481c0c628132588e6895ddd439f96f27c/testing/report.html
12:59:33 <kaz> s/https/-> https/
12:59:44 <kaz> s/html/html Draft Implementation for TD by Statically/
12:59:47 <mlagally> topic: Discovery
12:59:49 <kaz> rrsagent, draft minutes
12:59:49 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
12:59:55 <kaz> s/topic/subtopic/
12:59:58 <kaz> rrsagent, draft minutes
12:59:58 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz
13:00:04 <mlagally> mmc: please review PR and comment on it
13:00:13 <kaz> [adjourned]
13:00:14 <kaz> rrsagent, draft minutes
13:00:14 <RRSAgent> I have made the request to generate https://www.w3.org/2022/10/04-wot-pf-minutes.html kaz