11:02:22 RRSAgent has joined #wot-pf 11:02:22 logging to https://www.w3.org/2022/10/05-wot-pf-irc 11:02:47 meeting: WoT Testfest - Day 3 11:02:55 Ege has joined #wot-pf 11:03:15 present+ Kaz_Ashimura, Michael_McCool, Ege_Korkan, Michael_Lagally, Sebastian_Kaebisch, Tomoaki_Mizushima 11:03:23 present+ Kunihiko_Toumura 11:03:31 ktoumura has joined #wot-pf 11:03:53 scribenick: Ege 11:07:07 topic: Agenda 11:07:10 agenda: https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf#Agenda_05.10.2022 11:07:16 mm: anything to add? 11:07:25 i|anything|-> https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf#Agenda_05.10.2022 agenda for today| 11:07:41 topic: Architecture Implementation Report 11:07:48 mm: there is a pr but it is still failing 11:08:14 subtopic: PR 417 11:08:26 -> https://github.com/w3c/wot-testing/pull/417 PR 417 - adding TD with async action 11:08:27 mm: the errors are difficult to understand 11:08:44 ek: it seems that the json is invalid 11:08:53 mm: we can merge it once that is fixed 11:09:08 i|the err|-> https://github.com/w3c/wot-testing/actions/runs/3189290875/jobs/5202929352 Validation errors| 11:09:52 q? 11:09:57 q+ mlagally 11:09:59 ack m 11:10:00 q+ 11:10:12 topic: PR 409 11:10:29 mm: I have thought about this, I think that we do not have time 11:10:49 ml: how was behavior testing done in TD? 11:10:52 i|have t|-> https://github.com/w3c/wot-testing/pull/409 PR 409 - Change procedure to include Consumers| 11:10:57 rrsagent, make log public 11:11:01 rrsagent, draft minutes 11:11:01 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:11:29 chair: McCool 11:12:07 mm: we are over our deadline 11:13:18 mm: we can add this to our new charter 11:13:38 mlagally has joined #wot-pf 11:13:41 q? 11:13:45 Fady has joined #wot-pf 11:13:55 sebastian has joined #wot-pf 11:14:36 ek: my question is about how to handle the Consumer implementations 11:14:42 ... how to manage actions, etc. 11:14:59 ... we've not had discussion on how to test WoT Profile 11:15:12 q+ 11:15:17 ack 11:15:20 s/ack// 11:15:22 ack e 11:15:36 present+ Fady_Salama 11:15:43 ... so wondering how to tackle this point 11:15:48 q+ 11:15:50 mm: we do not do testing for security 11:16:00 ... so that should be cleaned up 11:16:12 i/my question/scribenick: kaz/ 11:16:20 i/we do not/scribenick: Ege/ 11:16:24 ack ml 11:16:37 ek: I think that profile spec should not be tested like we test the TD. Profile has specific assertions on the consumer behavior 11:17:29 q+ 11:17:53 q+ 11:18:24 ml: I understand the concerns. How should we do it though? A concrete proposal would be appreciated 11:18:33 ack k 11:19:47 kaz: I'd like to suggest again that we should clarify our policy on how to test Profile and Architecture first to avoid this kind of discussion repeatedly everyday 11:19:53 i/I'd/scribenick: kaz/ 11:19:57 scribenick: Ege 11:20:01 kaz: I have mentioned on Monday that we should clarify the procedure for testing profile and architecture 11:20:14 +1 11:20:38 s/kaz: I have mentioned on Monday that we should clarify the procedure for testing profile and architecture// 11:20:45 mm: do we agree that we should clarify testing of profiles 11:21:30 q+ 11:21:38 ek: I can say that we have never tested profiles in a plugfest. There were some TDs submitted but I do not remember people using these TDs and experimenting with them 11:21:48 ... I agree with kaz that we should clarify that 11:22:09 ... and this PR was my proposal on how to test profiles 11:22:43 q? 11:22:45 ack e 11:22:47 ack e 11:22:53 ack mc 11:23:03 mm: We can add another column to indicate whether an implementation is a producer or consumer 11:23:32 q+ 11:24:12 ml: that sounds good 11:24:34 ml: I think we can have 2 producer and 2 consumer implementations and do pairwise and cross pairwise testing 11:24:42 q? 11:24:44 ack ml 11:24:55 q+ 11:25:06 dape has joined #wot-pf 11:26:28 q+ 11:26:33 ml: that should satisfy the requirements 11:26:51 mm: that sounds good, also for TD spec this makes sense 11:26:55 q- 11:27:17 I agree that we also should apply the same methodology to TD testing 11:27:52 -> https://github.com/w3c/wot-testing/pull/409#issuecomment-1268306152 McCool's comments for PR 409 11:28:08 ack e 11:29:28 ek: the implementation descriptions do not say something about whether they are profile implementations (producer or consumer) 11:29:56 mm: yes, we were not clear about that terminology 11:30:23 mm: we should test profiles in a matrix but that might complicated with multiple profiles 11:30:48 kaz: I agree 11:30:49 ack k 11:30:56 q? 11:31:37 q+ Ege 11:31:40 ack e 11:31:49 rrsagent, draft minutes 11:31:49 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:31:50 ek: did you merge the ditto PR? 11:31:58 mm: yes, so that I can prepare for this meeting 11:32:06 topic: Architecture Implementation Report 11:32:43 mm: I have reorganized the files via PR 420 Reorganize Files 11:32:47 s/topic: PR 409/subtopic: PR 409/ 11:33:08 ... I had to change the ids of some TDs 11:33:37 topic: TD Implementation Report 11:34:03 q+ 11:34:23 mm: some tm optional features are fixed 11:34:42 s/topic: Architecture Implementation Report/topic: PRs/ 11:34:48 rrsagent, draft minutes 11:34:48 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:34:50 q? 11:36:28 s/topic: Architecture Implementation Report/topic: PRs/ 11:36:44 s/topic: PRs/topic: Architecture Implementation Report/ 11:36:47 rrsagent, draft minutes 11:36:47 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:37:30 merged https://github.com/w3c/wot-thing-description/pull/1709 11:37:30 ek: for the tm versioning, I have created a PR to fix it in the TD spec. I will propagate the changes to the playground once merged 11:37:46 rrsagent, draft minutes 11:37:46 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:39:21 i|I have reorganized the files|-> https://github.com/w3c/wot-architecture/pull/849 wot-architecture PR 849 - Oct 2022 Testfest Updates to Implementation Report| 11:39:49 i|I have reorganized the files|-> https://cdn.statically.io/gh/w3c/wot-architecture/b7f2c34e43be57fc30761073b9e15f8342a790fc/testing/report11.html Draft Implementation Report| 11:40:11 mm: there are two assertions that seem to be broken 11:40:29 i|some tm optional|-> https://github.com/w3c/wot-thing-description/pull/1706 wot-thing-description PR 1706 - Oct 2022 Testfest Updates to Implementation Report| 11:40:51 i|some tm optional|-> https://cdn.statically.io/gh/w3c/wot-thing-description/1d08866097e9347b8f01a885fb1a82e73a3758f4/testing/report11.html Draft Implementation Report| 11:41:03 rrsagent, draft minutes 11:41:03 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:41:17 mm: ege can you fix all the "all red" assertions 11:41:51 s|merged https://github.com/w3c/wot-thing-description/pull/1709|| 11:42:01 i|there are two|merged https://github.com/w3c/wot-thing-description/pull/1709| 11:42:03 rrsagent, draft minutes 11:42:03 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:42:33 mm: we have some assertion that have a single implementation 11:42:47 q? 11:42:50 ack e 11:42:51 mm: we need someone to put name in the basic security 11:42:56 q+ Sebastian 11:43:02 ack s 11:43:06 rrsagent, draft minutes 11:43:06 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:43:43 mm: you can see how to do it at intel nodejs implementation 11:44:57 -> https://github.com/w3c/wot-testing/tree/main/data/input_2022/TD/intel-nodejs Intel's node.js implementation 11:44:59 dp: I can look into our examples and add it 11:45:06 q+ dape 11:45:07 ack d 11:45:37 rrsagent, draft minutes 11:45:37 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:46:28 mm: we can leave the uri scheme to the PR transition, I can do it 11:46:37 mm: we need client flow for oauth2 11:47:55 mm: we also need the device flow but that is an odd one 11:48:05 ... I do not care if we lose it 11:48:29 q? 11:48:39 topic: Architecture Implementation Report 11:49:21 mm: we are missing half of the implementations 11:50:07 mm: I think we can spend half of the call tomorrow to go over the red ones 11:50:08 q+ 11:50:36 q? 11:50:44 qq+ mlagally 11:50:47 q- ml 11:52:00 ack e 11:52:42 q+ 11:52:59 present+ Daniel_Peintner 11:53:16 rrsagent, draft minutes 11:53:16 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:54:42 q? 11:56:35 q+ 11:56:52 -> https://github.com/w3c/wot-testing/tree/main/data/input_2022/TD/node-wot/TDs node-wot TDs 11:56:56 rrsagent, draft minutes 11:56:56 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 11:57:48 q+ 11:57:49 q+ 11:58:42 ek: I think that we need more and different submissions from people if we are going to test individual things instead of codebases 11:58:46 ack e 12:00:15 dp: we need to clarify the perspective before answering the questions 12:00:25 ack dape 12:00:26 ... also suppliying manual.csv for each thing would be too complicated 12:00:36 ack ml 12:00:46 -> https://github.com/w3c/wot-testing/blob/main/data/input_2022/Architecture/Results/node-wot.csv Architecture Results of node-wot.csv 12:00:57 ml: I have fixed the problems in the PRs before, so they can be merged 12:02:10 mm: I will merge PR 417 and 421 12:02:16 -> https://github.com/w3c/wot-testing/pull/417 PR 417 - adding TD with async action 12:02:41 -> https://github.com/w3c/wot-testing/pull/421 PR 421 - Schema Fixes to WoTWebThing+problemDetails.td.jsonld 12:03:19 rrsagent, draft minutes 12:03:19 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 12:05:02 mm: I will update the reports accordingly 12:05:21 [adjourned] 12:05:23 rrsagent, draft minutes 12:05:23 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 12:07:57 s/topic: Architecture Implementation Report/@@@/ 12:08:08 s/topic: Architecture Implementation Report/subtopic: PR 420/ 12:08:43 i|we are missing half|-> https://github.com/w3c/wot-architecture/pull/849 PR 849 - Oct 2022 Testfest Updates to Implementation Report| 12:08:52 ktoumura has left #wot-pf 12:09:05 i|we are missing half|-> https://cdn.statically.io/gh/w3c/wot-architecture/b7f2c34e43be57fc30761073b9e15f8342a790fc/testing/report11.html Draft Implementation Report| 12:09:08 rrsagent, draft minutes 12:09:08 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 12:11:19 i|I have reorganized the files|-> https://github.com/w3c/wot-testing/pull/420 PR 420 - Reorganize Files| 12:11:20 rrsagent, draft minutes 12:11:20 I have made the request to generate https://www.w3.org/2022/10/05-wot-pf-minutes.html kaz 14:03:30 Zakim has left #wot-pf