14:01:00 RRSAgent has joined #wot-pf 14:01:01 logging to https://www.w3.org/2022/06/09-wot-pf-irc 14:01:25 meeting: WoT Testfest - Day 4 14:01:40 Mizushima has joined #wot-pf 14:01:54 ktoumura has joined #wot-pf 14:01:55 present+ Kaz_Ashimura, Michael_McCool, Kunihiko_Toumura, Tomoaki_Mizushima 14:03:55 dape has joined #wot-pf 14:05:27 present+ Daniel_Peintner, Ege_Korkan, Sebastian_Kaebisch 14:05:45 Ege has joined #wot-pf 14:07:44 topic: TD PRs 14:08:02 scribenick: Ege 14:09:01 mm: I forgot that we need to add extra asserts 14:09:24 ... ege made a PR and fixed the issue 14:10:54 ek: I am amazed that you did it manually, we should automate it 14:10:54 s/asserts/assertions/ 14:11:02 s/ege made/Ege made/ 14:11:26 mm: So I have removed them from supressed.csv for the testing phase 14:12:15 mm: now our report is looking better 14:12:57 present+ Fady_Salama 14:15:30 i/So I have/(McCool shows report11.html on his PC)/ 14:15:56 q+ 14:16:31 dezell2 has joined #wot-pf 14:17:06 present+ David_Ezell 14:18:11 sk: we should implement the lower hanging fruits 14:18:23 mm: yes so that we can see the actually difficult things 14:18:36 kaz: we need to organize this call better 14:19:38 mm: if you have targeted an assertion in your PR, mention it 14:20:28 s/we need to organize this call better/starting with this draft implementation report is fine, but we should organize this call better. So would suggest we capture the existing issues first, starting with the issue of the procedure, missing tests, etc. And then discuss how to solve them next./ 14:20:40 ack k 14:22:10 q+ 14:23:33 kaz: so would suggest we quickly skim this draft table, and see what the existing problems are./ 14:23:39 s|are./|| 14:23:41 ack k 14:23:59 q+ 14:24:25 scribenick: kaz 14:24:26 ack e 14:24:42 q+ 14:24:49 mm: (goes through the draft report11.html) 14:25:26 subtopic: zero data 14:25:33 ack e 14:25:51 ek: regarding the results with 0 data, should be the problem with the test mechanism itself 14:25:51 ek: if we see a line with red 0 everywhere, it is a testing problem 14:26:41 subtopic: td-security-oauth2-client-flow 14:26:46 mm: need one more implementation 14:27:16 subtopic: td-security-auth2-code-flow 14:27:27 mm: need 2 implementations 14:27:36 subtopic: allOf 14:28:22 subtopic: anchor--Link 14:28:48 kaz: 2 dashes within the title correct? 14:28:59 mm: yes, that's table assertion 14:29:33 subtopic: at-type--SecurityScheme 14:29:56 subtopic: contentCoding--Form 14:30:29 mm: similarly with contentProtection 14:30:44 subtopic: default--DataSchema 14:31:02 subtopic: DigestSecurityScheme 14:31:26 subtopic: minLength--SringSchema 14:31:38 subtopic: multipleOf--IntegerScehema 14:31:42 mm: surprising... 14:31:57 subtopic: BasicSecurityScheme 14:32:13 mm: similar to DigestSecurityScheme 14:32:16 ... should be easy 14:32:30 subtopic: ComboSecuritycheme 14:32:41 mm: I have a proxy and still need one more 14:32:52 subtopic: op--Form 14:32:57 mm: surprised 14:33:01 ... pretty much used 14:33:16 ek: there are child assertions 14:33:22 mm: right 14:33:53 subtopic: queryaction 14:33:58 mm: should be easy 14:34:03 ek: not merged yet 14:34:07 .... maybe some problem there 14:34:17 mm: ok, need to clean it up 14:34:31 subtopic: pattern--StringSchema 14:34:36 ek: new features 14:34:43 s/features/feature/ 14:34:46 mm: ok 14:35:07 sutopic: proxy--DigestSecurityScheme 14:35:20 mm: qop (quality of protection) 14:35:29 s/sutopic/subtopic/ 14:35:42 subtopic: sizes--Link 14:35:46 mm: just icon 14:36:03 subtopic: subprotocol--Form 14:36:09 mm: any child assertion? 14:36:19 ek: just did yesterday 14:36:48 ... there is just an example but no actual child assertion 14:37:09 topic: tm-extend 14:37:14 mm: TM assertions 14:37:29 ... related to modularity of TM 14:37:41 subtopic: placeholder 14:37:45 mm: need some text 14:37:51 subtopic: tmRef1 14:38:04 q+ 14:38:06 subtopic: tmRequired 14:38:17 mm: got one from Siemens 14:38:32 ... and need another from the other implementers 14:38:52 sk: kind of surprised 14:38:57 tm-extend is tracked here: https://github.com/thingweb/thingweb-playground/issues/266 14:39:13 dp: node-wot should be able to cover it 14:39:56 mm: consuming TM is a bit different 14:39:58 ack dape 14:40:19 topic: next table starting with binding... 14:40:47 subtopic: privacy-auth... 14:40:53 mm: these are easy 14:41:25 ... need manual assertions 14:41:43 subtopic: td-context-ns-td10-namespacev10 14:41:56 mm: test cases? 14:42:06 s/v10/(v10)/ 14:42:46 ek: will work on the test cases 14:43:10 subtopic: td-default... 14:43:18 mm: handled by Consumers 14:43:32 ... don't have many Consumers 14:43:51 ... but surprised if node-wot can't handle this 14:44:36 (specifically, td-default-idempotent and td-default-in-apikey) 14:44:46 dp: let me check again 14:45:14 sk: these features were included in TD 1.0 already 14:45:23 ElodieThieblin has joined #wot-pf 14:45:30 mm: might be included in Huawei's results 14:45:31 q+ 14:46:15 ack k 14:46:41 kaz: as I mentioned the other day, we should clarify how to deal with old results for compatible features 14:46:51 ... importing the old results should be fine, though 14:46:53 mm: ok 14:47:30 ... wondering what implementation(s) cover all the features in addition to node-wot 14:47:45 subtopic: td-ns-multilanguage-content-negotiation 14:48:01 mm: need 2 implementations 14:48:16 subtopic: security-extension 14:48:29 subtopic: td-text-at-direction 14:48:38 mm: need to cover the example 14:48:40 q? 14:48:41 q+ 14:49:28 kaz: do we have actual text within the spec? 14:49:36 ... or just examples? 14:49:51 mm: these assertions have been extracted from the spec text 14:50:39 ... this can be covered by any existing TD (by adding an entry for this) 14:51:04 ... for example, if a Web browser can consume a TD, that's also fine 14:51:07 kaz: ok 14:51:25 present+ Elodie_Thieblin 14:51:33 topic: PRs 14:52:07 subtopic: PR 330 14:52:18 -> https://github.com/w3c/wot-testing/pull/330 PR 330 - Update input data 14:52:27 mm: need to update this 14:52:31 s/this/this PR itself/ 14:53:19 subtopic: PR 324 14:53:29 -> https://github.com/w3c/wot-testing/pull/324 PR 324 - Discovery: Add results for siemens-logilab 14:54:08 et: you can merge this PR 14:54:16 ... and then I can look into the details 14:54:20 (merged) 14:54:35 subtopic: PR 328 14:54:46 -> https://github.com/w3c/wot-testing/pull/328 PR 328 - Discovery: Add missing registration info IDs, remove auto tested tdd-notification 14:54:51 mm: let's merge this 14:54:59 ... cleaning up CSV for Discovery 14:55:03 (merged) 14:55:17 subtopic: PR 332 14:55:29 -> https://github.com/w3c/wot-testing/pull/332 PR 332 - Add siemens-logilab TDD thing description 14:55:33 mm: about TD 14:55:35 (merged) 14:55:52 subtopic: PR 334 14:56:02 -> https://github.com/w3c/wot-testing/pull/334 PR 334 - manuel assertation CSV file for ediTDor 14:56:04 (merged) 14:56:08 subtopic: PR 335 14:56:31 -> https://github.com/w3c/wot-testing/pull/335 PR 335 - Added manual assertions CSV for Eclipse Ditto 14:56:59 mm: using different name 14:57:31 ... let me go ahead and merge this 14:57:32 q? 14:57:35 ack k 14:57:57 kaz: and then you'll check the problem later? 14:57:59 mm: yes 14:58:05 (merged) 14:58:15 subtopic: PR 336 14:58:34 -> https://github.com/w3c/wot-testing/pull/336 PR 336 - Update README.md - Improve Instructions 14:58:41 mm: just updated the instructions 14:58:43 (merged) 14:59:06 subtopic: PR 317 14:59:17 -> https://github.com/w3c/wot-testing/pull/317 PR 317 - Add manual.csv files for dart_wot 14:59:19 mm: need Jon 14:59:24 subtopic: PR 330 14:59:34 s/need Jon/need Jan 14:59:50 -> https://github.com/w3c/wot-testing/pull/330 PR 330 - Update input data 15:00:54 mm: need to update it 15:01:02 ... can merge this and create another PR 15:01:05 (merged) 15:01:08 topic: Issues 15:02:16 subtopic: PR 1524 15:02:35 -> https://github.com/w3c/wot-thing-description/pull/1524 PR 1524 - Add old context value 15:02:40 mm: bug fix 15:02:43 (merged) 15:02:48 subtopic: PR 1532 15:03:10 -> https://github.com/w3c/wot-thing-description/pull/1532 PR 1532 - Allow placeholder for required and enum in TMs 15:03:23 s/topic: Issues/topic: TD PRs/ 15:03:49 fs: placeholder must be located much upper 15:04:07 q+ 15:04:29 ack k 15:04:38 mm: we're out of time 15:04:43 ... let's discuss this tomorrow 15:04:47 q+ 15:05:39 topic: AOB 15:05:49 kaz: we should clarify what to discuss tomorrow 15:06:11 ... if our goal is finalizing the test platform for this Charter period, that's fine 15:06:20 ... but we should clarify our expectations 15:06:42 mm: think our goals should be clarifying the gaps this time 15:07:01 ... can have follow-up discussion next week 15:07:25 kaz: in that case, we should clarify the plan for next week as well 15:07:28 ... but let's do that tomorrow 15:07:30 mm: ok 15:07:46 ... tomorrow, we'll focus on finalizing the gaps mainly 15:07:51 [adjourned] 15:08:06 rrsagent, make log public 15:08:10 rrsagent, draft minutes 15:08:11 I have made the request to generate https://www.w3.org/2022/06/09-wot-pf-minutes.html kaz 17:25:28 Zakim has left #wot-pf