IRC log of wot-pf on 2021-05-26

Timestamps are in UTC.

13:10:48 [RRSAgent]
RRSAgent has joined #wot-pf
13:10:48 [RRSAgent]
logging to
13:10:55 [kaz]
meeting: WoT Testfest
13:11:01 [kaz]
chair: McCool
13:11:03 [McCool]
McCool has joined #wot-pf
13:11:22 [kaz]
present+ Kaz_Ashimura, Ege_Korkan, Kunihiko_Toumura, Michael_McCool, Tomoaki_Mizushima
13:12:44 [kaz]
scribenick: kaz
13:13:10 [kaz]
mm: should work on implementation test metadata
13:13:37 [kaz]
13:13:46 [kaz]
topic: Minutes
13:13:54 [kaz]
i/should/topic: Agenda/
13:14:11 [kaz]
-> May-19
13:14:33 [kaz]
mm: relatively short meeting
13:14:49 [kaz]
... clarification for discovery
13:15:41 [kaz]
... any problems?
13:15:45 [kaz]
(none; approved)
13:16:50 [kaz]
topic: Testfest planning
13:16:57 [kaz]
mm: let's start with TD
13:17:47 [kaz]
-> TD area within the wot-testing repo
13:18:51 [kaz]
-> report template within the wot-thing-description repo
13:19:53 [kaz]
mm: (discuss the requirements for implementations)
13:19:54 [kaz]
13:20:11 [kaz]
Each implementation represents a working system
13:20:11 [kaz]
that either exposes or consumes at least one WoT Thing Description.
13:20:12 [kaz]
13:21:15 [kaz]
mm: would have two implementations for both producer and consumer
13:21:37 [kaz]
ek: need update for the implementation result table as well
13:23:31 [kaz]
topic: PRs
13:23:46 [kaz]
-> PR 125 - fix(json): Fix json files to be json parsed
13:24:29 [kaz]
mm: (merges the PR)
13:26:03 [kaz]
topic: Test report metadata
13:26:19 [kaz]
mm: (creates a new branch, "test-report-metadata")
13:30:01 [kaz]
... (copies the content from wot-thing-description/testing to the test-report-metadata branch of the wot-testing repo (locally copied on McCool's PC))
13:30:30 [kaz]
... (adds edits to the testing/inputs/templates/report.html file"
13:31:04 [kaz]
... any updates for the template in general?
13:31:37 [kaz]
kaz: implementation reports are generated by the WGs and no general templates
13:31:40 [kaz]
mm: ok
13:31:53 [kaz]
... (continue to add updates to the report.html)
13:35:39 [kaz]
... (goes through the file)
13:37:24 [kaz]
... (changes the criteria section)
13:37:41 [kaz]
13:38:18 [kaz]
Our goal is that all required features will have at least two implementations and all optional features will have at least one implementation.
13:38:20 [kaz]
13:39:53 [kaz]
(some discussion on how to track the resulted behaviors)
13:40:39 [kaz]
mm: (updates the "5. Implementation Report requirements" section)
13:46:32 [kaz]
... (moves ahead to "6. Systems" section)
13:47:51 [kaz]
... question about "servers" vs "clients". can be converted to "producers" vs "consumers" within the WoT context
13:50:12 [Ege]
13:50:16 [kaz]
... (then "7. Security")
13:50:20 [kaz]
13:51:42 [kaz]
mm: (revisits the issue on "servers" and "clients")
13:52:33 [kaz]
... producers should be assertion tester
13:52:50 [kaz]
13:53:23 [kaz]
... one consumer with multiple producers
13:53:59 [kaz]
... need manual assertions
13:54:35 [kaz]
ek: is there any feature used by both the sides?
13:55:54 [kaz]
mm: maybe we could split the Pass/Fail column into Consumer Pass/Fail and Producer Pass/Fail
13:57:00 [kaz]
... so could have two separate result columns, one for Consumers and another for Producers
13:59:59 [kaz]
... maybe we should have two separate tables
14:00:22 [kaz]
... one for data itself and another for behavior
14:01:08 [kaz]
(we're getting out of time...)
14:01:51 [kaz]
kaz: so will you push the updated report.html to the wot-testing repo?
14:01:56 [kaz]
mm: yes, will do now
14:02:13 [kaz]
14:02:17 [kaz]
rrsagent, make log public
14:03:01 [Mizushima]
Mizushima has left #wot-pf
14:03:13 [kaz]
rrsagent, draft minutes
14:03:13 [RRSAgent]
I have made the request to generate kaz
14:13:00 [Ege]
Topic: Minutes review
14:58:51 [zkis]
zkis has joined #wot-pf
15:15:26 [Zakim]
Zakim has left #wot-pf