14:13:22 <RRSAgent> RRSAgent has joined #wot-pf
14:13:22 <RRSAgent> logging to https://www.w3.org/2022/11/16-wot-pf-irc
14:13:25 <dape> dape has joined #wot-pf
14:13:30 <kaz> meeting: WoT Testing/Plugfest
14:13:38 <kaz> q+
14:13:54 <mlagally__> ## manual vs. automated testing
14:13:57 <kaz> ack k
14:14:03 <kaz> chair: Lagally
14:14:12 <kaz> topic: Agenda
14:14:13 <Fady> Fady has joined #wot-pf
14:14:32 <Ege> https://www.w3.org/WoT/IG/wiki/PlugFest_WebConf let's do it there I think :)
14:14:35 <kaz> * Continue the testing conversation wrt. profile
14:14:45 <kaz> * Overall testing structure
14:14:57 <kaz> * manual vs. automated testing
14:14:59 <kaz> q?
14:15:13 <kaz> s/## manual vs. automated testing//
14:15:16 <kaz> q+
14:16:41 <kaz> present+ Kaz_Ashimura, Michael_Lagally, Daniel_Peintner, Ege_Korkan, Fady_Salama, Ryuichi_Matsukura, Sebastian_Kaebisch, Tomoaki_Mizushima
14:17:23 <sebastian_> Ege: suggest to talk about testing structure
14:17:58 <sebastian_> <ML setup the Agenda>
14:18:03 <sebastian_> topic: Minutes
14:18:29 <sebastian_> ->
14:18:39 <sebastian_> s/->/
14:18:41 <sebastian_> -> https://www.w3.org/2022/11/09-wot-pf-minutes.html
14:19:33 <kaz> s/html/html Nov-9/
14:19:48 <kaz> rrsagent, make log public
14:19:54 <kaz> rrsagent, draft minutes
14:19:54 <RRSAgent> I have made the request to generate https://www.w3.org/2022/11/16-wot-pf-minutes.html kaz
14:19:56 <sebastian_> Kaz: updated some off topics and speaker names
14:21:11 <sebastian_> ML: any objections?
14:21:12 <sebastian_> no
14:21:29 <sebastian_> topic: Overall testing structure
14:21:42 <sebastian_> Ege: I can share my screen
14:21:43 <kaz> i/Continue/scribenick: kaz/
14:21:56 <sebastian_> <ML shows the current folder structure of the testing repo>
14:21:57 <kaz> i/suggest to talk/scribenick: sebastian_/
14:22:00 <kaz> rrsagent, draft minutes
14:22:00 <RRSAgent> I have made the request to generate https://www.w3.org/2022/11/16-wot-pf-minutes.html kaz
14:22:01 <kaz> q?
14:22:03 <kaz> ack k
14:22:34 <kaz> rrsagent, draft minutes
14:22:34 <RRSAgent> I have made the request to generate https://www.w3.org/2022/11/16-wot-pf-minutes.html kaz
14:22:38 <sebastian_> <Ege starts to share and explains the folder structure in the testing repo>
14:23:11 <kaz> -> https://github.com/w3c/wot-testing/tree/main/data wot-testing repo - data area
14:23:29 <sebastian_> Ege: data folder is used to copy all test files in one place
14:23:49 <Fady> q+
14:24:12 <sebastian_> <Ege shows the README of the July 2022 TestFest>
14:24:25 <kaz> -> https://github.com/w3c/wot-testing/tree/main/events/2022.07.Online wot-testing repo - 2022.07.Online area
14:24:27 <kaz> q+
14:24:52 <sebastian_> Ege: for the September TestFest event we miss to provde a reated README
14:25:05 <sebastian_> s/provde/provide
14:26:25 <sebastian_> ... we should provide all information in a single place (in testing repo)
14:26:44 <sebastian_> ML: What is in the data/input_2022 folder?
14:27:36 <sebastian_> Ege: all the data that is required to provide the implementation report
14:27:43 <sebastian_> q+
14:27:46 <Fady> q-
14:28:16 <sebastian_> ML: Where the implementation report generated?
14:28:31 <sebastian_> Ege: Locally on McCools computer
14:28:44 <kaz> s/McCools/McCool's/
14:28:56 <sebastian_> ML: This is not transparance.
14:29:04 <sebastian_> Ege: agree
14:29:17 <Ege> q?
14:29:22 <kaz> s/transparance/transparent/
14:30:20 <sebastian_> Kaz: I'm agree with ML points, but we should clearify existing issues
14:31:03 <sebastian_> ... we should talk with McCool to solve this issue
14:31:38 <kaz> ack k
14:31:42 <sebastian_> ... and improve the situation
14:33:00 <sebastian_> <Ege creates an issue>
14:33:33 <mlagally__> q?
14:34:27 <kaz> s/I'm agree with ML points, but we should clearify existing issues/As I've been asking you all, we need to generate a clear guideline on how to submit test results. So I basically agree with Lagally's points. However, we should once clarify our issues and our existing resources first./
14:35:43 <kaz> s/we should talk with McCool to solve this issue/And then we (including McCool) should discuss how to solve the issues based on the existing resources next./
14:36:05 <kaz> s/and im/to im/
14:36:32 <kaz> q?
14:36:34 <kaz> ack s
14:36:40 <kaz> q+
14:37:22 <sebastian_> SK: This is a know sitatuaton since a while, however, the script simple takes the input from the testing folder and creates the IR webpage
14:37:36 <kaz> s/know si/known si/
14:37:50 <sebastian_> ... we should continue this discussion when McCool is available again
14:38:22 <sebastian_> ML: we should simplify the process befor the next TestFest
14:38:31 <sebastian_> q+
14:38:49 <kaz> ack k
14:39:04 <Ege> q+
14:39:48 <kaz> kaz: We've been skimming the existing resources for 5 mins or so
14:40:04 <sebastian_> Ege: we should avoid to ask developer to provide there inputs in different  repos
14:40:14 <sebastian_> ack s
14:40:18 <sebastian_> ack e
14:40:50 <sebastian_> <ML creates a new Issue>
14:41:01 <kaz> s/or so/or so. So I'd suggest we record all those resources, and clarify what is done by whom (which repository and which tool on which folder based on which guideline)/
14:41:02 <sebastian_> -> https://github.com/w3c/wot-testing/issues/478
14:42:40 <sebastian_> ML: I would not see some issues here. However, I would prefer to see a simple description aout the overall process
14:42:50 <sebastian_> s/aout/about
14:43:02 <sebastian_> s/sitatuaton/situation
14:43:33 <kaz> q+
14:43:52 <dape> q+
14:44:38 <kaz> s/478/478 Issue 478 - Problems with Current Testing/
14:44:51 <sebastian_> Kaz: We should create another list on the existing resources. We should handle 2 topics in parallel
14:45:44 <sebastian_> s/<ML creates a new Issue>/<ML updates issue 478>
14:46:22 <kaz> kaz has joined #wot-pf
14:46:42 <sebastian_> ML: is the validation of TD inputs documented?
14:46:44 <Ege> https://github.com/w3c/wot-testing/blob/main/.github/workflows/validation.yaml
14:47:06 <sebastian_> Ege: its based on the TD playground
14:47:25 <sebastian_> s/https://github.com/w3c/wot-testing/blob/main/.github/workflows/validation.yaml/->https://github.com/w3c/wot-testing/blob/main/.github/workflows/validation.yaml
14:47:37 <kaz> q?
14:47:41 <kaz> ack k
14:48:01 <kaz> rrsagent, make log public
14:48:07 <kaz> rrsagent, draft minutes
14:48:07 <RRSAgent> I have made the request to generate https://www.w3.org/2022/11/16-wot-pf-minutes.html kaz
14:48:32 <Ege> q+
14:48:36 <Ege> ack d
14:48:40 <sebastian_> Danial: Last time the manuel csv was changed during the testing week. We should avoid this for the next time
14:48:55 <dape>  ack dape
14:49:05 <sebastian_> ... should be also listed in the issue 478
14:49:46 <kaz> q+
14:49:49 <kaz> ack e
14:50:07 <kaz> s/manual csv/manual.csv/
14:50:37 <dape> s/Danial:/Daniel:
14:50:58 <sebastian_> Kaz: we have only 10min left, we should clearify what should be clearified
14:50:58 <mlagally__> https://github.com/w3c/wot-testing/issues/478
14:51:07 <mlagally__> https://github.com/w3c/wot-testing/issues/479
14:51:40 <sebastian_> topic: Testing-based PR from Profile
14:51:46 <kaz> s/clearified/clarified, and ask people to give inputs for the two GitHub Issues, one on the problems and another on the existing resources/
14:52:03 <sebastian_> -> https://github.com/w3c/wot-profile/pull/324
14:52:13 <sebastian_> q+
14:52:31 <kaz> s|https://github.com/w3c/wot-testing/issues/478|-> https://github.com/w3c/wot-testing/issues/478 Issue 478 - Problems with Current Testing|
14:52:34 <kaz> ack k
14:52:38 <kaz> ack s
14:52:53 <Ege> q+
14:53:17 <kaz> s|https://github.com/w3c/wot-testing/issues/479|-> https://github.com/w3c/wot-testing/issues/479 Issue 479 - Describe and consolidate existing process and tooling|
14:53:19 <kaz> q+
14:53:51 <kaz> i|324|topic: Profile Testing|
14:54:32 <sebastian_> SK: the content of the PR is fine, however, should go to testing repo
14:54:43 <sebastian_> ML: Where should it go exactly?
14:54:55 <sebastian_> Ege: this should go to the data folder
14:55:22 <sebastian_> ... data/input_2022/Profile
14:55:22 <kaz> s/324/324 wot-profile PR 324 - December Testfest Preparation - implementation cross reference and xref tool/
14:56:31 <kaz> q?
14:56:32 <kaz> ack e
14:58:19 <sebastian_> q+
14:59:26 <sebastian_> Kaz: are you ok, to move the content of the PR to the testing folder?
15:00:02 <sebastian_> ML: I'm ok to provide the content to a different place, however, it should be clearified what the developer should do.
15:00:21 <Ege> for the minutes, I did not do a formal objection that is what the W3C Process is referring to: https://www.w3.org/2021/Process-20211102/#WGArchiveMinorityViews
15:02:23 <kaz> kaz: In that case, we can merge this PR itself today, and register this as an existing problem to Issue 478 and as an existing resource to Issue 479. Then we should continue the discussion on how to improve the current messy situation next week with McCool during the Testing call.
15:02:43 <kaz> q?
15:02:45 <kaz> ack k
15:02:46 <kaz> ack s
15:03:15 <kaz> s/clearified/clarified/
15:03:22 <kaz> q?
15:04:27 <kaz> q+
15:04:58 <Ege> also for the minutes, the W3C process does not talk about objections to Pull Requests. What I did was saying that we should not merge this PR.
15:07:22 <Ege> Ege has left #wot-pf
15:07:44 <kaz> q?
15:09:35 <kaz> s|for the minutes, I did not do a formal objection that is what the W3C Process is referring to: https://www.w3.org/2021/Process-20211102/#WGArchiveMinorityViews||
15:09:52 <kaz> s|also for the minutes, the W3C process does not talk about objections to Pull Requests. What I did was saying that we should not merge this PR.||
15:10:00 <kaz> rrsagent, draft minutes
15:10:00 <RRSAgent> I have made the request to generate https://www.w3.org/2022/11/16-wot-pf-minutes.html kaz
15:12:36 <kaz> [ no objection to merge wot-profile PR 324 itself; However, this resource to be registered to the existing problem list (wot-testing Issue 478) and the existing resource list (wot-testing Issue 479). Also could be move to wot-testing repository after some more discussion during the next Testing call. ]
15:12:39 <kaz> [adjourned]
15:12:47 <kaz> rrsagent, make log public
15:12:52 <kaz> rrsagent, draft minutes
15:12:52 <RRSAgent> I have made the request to generate https://www.w3.org/2022/11/16-wot-pf-minutes.html kaz
15:14:50 <dape> dape has left #wot-pf
15:15:11 <kaz> i/We've been/scribenick: kaz/
15:15:28 <kaz> i/we should avoid/scribenick: sebastian_/
15:15:29 <kaz> rrsagent, draft minutes
15:15:29 <RRSAgent> I have made the request to generate https://www.w3.org/2022/11/16-wot-pf-minutes.html kaz
15:15:51 <kaz> i/In that case/scribenick: kaz/
15:15:52 <kaz> rrsagent, draft minutes
15:15:53 <RRSAgent> I have made the request to generate https://www.w3.org/2022/11/16-wot-pf-minutes.html kaz