16:00:12 RRSAgent has joined #did-topic 16:00:12 logging to https://www.w3.org/2021/04/29-did-topic-irc 16:00:27 Zakim has joined #did-topic 16:02:17 present+ 16:02:25 rrsagent, make minutes public 16:02:25 I'm logging. I don't understand 'make minutes public', brent. Try /msg RRSAgent help 16:03:06 rrsagent, draft minutes 16:03:06 I have made the request to generate https://www.w3.org/2021/04/29-did-topic-minutes.html brent 16:03:15 rrsagent, make logs public 16:03:30 zakim, this is did-topic 16:03:30 got it, brent 16:03:40 chair: brent 16:04:20 meeting: decentralized identifier working group - special topic call 16:05:25 scribe+ 16:05:40 scribe+ 16:05:47 brent: Let's dive in... 16:05:49 Orie has joined #did-topic 16:05:49 Topic: DID test suite 16:05:52 q+ 16:05:57 ack manu 16:06:00 https://github.com/w3c/did-test-suite/pulls 16:06:01 present+ 16:06:09 https://github.com/w3c/did-test-suite/pull/70 16:06:15 present+ 16:06:22 manu: PRs to review, Shigeya's looks good. I think we should pull it in. 16:06:33 ... I still don't know what the docker image does. 16:07:00 Orie: for folks who want to run the test harness as a web server, then you can send JSON to it. 16:07:16 ... if someone wanted to host it, that would allow real-time DID testing 16:07:27 manu: is there an example of how to do it? 16:07:41 Orie: there was. I expect it should still work. 16:08:10 manu: I don't expect it to work. I am skeptical that it will work after the restructuring. Is there anything in the readme? 16:08:30 Orie: there was, at one point we hosted a version of it. possible the restructuring broke it. 16:08:43 manu: shigeya have you been able to test that this works? 16:08:50 shigeya: it worked as expected 16:09:00 ... I agree with Orie 16:09:18 https://github.com/w3c/did-test-suite/pull/71 16:09:18 manu: other PR is initial JSON test, is buchner here? 16:09:45 ... hopefully he got his answers. Can't merge until tests are done. 16:09:52 https://github.com/w3c/did-test-suite/pull/71/files#diff-a311c8ed2431c0662a73a2e224d5fed7edfd946d8c201df6bc7f1fb877b609a9R31-R35 16:10:27 manu: we don't have any boolean or null properties, not sure if there are sequence values where order is important. 16:10:44 ... it may be that we have some tests for which there aren't test values 16:10:54 https://did.actor/mike/ 16:11:02 https://did.actor/mike/did.json 16:11:10 ... it is possible that two implementations could submit a test with unregistered properties that have these value types to test them 16:11:14 ^ a did document that uses features nobody else uses. 16:11:18 ... would there be objections to that? 16:11:41 markus_sabadello has joined #did-topic 16:11:43 present+ 16:11:45 ... Orie has one, we would need one more 16:12:03 q+ 16:12:17 ... I don't think this really needs to be tested, even if we leave the normative statements in, but the easiest thing is to get two examples in. 16:12:27 Orie: these features need to be tested or removed. 16:13:13 markus_sabadello: if Ories submits did mike, then daniel bichner can submit something as well. We can point him to this conversation and ask him to submit an implementation that tests them. 16:13:30 s/markus_sabadello/manu/ 16:13:35 manu: Amy has created a checklist for all normative statements 16:13:36 https://github.com/w3c/did-test-suite/issues/72 16:13:41 https://github.com/w3c/did-test-suite/issues/73 16:13:47 https://github.com/w3c/did-test-suite/issues/74 16:13:48 https://github.com/w3c/did-test-suite/issues/75 16:13:50 https://github.com/w3c/did-test-suite/issues/76 16:13:55 https://github.com/w3c/did-test-suite/issues/77 16:14:19 ... wee need to assign these to people, this will let us be sure all the normative statements are tested. 16:14:28 ... who did syntax and parameters? 16:14:54 markus_sabadello: I did some 16:15:01 manu: I will take data model 16:15:51 manu: production and consumption are all together, so this will be daniel (JSON), me (JSON-LD), and Jonathan (CBOR) 16:16:00 ... markus is resolution 16:16:03 markus_sabadello: yes 16:16:20 manu: did methods are all human testable, I'll assign Drummond 16:16:41 ... once we go through the checklists we will know if we have all the tests we need. 16:16:51 ... need to be done before our next tuesday call 16:17:05 manu: any concerns or objections? 16:17:14 brent: not hearing any 16:17:19 https://github.com/w3c/did-test-suite/issues/51 16:17:28 manu: last item, @issue51 16:17:42 ... we have 5? implementations 16:18:08 Orie: There's not enough data to justify investing in visualization 16:18:19 manu: I disagree, we have 9 implementations, when is it enough? 16:18:47 Orie: if we have 9 actual separate ones, that would be enough. Last I checked it wasn't enough. 16:19:04 manu: there are 5 methods and 3 resolvers and 1 dereferencer 16:19:16 Orie: at a minimum we need two of each 16:19:26 manu: but we still need a report 16:19:53 ... we need at least one of each thing. I suggest we have enough. If you disagree, I want to know how much we need. 16:20:24 Orie: there was automated reporting set up. It should be possible, but I am hesitant to do it with only 1 of a thing. 16:20:48 manu: the only thing that coyuld change at this point is adding or removing tests, I hope the test generator doesn't care. 16:21:01 ... I don't think it's wasted effort to do a report. 16:21:16 Orie: generating the report it trivial, anyone can do it. 16:21:28 ... the question is if we shoudl do it now 16:21:47 manu: I would prefer that 16:22:40 Orie: at what point is the report visualized enough. we have the automated one, I did an implementation that was better, but it is possibly broken since the refactor 16:22:56 manu: that's the one I mean, I'm fairly sure its broken, could you fix it? 16:23:11 Orie: if tests change, that report breaks 16:23:42 manu: that means we'll have to wait. I was hoping we could get it to a stage where we can see how far off we are. 16:23:52 ... without having to manually do it. 16:23:59 ... that's not ideal 16:24:09 Orie: the code is there, anyone can update it. 16:24:28 manu: it was hard for me to understand it. Not clear to me how the tallying was happening 16:24:50 ... looking at the package.json 16:25:12 Orie: follow the link at the top level readme will lead you to thow to generate the test report. 16:25:29 ... it would do well to have another developer look at it 16:25:47 manu: then we will need someone to step forward. 16:25:58 Orie: I at least need someone else to work with 16:26:27 manu: we'll put that out to the group. We need that for visibiity in how we're doing 16:26:34 ... any other issue to discuss? 16:26:48 https://github.com/w3c/did-test-suite/tree/main/packages/did-core-test-server 16:26:52 markus_sabadello: which part of the code is about the reports? 16:26:56 https://github.com/w3c/did-test-suite/blob/main/packages/did-core-test-server/package.json#L11 16:27:10 https://github.com/w3c/did-test-suite/tree/main/packages/did-core-test-server#usage 16:27:12 https://github.com/w3c/did-test-suite/blob/main/packages/did-core-test-server/generate-latest-respec-data.js 16:27:25 markus_sabadello: thanks 16:27:48 https://github.com/w3c/did-test-suite/blob/main/index.html#L686 16:27:52 ^ rally this is the problem 16:28:03 report is generated client side from json in respec 16:28:05 thats highly brittle 16:30:01 brent: I will send an email to the mailing list that points folks to github 16:30:26 present+ 16:30:39 action: brent will send an email to the list 16:30:49 zakim, who is here? 16:30:49 Present: manu, Orie, shigeya, markus_sabadello, TallTed 16:30:51 On IRC I see markus_sabadello, Orie, Zakim, RRSAgent, brent, chriswinc, ChristopherA, dlongley, manu, shigeya, wayne, cel, rhiaro 16:30:58 present+ 16:31:01 zakim, who is here? 16:31:01 Present: manu, Orie, shigeya, markus_sabadello, TallTed, brent 16:31:03 On IRC I see markus_sabadello, Orie, Zakim, RRSAgent, brent, chriswinc, ChristopherA, dlongley, manu, shigeya, wayne, cel, rhiaro 16:31:16 zakim, end the meeting 16:31:16 As of this point the attendees have been manu, Orie, shigeya, markus_sabadello, TallTed, brent 16:31:18 RRSAgent, please draft minutes 16:31:18 I have made the request to generate https://www.w3.org/2021/04/29-did-topic-minutes.html Zakim 16:31:21 I am happy to have been of service, brent; please remember to excuse RRSAgent. Goodbye 16:31:26 Zakim has left #did-topic 16:31:38 rrsagent, bye 16:31:38 I see 1 open action item saved in https://www.w3.org/2021/04/29-did-topic-actions.rdf : 16:31:38 ACTION: brent will send an email to the list [1] 16:31:38 recorded in https://www.w3.org/2021/04/29-did-topic-irc#T16-30-39