14:48:15 RRSAgent has joined #annotation 14:48:15 logging to http://www.w3.org/2016/04/22-annotation-irc 14:48:20 trackbot, start meeting 14:48:22 RRSAgent, make logs public 14:48:22 Zakim has joined #annotation 14:48:24 Zakim, this will be 2666 14:48:24 ok, trackbot 14:48:25 Meeting: Web Annotation Working Group Teleconference 14:48:25 Date: 22 April 2016 14:48:37 Chair: Rob_Sanderson, Tim_Cole 14:48:43 Present+ Rob_Sanderson 14:50:01 TimCole has joined #annotation 14:51:07 Regrets+ Ben_de_Meester 14:53:44 Meeting: Web Annotation Working Group Teleconference 14:55:40 present+ 14:55:49 present+ Tim_Cole 15:00:01 tbdinesh has joined #annotation 15:00:37 present+ ShaneM 15:01:16 tilgovi has joined #annotation 15:02:07 Present+ Ivan 15:02:35 Present+ Benjamin_Young 15:03:02 Present+ Randall_Leeds 15:03:34 *sniff* 15:03:47 scribenick: azaroth 15:04:01 TimCole: Let's get started 15:04:08 TOPIC: Agenda Review, Announcements 15:04:57 TimCole: (walks through agenda) Anything else we need to talk about? 15:05:10 present+ tb_dinesh 15:05:21 takeshi has joined #annotation 15:05:22 davis_salisbury has joined #annotation 15:05:25 Present +dan_whaley 15:05:32 ... Okay. Want to announce that at the next couple of DPUB IG meetings will have topics of interest for this group 15:05:41 present+ davis_salisbury 15:05:43 http://spec-ops.github.io/html-note/index.html 15:05:51 ... Draft note from Shane, any background? 15:06:01 Present+ Takeshi_Kanai 15:06:13 ShaneM: Happy to. Short story is, A11y folks and DPUB folks have talked about the need for semantically rich way of marking up notes 15:06:28 ... HTML is not good at this. Gathered some ideas a year ago and recently revised 15:06:52 ... Possible to do as an HTML extension. Can implement as what was called a web component 15:06:58 uskudarli has joined #annotation 15:07:15 ... Revived the interest in that, put together a skeleton, and going to see if there's support in the IG to move forwards 15:07:38 TimCole: Would be nice to have that. There's a reference to the WAWG doc, so feedback would be welcome 15:07:51 ... Not sure if this relates to Doug's interest in HTML serialization issues 15:08:10 shepazu: Not sure if this is related or a separate branch. What I tried was very similar 15:08:33 TimCole: Other thing, the following week (May 2) has a discussion of WDs of our group 15:08:47 ... Rob and I will be on the call, and try to describe where we are 15:09:05 PaoloCiccarese has joined #annotation 15:09:08 ... see if there's feedback on the drafts. Might be useful to have it before Berlin, so we can discuss any feedback 15:09:15 ... Ivan any thing else? (no) 15:09:22 ... Other announcements? 15:09:23 q? 15:09:36 TOPIC: Minutes Approval 15:09:40 PROPOSED RESOLUTION: Minutes of the previous call are approved: https://www.w3.org/2016/04/15-annotation-minutes.html 15:10:04 q? 15:10:07 RESOLUTION: Minutes of the previous call are approved: https://www.w3.org/2016/04/15-annotation-minutes.html 15:10:43 TOPIC: Testing 15:10:58 Regrets+ Ben_De_Meester 15:11:06 TimCole: First, need to get a sense of progress and what we need. 15:11:21 ... Can you review for the group, Shane? 15:11:35 ShaneM: We've done some thinking and there's some momentum to get the infrastructure in place 15:11:39 https://lists.w3.org/Archives/Public/public-annotation/2016Apr/0077.html 15:11:45 q+ 15:11:46 ... But that's where we're at, haven't solved any problem yet 15:12:02 ... Talked with web platform tests to see if that's the right place, and it seems to be 15:12:06 https://github.com/Spec-Ops/web-platform-tests 15:12:17 ... The reason that was a question at all is that those tests are about exercising user agents 15:12:37 ... And components are not UA centric. So didn't want to violate principles, or step on toes 15:12:56 ... We can drive the testing from the browser, which is good, people used to running W3C tests will be familiar with interface 15:13:24 ... have set aside the question of is it possible to automate the testing of clients when selecting parts of documents 15:13:33 ... Can be manual intervention though 15:13:35 Present+ Paolo_Ciccarese 15:14:00 conversation on public-test-infra https://lists.w3.org/Archives/Public/public-test-infra/2016AprJun/0000.html 15:14:04 ... For a given assertion, eg a MUST in the rec, that say the annotation takes a certain form 15:14:18 ... there's a couple of different ways to do it, but we can express tests in a declarative way with sample data 15:14:34 ... Select the region, run it through the client and push the data to make sure it has the right form 15:14:41 ... that sort of testing. 15:14:55 ... Don't think this is anything new, but we now have a model in mind and some people to put it together 15:14:59 q+ 15:15:08 ... There'll be some back end tooling for the web platform test environment 15:15:20 ... to support the declarative test cases 15:15:33 ... and a folder to put the tests in. Then running them is just select the folder and say run the tests 15:15:51 ... it'll run the automated ones for you. If you're a testing geek it's very interesting :) 15:16:03 ... I'll send out a mail to the group for an example test 15:16:27 ... Spec Ops has taken it on, as it's tightly coupled to the projects that we already have funded 15:16:31 ... was able to finesse it in 15:16:43 ... Don't have funding for annotation, but we need it elsewhere (Payments) 15:16:43 ack shepazu 15:17:13 shepazu: Another question came up... Shane's initial one was should we do client side testing 15:17:30 ... The testing methodologies for related things were like checking for self consistency and the shape of the data 15:17:59 ... Ontology/vocab specs has just been to test consistency, not the implementation 15:18:07 ... Exception for CSVW 15:18:13 ... Wanted to see what the feeling of the group was 15:18:15 good question! 15:18:41 ... Should test what the user agents generate, but could be just is it consistent 15:18:50 ... Should we test both or just one? 15:19:04 Yes 15:19:05 Both 15:19:40 TimCole: The tests as described involve whether its consistent with the model 15:19:44 Servers MUST be tested for the protocol spec. 15:19:46 ... but semantics harder to test 15:19:47 +1 to both 15:19:58 q+ 15:19:59 ack ivan 15:20:04 tilgovi has joined #annotation 15:20:41 ivan: One thing is that we have implementations, some are here in the group, that are not specifically browser based in the way that I understand the web platform to work 15:20:59 ... one of the differences might be that the media on which the annotations happen are not HTML but say images 15:21:15 ... we need the implementations, they're equally valid for the CR or should be, and whether that fits the testing model? 15:21:23 it fits the model. 15:21:36 ... in some sense the extreme case, but perhaps for purely timing reasons, might have implementations that are part of an epub reader 15:21:53 ... have two, one mainly, but are completely out of the browser picture 15:22:09 ... Other question is that I presume this doesn't relate to the protocol testing? 15:22:38 ... Presume has to go through some different means? And also, agree that both should be tested, but on a practical level if we have timing then the priority is the testing of the model 15:22:46 to be clear, all we can test is the Web Annotation Data Model serialization provided from the clients--where that JSON hits the testing code (browser, server, command line) is a matter of deployment 15:22:48 ... that's what's critical to have the CR phase complete 15:22:53 ePub reader testing could be done here - but the connection between the ePub reader and the test environment is an exercise for the ePub reader implementor 15:22:55 ... Have to be careful on priorities 15:22:55 ack shep 15:22:59 tilgovi_ has joined #annotation 15:23:27 shepazu: There's a class of user agent that won't be able to use the test framework, so the tests themselves should run in both the platform and elsewhere 15:23:50 ... for those user agents that aren't browser based, we could do self reporting 15:23:59 ... need a validator that they send their output to 15:24:17 ... Here is the JSON-LD, I'll put it in this form for the test, and the test gets run 15:24:24 ... does that seem reasonable? 15:24:49 q+ to mention that it would be possible to provide an endpoint on the web platform tests to which an ePub reader could push their annotation or whatever 15:24:56 ... if we should test the UAs, the spec is written so its largely about the vocab, not the UAs 15:25:04 ... not sure if we need a different spec to talk about what a UA should do 15:25:09 ... don't have a strong opinion 15:25:32 ... Could add normative assertions to the spec for conformance of UAs, which would help with testing 15:25:49 we can't test what isn't spec'd, and we haven't spec'd UA conformance and (under this current charter) we don't have time 15:25:50 ... maybe just at the beginning, UAs of this class, must do bla bla bla 15:25:55 ... then apply it to the different clients 15:26:12 ... recap existing assertions as applying to the generator of the content, rather than the model itself 15:26:30 scribenick: tilgovi 15:26:36 browser-based UA's won't have the same conformance requirements as a screen-scraper (for instance) 15:26:38 ack ShaneM 15:26:38 ShaneM, you wanted to mention that it would be possible to provide an endpoint on the web platform tests to which an ePub reader could push their annotation or whatever 15:27:16 q+ to describe image case 15:27:17 ShaneM: if any epub reader implemented the protocol we couldprovide a testing endpoint 15:27:49 ... the framework could open another endpoint for annotations 15:28:06 ... we're going to put that framework together regardless 15:28:24 ... your point is really good Doug, there's hardly any discussion of UA requirement sin the spec right now 15:28:29 q+ 15:28:32 ... I don't have an opinion on whether the group shuold define these or not 15:28:55 ... If you do, I encourage you to do it as a profile. They don't have to support all annotations, but they have to support them in the way you define it. 15:29:06 ... You have a lot of different ways of using annotation. 15:29:23 ack azaroth 15:29:23 azaroth, you wanted to describe image case 15:29:32 TimCole: Let's go forward in the queue for now. 15:29:56 azaroth: Like the image case, it's not native in the browser, but I think what Shane's just described would work very well for our types of user agents 15:30:06 ... if they implemented an early version of the protocol, they could relatively easily be updated 15:30:27 ... we could add the validator endpoint as somewhere to send the annotations and have the validator run the tests that it thinks it can based on what it's received 15:30:41 ack ivan 15:30:47 ... at least all of the syntactic validation should fit right in 15:31:04 s/if they/they/ 15:31:15 ivan: On the UA requirement, I am doubtful we can do something really useful and complete, at least in the lifetime of this working group. 15:31:41 +1 to Ivan -- priorities important, get what we need first, then nice to haves around different UAs 15:31:49 +1 to focusing on testing and shipping what we've already spec'd 15:31:58 ... If I look at the various types of user agents, from Hypothesis to epub readers, we have too many and I don't think we can do a meaningful work on that so it would not be my priority in view of the time we have 15:32:26 TimeCole: We talked before about grouping some of the features by things like media type as a way to have like profiles and acknowledged that no single implementation, as Shane mentioned, will do it all 15:32:34 q? 15:32:38 ... is that what we talked about previously, Ivan? 15:32:40 ivan: yeah. 15:33:10 TimCole: Maybe other implementors on the call have thoughts. 15:33:24 ... We talked a couple weeks ago about how we still need to do the work of identifying, in our documents, what are the testable features. 15:33:32 ... I think we still have to do that. 15:33:39 q+ 15:33:41 ... Am I right? 15:34:02 ShaneM: I believe you're correct. I know that I had an action to identify some things. I dind't do that and I apoligize. 15:34:17 ... Greg Kellogg did do some of that, in the context of the discussions we were having. 15:34:28 ... Showing how we much craft a declarative test. 15:34:35 gregg has 1 karma 15:34:38 s/much/might/ 15:34:54 ... You use a declarative grammar to say "this is what is to be tested" and then you write a framework that is the script 15:35:02 q+ to ask about automation of declarations from ontology 15:35:22 ... We are looking for the possibility that anyone can write a test. Since the declarative grammar is JSON and you are all very familiar we JSON that's one fo the reasons we're looking at this route. 15:35:23 here's the draft from gregg https://gist.github.com/gkellogg/4ff74c27313e95a6b3dcbad6cc64277a 15:35:30 ... There's a gist he put up. Thank you, Benjamin. 15:35:54 ... I hadn't planned to go through this because it's embryonic, we just started the work. 15:36:02 it's 75% JSON Schema fwiw 15:36:17 ... If you follow that link, the test is the input about the test that defines the context and the annotation. It's the input for a test. 15:36:35 q+ 15:36:38 TimCole: Maybe if people look at that you can get more people to help find and make those declarative tests about the assertions. 15:37:04 ShaneM: Yes. If we can get a few examples, hopefully we can cut up the spec and one person can go off and look at a section and add these testable assertions 15:37:06 advantage of declarative is that we can use them in the browser, via the command line, or an API 15:37:16 ack takeshi 15:37:21 TimCole: In the interest of times, I'd like to wrap this discussion up for the day, in ten minutes or so. 15:37:47 takeshi: I'm implementing a sort of annotation application as a prototype and that is a native application, not based on the browser engine. 15:37:59 ... Since we are focusing on handwriting, the text selection is in second priority. 15:38:20 ... Even if we receive the text selection annotation from the server it might be ignored or just show up as an annotation to that web page. 15:38:34 ... That could be different from the expectation for others, but at this time this is what I am planning to do. 15:38:58 ... If the specification requires that any of the feature has to be implemented in the annotation application, I'm afraid that my application could not meet that criteria. 15:39:55 TimCole: Would you application be able to send annotations that you generate as JSON-LD to a validator. 15:40:25 how do you test if a feature (such as selection) is implemented in an annotation appl? 15:40:28 ack azaroth 15:40:28 azaroth, you wanted to ask about automation of declarations from ontology 15:40:31 takeshi: Even though all the annotation data will be sent in the JSON-LD, we might ignore some annotations we have in JSON-LD 15:41:24 azaroth: Many of the requirements are in the vocabulary with which properties they should be used with and whether you can have more than one, etc 15:42:08 ... It may be useful if we create at least stubs of all of the possible tests going forward, and workin with the IDPF to make the JSON schema ... there's a lot of shared tooling around what sorts of tests can be written given the flexibility of RDF and JSON-LD, but still keeping it within the spec. 15:42:24 ... Question then is, is that something that we should look into? I'm happy to spend a bit of time working on it. 15:42:29 ShaneM: That would be fantastic. 15:43:01 ... We envisioned doing certain kinds of exercising automatically. We have some tooling for that, but let's not monopolize this meeting. 15:43:04 ack ivan 15:43:22 ivan: Rob almost said everything I wanted to say. I have one additional thing to add. 15:43:35 ... I think having JSON Schema around as an additional tool we give to current and future implementors would be useful anyway. 15:43:49 ... We can have an informative reference on the website alongside the context file. 15:43:51 q? 15:44:06 ShaneM: Obviously, JSON Schema is much more restrictive in terms of structure than JSON-LD, but that's okay. 15:44:30 TimCole: I don't think I heard any formal actions, but clearly members need to look at how these assertions and testable features are expressed in a declarative way and think about how to contribute to that. 15:44:38 ... The JSON schema would be useful. 15:44:45 ... And we have the potential automating of some of the tests. 15:44:54 ... We probably need to think about timeline for getting these things done. 15:45:05 Here is my ask: Anyone who wants to be looped in, go to http://lists.spec-ops.io/listinfo.cgi/testdev-spec-ops.io and join the list 15:45:12 ... Can I suggest we make it of prime importance for next weeks call to think about what we want to get done before the face to face. 15:45:21 and yes - let's set a schedule in the next week 15:45:25 ... Does that sound like a way forward? Did I miss something important? 15:45:48 Topic: Issues 15:46:19 TimCole: Issue #200 was should oa:start and oa:end always use xsd:nonNegativeInteger. 15:46:23 https://github.com/w3c/web-annotation/issues/200 15:46:39 ... I think we talked about lat week that this proposal was the way to do it. The answer was yes. We wanted to give people a chance to think about it for a week. 15:46:43 ... Do we need further discussion on this? 15:46:59 azaroth: I think we can make it an editorial action to update the context. 15:47:23 ... The concern that I had that stain proved was not a concern, whether or not JSON-LD compaction causes nonNegativeInteger to stick around. 15:47:29 EmrahGuder has joined #annotation 15:48:04 PROPOSED RESOLUTION: Accept git issue #200, make start and end nonNegativeInteger in @context 15:48:06 +1 15:48:07 +1 15:48:07 +1 15:48:10 +1 15:48:20 +1 15:48:22 +1 15:48:26 +1 15:48:27 I am abstaining - too new here 15:48:30 I can't reproduce the success described. 15:48:36 With compaction removing it. 15:49:35 rrsagent, pointer? 15:49:35 See http://www.w3.org/2016/04/22-annotation-irc#T15-49-35 15:49:37 RESOLUTION: Accept git issue #200, make start and end nonNegativeInteger in @context 15:49:47 https://github.com/w3c/web-annotation/issues/203 15:50:19 TimCole: The discussion last week on selectors vs media types, there was a lot of positive response about what's been put together. 15:50:41 ivan: I think the idea that came out of some discussion was that this table should exist, so I sat down on made it. I think it should go back to the editors to look at. 15:50:52 ... There are comments I made in the issue, but I think they are all editorial. 15:51:15 ... I would propose this is something Benjamin, Rob, and I can handle on email. 15:51:20 +1 with a few minor tweaks (e.g. Fragment should be either tick or ?, as we don't know future fragment specs and don't want to suggest they're not to be used) 15:51:39 TimCole: So a proposal would be to put this to editor action. 15:52:02 PROPOSED RESOLUTION: Accept proposed media/selector table towards conformance section of the specs 15:52:06 +1 15:52:08 +1 15:52:09 =1 15:52:11 +1 15:52:18 +1 15:52:32 +1 15:52:46 RESOLUTION: Accept proposed media/selector table towards conformance section of the specs 15:52:57 https://github.com/w3c/web-annotation/issues/195 15:52:58 rrsagent, pointer? 15:52:58 See http://www.w3.org/2016/04/22-annotation-irc#T15-52-58 15:53:03 TimCole: Let's take one more issue today. 15:53:11 ... this was the issue involving refining state by selector. 15:53:28 ... As I understood the thread, there's some confusion about what is needed here. 15:54:22 ivan: There is a question if I can mix, with some limitations, the refinements. Can I refine a state with a selector? 15:54:34 ... I have the impression that there is no disagreement on that between us. 15:54:48 azaroth: There are no disagreements on that. It would be good to be able to refine a state with a selector. 15:55:07 ivan: I would propose to do that, then, and let that be an editorial action. 15:55:21 q+ 15:55:26 azaroth: To be clear, where we may disagree, I think it should still be possible to have both hasState and hasSelector on a specific resource. 15:55:33 ivan: I'm saying I'd like to separate these two questions. 15:55:47 TimCole: Can we do that? Can a new issue be created and some resolution be posted to the issue to Github. 15:55:54 ... in the meantime we can close the other issue. 15:56:03 q- 15:56:12 ivan: I think that the issue is saying, can a refinement be made on a state? 15:56:20 ... we can make that a sepraate issue and make it editorial right away. 15:57:02 TimCole: I want to give people a chance over the week before we actually close it out. 15:57:02 https://github.com/w3c/web-annotation/issues/147 15:57:21 TimCole: We don' thave time to talk about HTML serialization in depth, we don't have time, but there was discussion in 147 15:57:46 ... about the challenges in that RDFa people will be using different labels because you don't have the context available in RDFa that we have in JSON-LD. 15:57:50 ... Do we need to talk about this? 15:58:20 +1 to the namespace 15:58:48 ivan: To have that namespace document before the end of the WG is probably a good idea. 15:59:05 ... I can look at doing it, or someone else can. At this moment I cannot do it and I think it should not have a high proiority for the coming weeks. 15:59:22 q+ 15:59:29 TimCole: Let's leave it in there and we'll get to it after Berlin, I guess. 15:59:52 ack ivan 15:59:54 ivan: A question to Rob. 16:00:14 ... Rob, I am in a complete mess right now... what happens to the vocabulary file and the context file that should be pushed on to /ns? 16:00:26 ... I haven't done anything on installing it on the W3C side because I have no idea where we are. 16:00:31 azaroth: I'm in the same state, I must admit. 16:00:39 ivan: At some point we have to do that. We are already out of sync. 16:01:11 ... By the time we go to CR, when tests become available, these things should be in sync. 16:01:18 TimCole: Anything else? 16:01:24 ... Thanks, everybody. We'll talk next week. 16:01:35 tilgovi has left #annotation 16:01:49 rrsagent, draft minutes 16:01:49 I have made the request to generate http://www.w3.org/2016/04/22-annotation-minutes.html ivan 16:01:57 trackbot, end telcon 16:01:57 Zakim, list attendees 16:01:57 As of this point the attendees have been Rob_Sanderson, TimCole, Tim_Cole, ShaneM, Ivan, Benjamin_Young, Randall_Leeds, tb_dinesh, davis_salisbury, Takeshi_Kanai, Paolo_Ciccarese 16:02:05 RRSAgent, please draft minutes 16:02:05 I have made the request to generate http://www.w3.org/2016/04/22-annotation-minutes.html trackbot 16:02:06 RRSAgent, bye 16:02:06 I see no action items