14:05:53 RRSAgent has joined #iii 14:05:53 logging to https://www.w3.org/2022/09/14-iii-irc 14:05:55 Zakim has joined #iii 14:10:33 Meeting: Independent Interoperable Implementation and going beyond Candidate Recommendation - TPAC 2022 breakout 14:10:36 Chair: Philippe_Le_Hegaret, Nigel_Megitt 14:10:38 Agenda: https://www.w3.org/events/meetings/f1f4a11e-9f4e-48ea-b2a2-405fb13ce940#agenda 14:10:40 RRSAgent, make log public 14:10:42 RRSAgent, this meeting spans midnight 14:17:22 RRSAgent, stay 14:17:24 Zakim, stay 14:17:24 I don't understand 'stay', dom 15:14:58 dom has joined #iii 16:12:33 agenda+ breakout 16:14:30 tantek has joined #iii 17:09:26 tantek has joined #iii 18:02:13 tantek has joined #iii 18:15:49 dom has joined #iii 18:20:06 tantek has joined #iii 20:15:05 dom has joined #iii 20:30:10 dom has joined #iii 20:35:12 tantek has joined #iii 20:38:31 plh has joined #iii 20:38:52 plh has changed the topic to: Slides: https://www.w3.org/2022/Talks/TPAC/iiis-breakout/ 21:07:02 dom__ has joined #iii 21:52:36 gkellogg has joined #iii 21:52:59 dom has joined #iii 21:54:31 Mek has joined #iii 21:56:57 JeffWaters has joined #iii 21:58:48 tantek has joined #iii 21:59:21 gkellogg has joined #iii 21:59:28 lgombos_ has joined #iii 22:01:06 dsinger has joined #III 22:01:57 gsnedders_irc has joined #iii 22:02:27 florian has joined #iii 22:02:34 martinthomson has joined #iii 22:02:35 hjrchung has joined #iii 22:02:39 present+ Florian 22:03:53 tink has joined #iii 22:03:58 hober has joined #iii 22:03:59 present+ 22:04:01 present+ 22:04:02 present+ 22:04:02 present+ 22:04:03 preent+ Gregg_Kellogg 22:04:06 cwilso has joined #III 22:04:07 present+ Léonie (tink) 22:04:09 present+ dsinger 22:04:11 present+ 22:04:12 present+ 22:04:13 duga has joined #iii 22:04:15 Neil has joined #iii 22:04:18 cyril has joined #iii 22:04:20 Guest85 has joined #iii 22:04:22 Travis has joined #iii 22:04:22 present+ 22:04:24 present+ 22:04:26 present+ 22:04:29 present+ 22:04:30 zakim, pick a victim 22:04:30 Not knowing who is chairing or who scribed recently, I propose Travis 22:04:30 nigel has joined #iii 22:04:37 Brent has joined #iii 22:04:40 karlcow has joined #iii 22:04:47 Present+ Nigel_Megitt 22:04:49 present+ 22:04:51 present+ 22:04:55 pal has joined #iii 22:05:03 scrive: Travis 22:05:05 present+ 22:05:08 present+ 22:05:10 present+ 22:05:15 s/scrive/scribe/ 22:05:28 plh: this topic has been going around the W3C for awhile... 22:05:32 Zakim, can we examine the algorithm you used to pick Travis? 22:05:32 I don't understand your question, martinthomson. 22:05:45 .. goal of session is to have a discussion and potentially change the process. 22:05:58 .. not for the upcoming process, but maybe the next year (2024) 22:06:04 https://www.w3.org/2022/Talks/TPAC/iiis-breakout/ 22:06:10 .. slides 👆 22:06:16 mkhraisha has joined #iii 22:06:16 atai has joined #iii 22:06:31 present+ 22:06:35 .. rules are coming from Process doc which says.. 22:06:55 .. 22:07:04 .. process tells how to release deliverales. 22:07:15 .. "Adaquate implementation experience" 22:07:25 .. is what needs to be demonstrated 22:07:29 .. very open-ended. 22:07:39 .. are there "iii"? 22:08:15 .. several issues raised recently. 22:08:31 s/Adaquate/Adequate/ 22:08:39 .. what qualifies as an implementation? Does a JS-implementation? 22:08:54 https://github.com/w3c/w3process/issues/167 22:08:54 .. TTML -- one implementation was a polyfil, as part of the report. 22:08:59 .. What about a plugin? 22:09:04 https://github.com/w3c/w3process/issues/522 22:09:15 .. What about an e-reader? 22:09:29 .. "publicly available" is noted. 22:09:31 Answers: yes, yes, ?, no, ?, no 22:09:54 .. Does the license tied to the implementation matter? 22:09:58 q+ 22:10:21 .. Another issue is what is "independent?" 22:10:26 q+ 22:10:37 .. How much can be shared between implementations before they are considered one? 22:10:51 q? 22:10:59 q+ marcosc 22:11:04 q+ 22:11:42 .. What if we only get implementation from the spec editors? Is that OK? 22:12:07 s/brotly/brotli 22:12:25 .. (cites URL discussion from ages ago--was about fixing bugs in the common library) 22:12:41 q+ to add to independent: two implementations from the same company? two companies shipping the result of the same consultant's work? forked open source? 22:12:42 .. Finally "interoperable". You have producers/consumers. 22:12:53 .. For HTML, didn't look at producers. 22:12:59 .. Same for SVG. 22:13:08 .. We look at some classes of consumers. 22:13:16 .. For TTML, consumer is cloud services. 22:13:28 .. These are not "end users", can they count as consumers? 22:13:32 .. So many questions. 22:13:41 .. We have also been insisting on tests. 22:13:46 .. Charters are now saying this. 22:13:53 .. (Can CSS please do this too?) 22:14:02 lgombos______ has joined #iii 22:14:27 .. Just how extensive should the testing be? 22:14:36 .. (every combo of CSS?) 22:15:12 .. When updating Geolocation.. got a comment in AC review that the *entire* test suite should have been run (not just the deltas) 22:15:21 .. Running manual tests was a chore. 22:15:58 yonet has joined #iii 22:16:03 .. W3C works on a variety of different areas... 22:16:07 s/CSS?/CSS colors/ 22:16:19 .. Have VC, DID, Perf, Data stuff, etc. 22:16:36 .. Have older protocols (open screen, and SOAP from before I was born) 22:17:23 q? 22:17:24 .. Often certifications about security/privacy is also not checked, because it's uncheckable? 22:17:53 plh: (Timing slide) 22:18:14 .. just wanted to mention that external timing matters sometimes. 22:18:24 .. Need to deal with TTML charter 22:18:43 .. this session is not meant to come to resolution on TTLM FO. 22:18:54 .. FO council will decide this. 22:18:59 manu has joined #iii 22:19:08 martinthomson: Going back to original def and goals 22:19:50 .. your questions about iii, found that I only really care about deployed (people are using it "for real") 22:19:53 rego_ has joined #iii 22:19:55 q+ to comment on adoption 22:19:59 q+ to discuss deployed, real interop, "does this spec matter for people using the web" 22:20:13 q+ to say the implementation question is for specification quality assurance 22:20:18 .. these are perhaps questions you might want to ask on your way to finding out about deployment 22:20:23 q+ 22:20:26 q- later 22:20:36 .. also, integration *does* matter--in the case of WebRTC. 22:20:38 ack martinthomson 22:20:41 ack hober 22:20:42 q+ to note that we might want different classes of testing for data models vs. protocols (at least) 22:21:02 hober: 1) [CSS WG] word "independent" discussed a lot 22:21:13 .. many features worked on by Adobe, etc. (CSS Regions) 22:21:25 .. same engineers at Adobe did the implementation in different browser engines. 22:21:46 .. at the time, CSSWG decided it *could not* count as independent because the "same minds" had produced them. 22:21:50 jyasskin has joined #iii 22:21:57 q- later 22:22:02 .. didn't demonstrate that other minds could do it. 22:22:21 .. 2) framing problem? interop producers/consumers, not right question. 22:22:36 .. spec makes a normative statement. Reads on some implementation, but not others. 22:22:56 .. in HTML, parsing norm statements are for parser impls, not for authoring conformance. 22:23:14 .. I don't think there's one answer of how many are needed. 22:23:31 ack marcosc 22:24:00 MarcosC: you noted that groups define what the criteria was. 22:24:34 .. you couldn't recommend somethingn if it wasn't being used by a lot of people. 22:24:54 .. we know that W3C specs (in name) do carry weight. 22:25:10 .. we want those expectatons to be there in the spec. 22:25:27 .. I'm worried about an abuse in bad faith 22:25:41 .. "interoperable" I think we have a good understanding; not everything is tesable. 22:25:56 s/expectatons/expectations/ 22:26:13 s/tesable/testable 22:26:32 .. was shocked to hear about some of these per-group decisions. 22:26:48 q? 22:26:49 gkellogg has joined #iii 22:26:51 .. we need to perhaps not be too extreme at times. 22:26:51 ack florian 22:26:58 florian: reacting to martin 22:27:10 .. we [css?] are seeing this from a different angle. 22:27:27 .. saying "Rec" is a statement about the doc, not the tech in the world 22:27:35 +1 to Florian re specification quality 22:27:42 .. I care more about that the tech exists, not...[missed[ 22:27:45 +1 Florian 22:28:20 +1 florian 22:28:24 .. multiple impl. can tell you will it work across a diversity of devices. 22:28:29 q+ 22:28:47 .. whether it achives market success is indpendent of the quality of the document. 22:28:55 .. question: how do we know the spec is any good? 22:28:57 q- later 22:29:00 s/...[missed[/if it has been deployed/ 22:29:06 .. WPT gives us what we need for browsers. 22:29:11 gkellogg has joined #iii 22:29:15 .. not all specs are to be implemented by browsers. 22:29:23 +1 that browsers are not the only platform that has to pass tests 22:29:37 .. don't think we've quantified what WPT achieves for other specs? (like DID?) 22:29:41 q- 22:29:46 q+ to note wpt for DID Methods 22:29:53 .. when we move to specs not meant to be done by browsers we might learn something. 22:30:08 .. e-pub readers. Not a browsers, but a CSS user agent. 22:30:31 .. charters might want to describe what software is meant to be a typical expected implementation might look like. 22:30:57 .. lots of implementations that don't align with the spec's expected targets might still be meaningless. 22:30:57 ack dsinger 22:30:57 dsinger, you wanted to add to independent: two implementations from the same company? two companies shipping the result of the same consultant's work? forked open source? 22:31:18 dsinger: More squishy edges: "independent" TTML has two implementations of the same spec! 22:31:25 .. by different eng. teams! 22:31:43 .. open source that has forked. How long must it be since they forked? 22:32:04 .. may have to prove... but makes it a judgment call. (Don't like that--rather have determinism) 22:32:14 .. Is a test suite an implementation (or not)? 22:32:23 ack nigel 22:32:23 nigel, you wanted to say the implementation question is for specification quality assurance 22:32:23 .. 🔥🔥 22:32:54 brentz has joined #iii 22:32:55 s/ TTML has two implementations / VTT has two implementations / 22:32:56 nigel: process doesn't say what you have to do, just says what the director might ask. 22:33:03 in Sir Tim we trust? 22:33:04 .. and what answers need to be given? 22:33:24 .. We're looking at this through our 2022 lense, then when it was written a long time ago. 22:33:47 .. we've heard a range from "I want it to be deployed" / "I want it to be readable" 22:34:02 +1 nigel 22:34:19 .. these questions are meant to provoke "if they implemented on a desert island, with a spec and a computer, could they do it? 22:34:40 .. we need to support breadth of devices, not just browsers. 22:34:59 is the question "could it be implemented" or "could an implementation based on this spec achieve interoperability?" 22:35:24 .. re: "iii" that's there to discover what it means. When you write a thing, you know what it meant. But another person may read it differently. It's meant for clarifying that. 22:35:27 [historic fact: CR was introduced in the Process at the request of the DOM Working Group] 22:35:31 q? 22:35:36 .. if we could all agree what the goal is, we should write that down. 22:35:37 ack tink 22:35:46 gkellogg_ has joined #iii 22:35:54 tink: An extent to which an implementation is used, should be considered. 22:35:59 .. ARIA in HTML spec. 22:36:07 .. implementations are co-validaitors, conformance checkers, etc. 22:36:11 q+ to agree and build on what nigel said 22:36:20 q- later 22:36:21 .. when looking at this, we considered how much these tool were used. 22:36:29 .. didn't want some brand new extension with no use. 22:36:45 .. W3C conformance validator was used. 22:36:59 .. so should consider extent of usage. 22:37:38 manu: we may consider different specs require different types of testing. 22:37:49 ack manu 22:37:49 manu, you wanted to note that we might want different classes of testing for data models vs. protocols (at least) and to note wpt for DID Methods 22:37:51 q+ on what some other SDOs do, reference software, test suite coverage 22:37:54 .. should also look at FOs over disagreements over spec implementations. 22:37:58 .. using DID core as example. 22:38:20 .. WG said, this is a data model spec. So, need to find producers of the data model. 22:38:31 .. but we got FOs saying we didn't do the appropriate testing. 22:38:41 .. there were rules. 50 producers. 22:38:49 .. Would be good to understand why that wasn't enough. 22:38:54 .. haven't heard much feedback on that. 22:39:01 .. now we've overcorrected. 22:39:14 .. have a thing that looks much more like WPT. 22:39:21 .. are testing at DID layer, and VC layer. 22:39:41 .. we still don't know, when we take these to REC, if we'll get FOs on interop. 22:39:56 +1 Manu 22:39:57 ack gsnedders_irc 22:39:59 .. would love to see this documented to avoid running into the FOs. 22:40:14 gsnedders_irc: +1 to nigels feedback 22:40:40 .. e-readers are not the same CSS impl as a web browser. 22:40:44 .. no one will disagree. 22:40:49 .. what is the goal of these specs? 22:40:50 siri: don't worry about it 22:40:56 gkellogg has joined #iii 22:41:10 .. CSS box L3 spec editor makes a bunch of non-backwards compatible changes... (hypothetical) 22:41:20 .. would that really be a replacement? 22:41:35 .. doesn't say whether that would be a useful spec. 22:41:36 ack florian 22:41:36 florian, you wanted to agree and build on what nigel said 22:41:41 .. without goals you can't judge. 22:41:51 florian: is a polyfil appropriate? 22:42:08 .. perhaps. If you can only implement some but not all, maybe we have a problem. 22:42:32 s/to nigels feedback/to nigel and dsinger's feedback/ 22:42:48 ack cwilso 22:42:48 cwilso, you wanted to discuss deployed, real interop, "does this spec matter for people using the web" 22:42:57 .. current process has "sample of questions the director will ask", but should be replaced by set of goals behind the current questions, and have the charter conversations figure out the details. 22:43:15 cwilso: echoing sam: what is the point of a web standard? 22:43:16 +1 to Florian's point that we need to establish what we want to achieve, and CRs can say how to do that for any particular WG, 22:43:17 q+ 22:43:21 .. what do we think it is? 22:43:27 .. we need a consistent set (or one) definition. 22:43:45 q+ to comment about "CR stigma" 22:43:45 q+ 22:43:47 .. otherwise, we'll continue to hear FOs from Mozilla, etc., when they haven't implemented... 22:44:03 .. without consistency we can end up in tense situations. 22:44:47 .. My opinion: point of standard is to have interop. Not just testing, etc. 22:45:05 .. lots of subtlety here, don't mean to gloss over it. 22:45:13 q+ to flame browser guys for thinking that the only platform that matters is browsers. 22:45:15 ack cyril 22:45:15 cyril, you wanted to comment on what some other SDOs do, reference software, test suite coverage 22:45:18 +1 to cwilso 22:45:23 +1 Cwilso 22:45:24 .. if we call "web standard" something that's not across the web, it's a disservice. 22:45:41 cyril: I think it would be interesting to compare W3C to other SDOs 22:45:43 q+ to ask if usefulness (it's shipped and used by millions) to end users trumps demonstration of interoperability (multiple browsers have implemented it)? 22:46:05 q+ to talk about standards track at the IETF 22:46:06 .. not sure "is interoperable" question is true across all W3C. 22:46:18 .. MPEG, etc., define the standard, then it is implemented. 22:46:34 .. CAn't stop the promotion before it's implemetned becuase implementation comes later! 22:46:44 .. in other SDOs, they talk about reference software. 22:46:57 q? 22:46:59 .. reference software is to improve quality of the spec. 22:47:10 .. might be one of the goals of the software to resolve ambiguities. 22:47:27 .. read the spec, then read the implementation, then you know. 22:47:44 .. on test suites: we say its about software, but it should also be about content. 22:47:56 .. should be sufficient to be able to produce and consume the content. 22:48:03 some of this is very much about what the meaning of "REC", and how we hold a very high bar for RECs, versus the endpoint of the standards track at other SDOs, and in many ways other SDOs aim for something closer to our CRs, no? 22:48:08 ack plh 22:48:27 gsnedders_irc: I think that you will find that there is a general trend toward high bars across other orgs too 22:48:34 plh: asked the AB what the different qualities we can expect about a standard. 22:49:01 .. for example: IETF standards come 10 years after... 22:49:10 martinthomson: oh definitely, things are absolutely trending in this direction, but far behind where the W3C was nearly two decades ago. 22:49:13 .. could decide to change to take into account adoption. 22:49:19 .. web is more than web browsers. 22:49:27 10 years later is a rough approximation, most IETF work never makes it that far 22:49:39 q? 22:49:44 ack dsinger 22:49:44 dsinger, you wanted to comment about "CR stigma" 22:49:46 .. web of data (not used by browsers) would therefore not meet the W3C group qualifications. 22:49:47 q+ to respond to nigel's flame 22:50:05 dsinger: There's not stigma being an RFC. But at W3C, groups do not like specs to stay at CR. 22:50:10 gkellogg has joined #iii 22:50:22 .. what's the psycological push to get to Rec? Would like to address that. 22:50:34 q+ 22:50:36 q+ 22:50:40 .. we don't want to address whether something in popular, but whether it's a well-written spec. 22:50:53 ack tink 22:51:02 tink: Advocating for authors. 22:51:23 .. I know authors would love a world with one implementation. 22:51:27 luxury 22:51:33 .. but these orgs need content that is production-ready. 22:51:49 1024x768... that was luxury 22:51:51 q- 22:51:53 .. W3C's strength on iii has allowed these companies to depend on production ready. 22:51:57 ack nigel 22:51:57 nigel, you wanted to flame browser guys for thinking that the only platform that matters is browsers. 22:51:59 .. very hugely important. 22:52:19 nigel: browser guys! You have a loud voice, but you're not the only one in the room! 22:52:40 .. for TTML, we have literally millions of divices with TTML renderer. Browser are the exception! 22:52:56 ack martinthomson 22:52:56 martinthomson, you wanted to talk about standards track at the IETF 22:52:58 .. Whatever we end up writing down, needs to be indpendent of the user agent. 22:53:31 martinthomson: in post standard in IETF matches CR. No one [there] cares what the RFC says... 22:53:41 .. no one really cares? 22:53:53 .. IETF says: Internet runs on Internet drafts. 22:54:08 .. this final pursuit of something that is "done" needs to stop. 22:54:28 .. the word "recommendation" has the right connotations. Didn't imply finally done. 22:54:31 q+ 22:54:54 .. bar keeps rising. Better privacy, security, a11y, etc., a bit paralysing. 22:55:15 .. Rec expectations is that it has to be done. Finshed. End. 22:55:16 ack cwilso 22:55:16 cwilso, you wanted to respond to nigel's flame 22:55:24 cyril_ has joined #iii 22:55:40 cwilso: on behalf of all browser vendors: we don't think we're the only ones in the room. 22:55:43 q+ 22:55:56 .. but if there's only one implementation, then it doesn't really seem like a web standard. 22:56:05 ack hober 22:56:10 q- 22:56:10 .. if you rely on just "one" instance, and have to go. 22:56:19 ack florian 22:56:26 vq? 22:56:29 hober: "Chris you just said exactly what I was going to say" <-- for the record! 22:56:55 florian: Rec doesn't mean done. Recent proces changes demonstrate this (rec revisions, updates, etc.) 22:57:15 .. Rec means you've demonstrated certain quality bar. 22:57:30 .. not everything needs to fit in the iii. But also needs consensus of the community. 22:57:33 But a lot of this isn't about the "finality" of REC, it's about the _perception_ of finality of REC. 22:57:44 .. great spec about a terrible idea, shouldn't get to Rec. 22:57:45 q+ to suggest a way ahead 22:57:59 zakim, close the queue 22:57:59 ok, plh, the speaker queue is closed 22:58:02 .. because it needs the consensus of the community. Is the market relevant, is it ethical? Etc. 22:58:07 ack plh 22:58:21 plh: we all know rec is not done. 22:58:26 .. but stages of rec are important. 22:58:43 .. when something gets to rec, some assume it must be important. 22:58:56 .. WCAG is important. Gets baked into laws. 22:59:03 .. we have to place the bar somewhere! 22:59:15 ack pal 23:00:24 pal: issue with what chris said... that's how you defined imteroperable. two implementations is one way, but NOT the only one. 23:00:27 ack dsinger 23:00:27 dsinger, you wanted to suggest a way ahead 23:00:38 dsinger: hearing general agreement. But we're going to have to write down the hard questions. 23:00:47 .. trying to answer them will refine what we mean. 23:00:57 .. implementation at different companies? Etc. 23:01:20 .. concerned that at this general level we will find that we think we agree, but in the details we won't. 23:01:34 .. keen that we continue to make progress and drill into those questions. 23:01:56 plh: PLEASE HELP IN THE PROCESS CG! 23:02:03 gkellogg has left #iii 23:02:35 RRSAgent, generate minutes 23:02:35 I have made the request to generate https://www.w3.org/2022/09/14-iii-minutes.html plh 23:04:18 nigel has joined #iii 23:22:25 dom has joined #iii 23:25:18 nigel has joined #iii 23:28:00 gsnedders_irc has joined #iii 23:29:42 nigel has joined #iii 23:30:21 duga has joined #iii 23:34:20 dsinger has joined #iii 23:34:22 dsinger has left #iii 23:35:37 miketaylr has joined #iii 23:39:26 tantek has joined #iii 23:59:34 tantek_ has joined #iii 00:08:00 duga has joined #iii 00:13:56