08:13:23 RRSAgent has joined #webdriver 08:13:23 logging to http://www.w3.org/2016/09/19-webdriver-irc 08:13:29 RRSAgent: Good morning. 08:13:29 I'm logging. I don't understand 'Good morning.', ato. Try /msg RRSAgent help 08:13:36 RRSAgent: Are you thick? 08:13:36 I'm logging. Sorry, nothing found for 'Are you thick' 08:14:50 Meeting: WebDriver F2F TPAC 19 September 2016 08:15:11 RRSAgent: Please draft the minutes. 08:15:11 I'm logging. I don't understand 'Please draft the minutes.', ato. Try /msg RRSAgent help 08:15:20 RRSAgent: create the minutes 08:15:20 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 08:15:48 RRSAgent: please set these logs world-visible 08:16:02 RRSAgent: please draft the minutes 08:16:02 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 08:17:14 Chair: AutomatedTester 08:17:27 mkwst has joined #webdriver 08:17:29 Scribe: ato 08:17:34 Scribe: Andreas Tolfsen 08:17:36 ScribeNick: ato 08:18:00 present+ 08:18:01 Present+ 08:18:02 present+ 08:18:05 present+ 08:18:09 Present+ 08:18:13 present+ 08:18:31 RRSAgent: please draft the minutes 08:18:31 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html juangj 08:18:48 that didn’t work, none of you is present 08:19:01 chang has joined #webdriver 08:19:02 Present: sam_u simonstewart ato wilhelm_ brrian 08:19:07 Present+ juangj 08:20:01 RRSAgent: please draft the minutes 08:20:01 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 08:20:21 present+ ato 08:20:23 RRSAgent: please draft the minutes 08:20:23 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 08:20:28 tkim has joined #webdriver 08:20:32 present+ 08:20:39 RRSAgent: please draft the minutes 08:20:39 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 08:21:10 present+ mkwst 08:21:13 RRSAgent: please draft the minutes 08:21:13 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 08:23:00 Sometimes hard to tell if RRSAgent does the bidding because of latency. 08:23:36 present+ jgraham 08:23:39 Sometimes hard to tell if RRSAgent does the bidding because of latency. 08:23:42 RRSAgent: please draft the minutes 08:23:42 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 08:29:13 present+ MikeSmith 08:29:52 mikepie has joined #webdriver 08:31:31 JohnJansen has joined #webdriver 08:32:05 MikeSmith: Morning coffee break 10-11, we need to pay respect to this. 08:32:18 MikeSmith: Make sure to break at 10:30. 08:33:05 present+ DavidBurns 08:33:19 AutomatedTester: We’ll start with introductions. 08:33:19 present+ 08:33:24 RRSAgent, make minutes 08:33:24 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html MikeSmith 08:33:27 present+ 08:33:41 AutomatedTester: I’m David Burns, editor and now chair. Work at Moizlla. 08:33:52 mkwst: I’m Mike West. Work on Chrome. Have not done work on WebDriver, but interested. 08:34:09 rbyers has joined #webdriver 08:34:18 present+ rbyers 08:34:32 rbyers: Work on platform predictability. Just observing. 08:34:42 present+ AutomatedTester 08:35:02 ToddRiefstack: Work on performance with Microsoft. 08:35:15 present+ mikepie 08:35:28 mikepie: Want to talk about extensions tomorrow. 08:35:31 Present+ JohnJansen 08:35:47 JohnJansen: Work on the WebDriver implementation at Microsoft, Web Platform Tests, and a lot of stuff that’s not relevant. 08:36:11 juangj: Work with Google. Work on Google’s scalability of WebDriver internally. 08:36:27 present+ paul 08:36:38 paul: I’m interested in listening and wonder what’s happening in this space. 08:36:59 [unknown observer introducing himself] 08:37:14 [another unknown observer introduction] 08:37:35 wilhelm_: My name is Wilhelm, former chair. Used to work with Opera. Now I’m running my own consultancy. 08:38:20 ato: I’m Andreas Tolfsen. I work for Mozilla. Used to be at Opera with wilhelm_. 08:38:27 jgraham: I work with geckodriver at Moizlla. 08:38:37 brrian: I work with Apple. On safaridriver. 08:38:45 sam_u: Hi, I work with Google. 08:39:13 simonstewart: I’m Simon Stewart. Creator of WebDriver, co-editor of the specification. 08:39:20 Topic: State of the Union 08:39:22 https://www.w3.org/wiki/WebDriver/2016-TPAC-F2F 08:39:23 https://www.w3.org/wiki/WebDriver/2016-TPAC-F2F 08:39:45 AutomatedTester: The last meeting was in Redmond, where for the first time we had Apple join us for a F2F. 08:39:50 AutomatedTester: A number of items were discussed. 08:40:10 AutomatedTester: Key item discussed was actions, where jgraham discussed how things were going to look. 08:40:25 AutomatedTester: Since then we have had the first part of that landed in the spec, which is hte transposing of the matrix. 08:40:37 AutomatedTester: Before it gets handed over to a dispatcher, where events are dispatched. 08:40:44 AutomatedTester: The dispatch part is currently being reviewed. 08:40:46 AutomatedTester: Is that correct? 08:40:52 jgraham: The pointers thing is still in review. 08:41:02 AutomatedTester: I didn’t land it because there might be some comments. 08:41:31 AutomatedTester: Hopefully people have started reading that part, as that was really the last main item that we were going to try get landed before TPAC. 08:41:47 AutomatedTester: A contentious item we’re going to discuss today are capabilities. 08:42:06 AutomatedTester: From the specification PoV, we are down to the devil-in-the-detail kind of issues now. 08:42:19 AutomatedTester: As for the test suite, since the last F2F there hasn’t really been much work on that. 08:42:46 AutomatedTester: Because of things that have happened at Mozilla, we have been forced to focus more on our own implementation. 08:43:02 AutomatedTester: That is the current state of the specification and the test suite. 08:43:04 q+ to comment 08:43:06 AutomatedTester: Am I missing anything? 08:43:14 Zakim has joined #webdriver 08:43:15 JohnJansen: Should we discuss the test suite tomorrow maybe? 08:43:17 q+ to comment 08:43:20 simonstewart, AutomatedTester: Yeha. 08:43:32 https://www.w3.org/2016/05/browser-testing-tools-charter.html 08:43:35 MikeSmith: Everybody should look at our current charter. 08:43:46 MikeSmith: There’s nothing interesting, apart from the end date. 08:43:58 MikeSmith: Ideally we would like to go to REC before end of March. 08:44:04 MikeSmith: Looks like that isn’t going to happen. 08:44:16 AutomatedTester: Should we make that the next agenda item? 08:45:22 chang has joined #webdriver 08:45:31 ato: If we want to renew this we probably want to add Safari. 08:45:36 MikeSmith: Yes. 08:45:37 q+ 08:45:42 simonstewart: And Selenium, as an intermediary. 08:45:43 ato: Yes. 08:46:13 q? 08:46:24 ack MikeSmith 08:46:24 MikeSmith, you wanted to comment 08:46:31 JohnJansen: There’s a community/interest group meeting on Thursday. 08:46:41 JohnJansen: I thought the console API would be under this. 08:46:42 q? 08:46:48 JohnJansen: Do I have the wrong impression? 08:47:02 jgraham: I don’t know what the point of having a WG for the WPT. 08:47:09 jgraham: We’re not aiming to produce specification text. 08:47:43 JohnJansen: I think that group could do with the direction of a group. 08:48:09 JohnJansen: To align browser vendors with the work going on there. 08:48:20 JohnJansen: No one has direct responsibility for it. 08:48:26 JohnJansen: It’s hard to know what the expectations are. 08:48:44 JohnJansen: It strikes me as something we might be able to improve. 08:49:09 jgraham: Typically so far, the people in this room has had very specific WebDriver experience, which is not necessarily the same group of people you want giving input to WPT as a whole. 08:49:17 jgraham: It’s not clear from a human point of view that they are the same group. 08:49:44 JohnJansen: I agree. There’s an interesting Venn-diagram. 08:50:09 q? 08:50:12 ack rbyers 08:51:25 AutomatedTester: What you want, is a task force that WPT is actually maintained and driven forward? 08:51:32 q+ to comment about testing plans 08:51:42 AutomatedTester: Historically, we have jgraham doing a lot of the harness work. 08:51:48 AutomatedTester: And the infrastructure around that. 08:51:58 AutomatedTester: And then the spec owners helping out. 08:52:12 AutomatedTester: It would be good for specs to have actual tests. 08:52:18 AutomatedTester: Things appear to be falling between the cracks. 08:52:29 jgraham: I have a feeling that this is a discussion for Thursday. 08:52:37 q? 08:53:16 q- 08:53:45 q+ to comment about scheduling for transtion to CR and to Rec 08:53:56 ato: It also feels like it’s a mistake to increase the charter of the group now before we publish. 08:54:04 jgraham: What are the success criteria? 08:54:14 jgraham: I’m thinking implementations. 08:54:22 jgraham: geckodriver is one implementation. 08:54:34 sam_u: We are making changes, but they are hidden behind a flag. 08:54:40 simonstewart: Selenium another. 08:54:42 (third) 08:54:52 JohnJansen: I don’t see why we can’t hit March. 08:55:20 jgraham: I think I disagree, as people implement the spec we will find things that people haven’t thought about. 08:55:23 [agreement] 08:55:36 MikeSmith: We don’t want to be in CR any longer we want to be. 08:56:06 MikeSmith: If we want to be the end of March, we need everything done by the end of February. 08:56:16 MikeSmith: We can always extend. 08:56:31 MikeSmith: But I always almost say no. 08:56:42 MikeSmith: So it’s hypocritical of me to call for it. 08:57:09 AutomatedTester: We have certain parts that are solid. 08:57:42 jgraham: In practice tests are written when implementations are written. 08:57:54 jgraham: People don’t generally write tests for the sake of writing tests. 08:58:32 jgraham: From our point of view, we haven’t written tests because we can’t run them in automation for build system issues. 08:59:01 [Mozilla discussion] 09:01:37 ato: I’m worried about the process of pushing fixes after REC. 09:01:47 rbyers: The activity can always continue on Github 09:01:56 MikeSmith: There isn’t a great process for that. 09:02:11 [discussion about process] 09:04:20 MikeSmith: For some organisations it’s important to always have a link to the spec text as it was when it was pushed to Rec. 09:05:38 q? 09:05:42 ack mikepie 09:05:47 ack MikeSmith 09:05:47 MikeSmith, you wanted to comment about scheduling for transtion to CR and to Rec 09:05:51 rbyers: It’s always an option to hire a contractor to write tests. 09:05:57 sam_u: Yes, we have a lot of tests we could upstream 09:06:29 ato: But it’s not just as easy as upstreaming. It’s a lot of work to review tests against the spec, maybe you find bugs, you need to fix spec, iterate. 09:06:42 JohnJansen: I think we should keep the current date. 09:06:53 MikeSmith: We also need people to review those. 09:07:02 MikeSmith: With WPT the biggest frustration is review. 09:07:15 MikeSmith: It’s all volunteer work. 09:07:44 q? 09:09:13 ato: At Mozilla we review W3C related changes equally to internal changes. 09:09:23 ato: Practically changes to WebDriver W3C bits, changes are being reviewed. 09:09:38 [talk about review process in WPT] 09:11:48 juangj: WebDriver 2 09:12:04 ato: Console API, extensions, meda, web bluetooth 09:14:29 MikeSmith: Evaluate manual tests in WPT and how we can automate them. 09:15:06 MikeSmith: It’s not just a software problem. we need to find out what things people have _not_ written tests for because they knew upfront they couldn’t automate. 09:17:53 Action: rbyers and sam to investigate possibility of investing in the tests. 09:18:16 Resolution: We are keeping current deadline of pushing to REC in March. 09:18:39 https://developer.mozilla.org/en-US/docs/Mozilla/QA/Marionette/WebDriver/status 09:18:51 ato: ↑ geckodriver implementation status 09:20:07 JohnJansen: We wrote an app for matching annotations in specs to tests. 09:20:19 JohnJansen: We applied it to WebDriver because it’s a relatively contained spec. 09:20:26 mkwst: I would be interested in this. 09:20:51 mkwst: It’s not clear from a lot of the specs I’m working on that we’re testing the right things. 09:21:29 AutomatedTester: Break until 11. 09:21:43 RRSAgent: please draft the minutes 09:21:43 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 09:21:57 juangj has joined #webdriver 09:36:33 gsnedders has joined #webdriver 09:43:30 JohnJansen has joined #webdriver 09:47:24 juangj has joined #webdriver 09:58:43 simonstewart has joined #webdriver 10:01:24 sam_u has joined #webdriver 10:02:17 simonstewart_ has joined #webdriver 10:03:14 Ms2ger has joined #webdriver 10:09:50 RRSAgent: please draft the minutes 10:09:50 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 10:13:22 rrsagent, this meeting spans midnight 10:13:29 RRSAgent: When is midnight? 10:13:29 I'm logging. Sorry, nothing found for 'When is midnight' 10:13:38 RRSAgent: You suck. 10:13:38 I'm logging. I don't understand 'You suck.', ato. Try /msg RRSAgent help 10:14:33 AutomatedTester: Is there anything people want to add to the agenda? 10:14:35 https://www.w3.org/wiki/WebDriver/2016-TPAC-F2F 10:16:02 Agenda: https://www.w3.org/wiki/WebDriver/2016-TPAC-F2F 10:16:08 MikeSmith: Any idea what the problem with RSSAgent is? 10:16:08 RRSAgent: please draft the minutes 10:16:08 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html Ms2ger 10:16:33 Full list of meetings from previous meetings: https://sny.no/bttmin 10:16:46 juangj: Security wrt. certs 10:17:05 sam_u: Send keys 10:17:14 AutomatedTester: Tomororw? 10:17:16 brrian: Yes 10:17:40 rbyers: Keyboard support in Blink people here. I can invite. 10:17:49 AutomatedTester: That sounds useful. 10:18:14 https://www.w3.org/2016/07/13-webdriver-minutes.html 10:18:24 https://www.w3.org/2016/07/14-webdriver-minutes.html#ActionSummary 10:23:07 jgraham, no idea what the problem with RRSAgent might be 10:23:22 scribe: AutomatedTester 10:23:35 RRSAgent: please draft the minutes 10:23:35 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 10:23:39 present+ 10:23:50 present+ 10:24:39 topic: capabilities 10:25:02 RRSAgent: draft minutes 10:25:02 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html AutomatedTester 10:25:45 jimevans has joined #webdriver 10:30:29 jgraham: the best way to start is to document what the requirements are so we know where to compromise 10:33:36 jgraham: requirements should be written on the whiteboard (photo to follow) 10:34:14 jgraham: from the point of the browser we need to know the endpoint and the configuration items for that browser 10:34:52 jgraham: we have a requirement to support multiple UA details in a new session command 10:35:28 jgraham: we need to remove as much duplication from the capabilities as possible. E.g. don't have multiple 100mb Firefox addons base64 encoded 10:35:42 ato: are we going to discuss extension points? 10:35:52 simonstewart: yes, we do want to support it. 10:36:16 simonstewart: there is no such thing as a routing request since a capabilities could route and might not be 10:36:23 jgraham: we can discuss this later 10:37:21 jgraham: from the point of view of the UA that should be sufficient. As far as possible we should get as much info as we can without starting the browser. We need to get there before initialising the resources where possible. 10:40:19 jgraham: have the ability to be transparent when moving between nodes. Should intermediaries be allowed to remove data? 10:42:12 simonstewart: we need to have something that is either widely used in Selenium or in the spec to main compatibility. 10:43:27 JohnJansen: capabilities from a browser vendor viewpoint, we have the way to get the UA we want on a specific platform or how do we get the UA we want with all the extensions 10:43:54 jgraham: capabilities is routing + configuration but we may need to keep it for compatibility 10:44:10 juangj: remove ambiguity in matching 10:44:20 juangj: for ease of implementation 10:45:03 simonstewart: the ability to feature sniff so we can use mixins when checking what is returned 10:47:00 simonstewart: we are basing the rest of this discussion on https://github.com/w3c/webdriver/pull/327 10:47:19 AutomatedTester: we need to discuss when items can be removed from the returned list 10:47:34 simonstewart has joined #webdriver 10:47:56 simonstewart: ease of implementation is missing from the list 10:50:07 simonstewart: the original design was simple in that the validation was done in local end. The requiredCapabilities was thought of to move the validation from the local end to the remote end. 10:50:49 simonstewart: we need to have validation on start up (resource allocation) 10:51:16 simonstewart: Jleyba's PR https://github.com/w3c/webdriver/pull/327 10:51:47 jgraham: [drawing the JSON structure from the PR ^] 10:53:34 simonstewart: the idea is to iterate over firstMatch and merge to alwaysMatch and then start session and if you cant do it, you try the next firstMatch item 10:55:22 simonstewart: the PR allows validation to happen in the end node, support multiple browser, minimise duplication, transparency, non ambiguous, ridiculuously easy to implement and feature sniffing 10:56:18 jgraham: I have a slightly alternate design based off jleyba's design. I put in the mailing list thread https://lists.w3.org/Archives/Public/public-browser-tools-testing/2016JulSep/0026.html 10:56:38 jgraham: [gives example of any browser on linux] 10:58:09 jimevans_ has joined #webdriver 10:59:24 jgraham: My alternate scheme [draws on whiteboard] has "routing":{} 10:59:44 simonstewart: people would want to route on rotable 10:59:48 jgraham: is that a thing 10:59:54 sam_u: yes 11:00:47 sam_u: the other issue is anything can suddenly become a routing item 11:01:08 jgraham: well chromeOptions and firefoxOptions dont really have anything that allow for routing 11:02:10 jgraham: the next item is "capabilities":[{}, {}] 11:02:39 jgraham: its like jleyba's item except its just alwaysMatch and not iterating on firstMatch 11:03:09 simonstewart: practically speaking people add ALL THE THINGS when starting 11:04:48 jgraham: [discusses how looping matches in his proposal] 11:04:58 RRSAgent: draft minutes 11:04:58 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html AutomatedTester 11:06:20 MikeSmith: we dont appear to be getting drafted minutes but items are being logged 11:08:10 worst case, I have a complete local log of channel, and can generate minutes from it later 11:08:30 ok 11:08:33 s/MikeSmith: /MikeSmith, 11:08:43 RRSAgent, make minutes 11:08:43 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html MikeSmith 11:10:01 [discussion on matches vs alwaysMatch + firstMatch] 11:12:50 juangj: let me restate to make sure I understand: routing is a list of alwaysMatch from jleyba's and then move to next node and then do the capabilities/settings key and then do that as a group of if statements to make sure it is correct 11:13:31 jgraham: that is a good description. An intermediary node would only look at routing: and the end node would only look at capabilities:/settings: 11:13:47 JohnJansen: but browsers don't work that way 11:14:02 jgraham: [gives example] 11:16:24 jimevans has joined #webdriver 11:16:33 RRSAgent, make logs public 11:16:44 RRSAgent, make minutes 11:16:44 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html MikeSmith 11:17:44 q+ to comment briefly 11:19:09 ato: I think both of these proposals are a little too complicated. 11:20:19 ato: we have 3 items we need. Matrix switching, machine details, UA details 11:20:55 jgraham: I dont think we need to have all items as routing. E.g. browser profiles 11:24:59 juangj: [gives an example on how routing would work on the alwaysMatch/firstMatch 11:26:48 jgraham: settings: would only have the UA items. Routing would direct you to the right machine 11:27:37 juangj: routing gets you to the machine that has what you need and then settings checks the UA is correct or returns NoSessionCreatedError 11:28:34 simonstewart: jgraham's proposal means local end needs to understand the topology of the network. 11:29:00 jgraham: I don't understand why anything needs to know the topology 11:30:17 simonstewart: this feels like it's going to be difficult for localend people to understand 11:30:45 sam_u has joined #webdriver 11:31:13 simonstewart: current implementations know how to look capabilities: key 11:32:40 jimevans has joined #webdriver 11:32:53 AUtomatedTester: no one is currently using the current spec requiredCapabilities key. I went and spoke to browserstack/testingbot/saucelabs and google to understand their use 11:33:16 simonstewart: this is great! this simplifies things 11:33:50 ato: it is easy to retrofit the PR to the current implementations for a form of backwards compatibility 11:34:45 ato: it is more difficult for local end implementors (Selenium Project) for the 2nd proposal 11:36:09 ato: What would we do to existing implementations 11:36:39 simonstewart: we would put requiredCapabilities into alwaysMatch and firstMatch into desiredCapabilities 11:39:22 juangj: browser profiles can still be duplicated 11:39:41 AutomatedTester: we could always use something like jgraham's either idea of a browser: {} 11:40:24 simonstewart: or we can have a way of store this profile on a server somehwere and a value pointing to it 11:40:33 s/somehwere/somewhere/ 11:40:50 ato: we dont get many profile users 11:41:03 jgraham: not sure, it was a big request in GeckoDriver 11:41:26 ato: people are more interested in setting prefs or extensions 11:41:39 jgraham: well in the 100mb profile case, the extension is 99mb 11:43:05 ato: with Firefox 47 we had to add extension end point to allow people to install addons later on 11:43:32 simonstewart: [describes historic Firefox XPI disklayout] 11:43:52 ato: Mozilla is now copying what chromeOptions is doing to simplify things 11:43:58 JohnJansen: but not in the spec? 11:44:05 ato: yes, this is Mozilla specific 11:44:57 ato: where would chromeOptions/FirefoxOptions go? 11:45:03 simonstewart: in alwaysMatch 11:45:50 ato: what happens if you send {alwaysMatch: someRandomKey:""} 11:46:13 simonstewart: NoSessionCreatedError is returned since it should fully do all the keys within that 11:48:01 [discussion about adding random items as the top level key] 11:48:35 [e.g. access tokens for networks] 11:50:02 jimevans has joined #webdriver 11:51:57 ato: we should have a note for how a local end _may_ write this 11:52:25 resolution: Move forward with jleyba's PR 11:53:23 action: Note/Example on how this would be used 11:53:42 Example of example: http://w3c.github.io/webdriver/webdriver-spec.html#capabilities 11:53:45 Example 5 11:54:09 action: DBURNS clean up jleyba's PR and get landed and then iterate as issues come up 11:55:53 Automated: CAn things be removed when we return capabilities? 11:56:04 simonstewart: no, we need backwards/forwards compatibility 11:56:23 jimevans has joined #webdriver 11:58:11 RRSAgent: draft minutes 11:58:11 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html AutomatedTester 12:01:57 jimevans has joined #webdriver 12:20:24 RMurillo has joined #webdriver 12:46:23 simonstewart has joined #webdriver 12:50:18 +present 12:50:22 present+ 12:50:31 present+ simonstewart 12:50:35 present+ JohnJansen 12:50:35 present+ AutomatedTester 12:50:44 RRSAgent: draft minutes 12:50:44 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html AutomatedTester 12:53:16 ArrrrrArrrrSAgent 12:55:17 sam_u has joined #webdriver 13:06:56 topic: Returned capabilities 13:07:22 brrian: We are ready to begin again. 13:08:24 ato: I'll be back in 10 mins or so, don't wait 13:08:54 simonstewart: there are 2 possible options on the table 13:09:29 simonstewart: 1) take the capaibilities that are matched and return what has been met and extra UA supported capabilities 13:09:38 ato: So only the matched capabilities? 13:09:55 simonstewart: yes, this allows people to sniff what is returned and then use mixins 13:10:32 simonstewart: historically we used capabilities to check what is returned and feature sniff before moving on 13:11:04 simonstewart: given the new newSession details discussed earlier now has the validation on the remote end and we just returned matched 13:11:44 simonstewart: in the spec we have a handful of things with capabilities in the commands (acceptsSslCerts) 13:12:21 jgraham: we dont want to return large amounts of data, e.g. large profile 13:13:06 simonstewart: we MUST return anything that has a capability name that is currently in the specification 13:13:24 jgraham: should we return we have done it or the value that was set 13:13:37 jgraham: e.g. browserName == true or browserName == Edge 13:13:43 simonstewart: browserName == Edge 13:14:18 ato: are we going to predefine a list ? 13:14:36 simonstewart: we want a canonical list and then have the ability to extend it 13:15:00 ato: do we use vendor prefixing? 13:15:10 simonstewart: just pick a string 13:19:58 jimevans has joined #webdriver 13:20:27 simonstewart: what would people prefer? 13:20:57 jgraham: the first option and vendors can change it if they need to. Ideally not to return 100mb profile base64 string 13:21:52 [discussion of current spec text] 13:22:41 ato: if you want to be nice to your user you can send back what the issue is but it does say we to send back a string 13:23:03 ato: from the practical point of view, for WPT we just check type of the errror not the string 13:23:48 simonstewart: there are multiple ways to fail on startup and this will be the end node talking to the browser (the shim probably) 13:28:50 resolution: returned object from new session should be capaibilities that are matched and return what has been met and UA capabilities (browser/platform/ssl) and the vendor can decide what is returned 13:33:53 [discussion around what is returned 13:35:58 jgraham: we need to have text in the spec for what capabilities is returned 13:38:08 simonstewart: [repeats resolution to check that is what people want] 13:38:24 jgraham: but do we really want to return proxy: ? 13:39:12 simonstewart: we can look at some of them where we return large things and just return a boolean to say it was done or not 13:40:40 simonstewart: do we return everything or just what we matched? 13:42:17 simonstewart: we can say we are using the profile and just the names of the extensions instead of the extension 13:44:50 present+ 13:47:32 resolution: returned object from new session should be the full list of known capabilities with defined serialisation 13:50:09 Suggested resolution: return “all capabilities matched for the session”, “every capability name given in the spec”, and “a custom subset (which may be All The Things) that the browser supports” 13:51:03 resolution: return “all capabilities matched for the session”, “every capability name given in the spec”, and “a custom subset (which may be All The Things) that the browser supports” 13:51:32 RRSAgent: draft minutes 13:51:32 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html AutomatedTester 13:54:48 resolution: return object with 2 keys, session_id: ".." capabilities:“all capabilities matched for the session”, “every capability name given in the spec”, and “a custom subset (which may be All The Things) that the browser supports” 13:56:14 action: to mention somewhere, over the rainbow, keys injected by intermediary nodes must be namespaced with a vendor prefix 13:56:27 🌈 14:19:55 jimevans has joined #webdriver 14:24:01 RRSAgent, make minutes 14:24:01 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html MikeSmith 14:25:06 w00t 14:26:55 simonstewart has joined #webdriver 14:33:20 jimevans has joined #webdriver 14:34:49 sam_u has joined #webdriver 14:35:34 MikeSmith: ++ 14:36:43 JohnJansen: what about capabilities that the browsers can do that the developers have no idea about 14:36:53 jimevans has joined #webdriver 14:37:13 simonstewart: we used to have a endpoint that used to do that GET /session_id 14:38:00 RRSAgent, make minutes 14:38:00 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html MikeSmith 14:38:01 jgraham: from a local end, are they wanting to support arbitary things? 14:38:36 ato: I cant imagine that people would do that 14:38:54 AutomatedTester: PHPDriver from facebook required people know the transport mechanisms 14:39:09 jgraham: this feels like this is just, you need more documentation 14:39:50 JohnJansen: knowing there is a MS Capabilities end point I can see what is able of doing it without having to look up docs 14:40:15 jgraham: feels like, writing more docs is better than adding a new end point 14:40:30 juangj: why not put this in a /status endpoint 14:40:46 (ftr, that was half in jest) 14:40:55 ato: we wont be removing capabilities 14:41:05 AutomatedTester: but we are adding new items 14:41:35 jgraham: if you are using it in an exploratory way there might be vendor specific items 14:43:22 jgraham: we could return a link to documentation 14:43:43 jgraham: but just returning the keys and no clue of what the values can be in there could be weak sauce 14:43:52 jgraham: people still need to then go read the docs 14:44:15 simonstewart: this does sound like docs 14:44:35 simonstewart: but there is another argument of asking what returning capabilities are available 14:45:05 “Probably someone is going to have a counter example involving intermediary notes” 14:46:44 ato: what is the granularity? top level? 14:46:51 jgraham: yes, just the top level 14:47:23 sam_u: this could be useful as a service exploring 14:47:53 simonstewart: OSS Selenium grid has a web page and people want to explore those capabilities 14:48:56 jgraham: intermediary nodes can't return this info so it breaks the transparency concept we wanted and discussed earlier 14:49:56 jimevans has joined #webdriver 14:49:58 Todd: when I worked in cloud services, it was possible to return meta data from the service 14:50:30 Todd: It might be good to make sure we have documentation 14:50:49 jgraham: I am happy for it to return a full set 14:51:50 JohnJansen: I dont understand why I was against returning the full capabilities 14:53:12 resolution: return an object with 2 keys, session_id: "...", capabilities: { full list of known capabilities with defined serialisation} 14:53:35 RRSAgent: draft minutes 14:53:35 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html AutomatedTester 14:54:07 AutomatedTester: http://vignette3.wikia.nocookie.net/uncyclopedia/images/0/04/Khrushchev_Banging.jpg/revision/latest?cb=20080805101523 14:54:54 topic: Unsigned Self Signed Certification 14:55:03 http://i.imgur.com/CKWJ5wh.gif 14:55:55 jimevans has joined #webdriver 14:56:32 simonstewart: things to discuss, capability name and default value 14:57:32 brrian: the default should be no/false as this causes a lot of insecure systems 14:57:50 simonstewart: [discusses the 3 audiences of WebDriver specification] 15:00:42 ato: currently OSS FirefoxDriver defaults to no, chrome defaults to yes and IE doesnt support it 15:00:45 PageLoadingTest.testShouldBeAbleToAccessPagesWithAnInsecureSslCertificate 15:02:59 jimevans_ has joined #webdriver 15:04:32 jgraham: one question that needs answer, what are vendors allowed 15:04:47 AutomatedTester: Mozilla infosec would like security in depth 15:05:53 AutomatedTester: Mozilla would also, if possible, to have a browser notification to say that we have WebDriver running 15:06:38 jgraham: what happens if the person can't launch a session but can hijack a session that is running 15:08:15 simonstewart: if you security conscious you would have code to default it off 15:08:51 brrian: I havent spoken to our infosec 15:08:55 I, for one, have no issues with a vendor putting up a visible indicator that the browser is being driven by WebDriver. 15:09:30 brrian: it will be really hard to have this in safari because of it's current architecture 15:09:41 JohnJansen: how do you switch it on? 15:09:54 juangj: you do [following steps] 15:10:19 [literally clicking one menu option in Safari] 15:10:32 ato: should we have a note about a visual display 15:10:40 all: yes 15:10:42 I also like the safari implementation (manual activation, "pane of glass" over automated sessions. 15:11:56 agreed with jim, the orange address bar and break-glass mechanisms are really nice 15:12:05 action: add prose to "show a visual display that automation is currently running" to the specification 15:13:16 ato: if Apple can't default to true we should have everyone default to false 15:14:10 jgraham: we would need to make this a SHOULD then (which is terrible) 15:15:33 FTR, what I said was that this discussion is _pending_ on what Apple’s sec team comes back with. 15:15:59 ato: this discussion is _pending_ on what Apple’s sec team comes back with. 15:16:59 JohnJansen: we have ways of working out security threats and security in depth is a good thing but they would let it go 15:18:06 ato: I dont have an opinion either way but I have an opinion on the input type 15:18:25 jgraham: we can do what we want but if the local ends are going to do the opposite then it doesnt matter 15:19:17 ato: what do want, leave it off by default in the spec? 15:19:26 simonstewart: in the spec it should be off 15:19:50 jimevans has joined #webdriver 15:20:32 simonstewart: in the GET and people access bad HTTPS we return a message (InsecureSSLError) 15:21:49 jgraham: in Edge, can you check that you got an self-signed cert? 15:21:52 JohnJansen: not sure 15:22:33 jgraham: so for navigation we need to check 15:24:38 ato: we need to make the page loading part of the spec more generic and unsigned certs should be handled there 15:25:05 jgraham: how does the page load strategy work in Selenium? 15:25:19 simonstewart: on everything, not just Go 15:25:40 action: Make Page load strategy more generic 15:27:11 action: add error code for when we invoke page loading strategy and we hit a self-signed certificate 15:28:03 ato: should we also have the user prompt handler return this error too? 15:28:15 simonstewart: yes, we need it in the processing model 15:28:43 ato: I dont think it should be there, we have setTimeouts that we dont want affect 15:30:13 action: to add insecure page check where it makes sense 15:30:38 jimevans has joined #webdriver 15:30:42 action: to investigate user prompt handling and insecure page detection to the processing model 15:30:50 moving* 15:30:54 jimevans_ has joined #webdriver 15:31:42 simonstewart: so acceptSslCert: False is the default 15:32:26 brrian: do we want to be insecureSslCert as a key? 15:32:57 acceptInsecureSSLCerts 15:33:55 s/insecureSslCert/acceptInsecureSSLCerts 15:35:03 resolution: change acceptSslCert to acceptInsecureCerts 15:36:21 resolution: change the wording to be SHOULD when processing the acceptInsecureCerts 15:36:43 sam_u: should Chrome be backwards compat? 15:36:50 jgraham: that's your choice 15:37:50 topic: Safe listing domains 15:38:31 ato: previously we discussed instead of a boolean, which is too course, should we be a list? 15:38:44 simonstewart: safe listing is a good idea 15:39:24 jgraham: can Gecko do that? 15:39:27 ato: yes 15:39:45 sam_u: in Chrome this is going to be really hard to do it 15:39:51 JohnJansen: and same with us 15:40:04 ato: do we want to do this or keep the boolean? 15:40:38 simonstewart: we need to a feature for a future spec to allow us to do this 15:41:18 action: add a bug that allows safe listing of domains for V2 15:42:30 RRSAgent: draft minutes 15:42:30 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html AutomatedTester 15:42:54 topic: Open Bugs https://www.w3.org/Bugs/Public/showdependencytree.cgi?id=20860&hide_resolved=1 15:44:08 same 15:44:23 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24121 15:44:30 Level 2 is https://www.w3.org/Bugs/Public/show_bug.cgi?id=24121 15:48:51 lukeis has joined #webdriver 15:51:10 MikeSmith: I don’t suppose anyone has an HDMI to HDMI cable we could borrow? Or a Mac DVI to VGA converter? 15:51:34 simonstewart, ask at reception 15:51:51 will ask myself as well 15:52:07 s/MikeSmith: /MikeSmith, 15:53:13 Zakim has left #webdriver 16:05:47 RRSAgent: draft minutes 16:05:47 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html lukeis 16:20:01 “I had a dream about what to do after minimising the browser window last night” 16:21:15 https://github.com/jnicklas/capybara/pull/1744#issuecomment-244200356 16:44:21 sam_u_ has joined #webdriver 16:50:53 JohnJansen has joined #webdriver 20:50:08 lukeis: we had a lightning triage session 22:32:59 sam_u has joined #webdriver 22:33:47 juangj has joined #webdriver 22:40:18 lukeis: Lisbon is quite good fun. 22:41:02 lukeis: It’s a fairly civilised place to hold a conference, although I must admit the conference venue is very W3C-esque which implies terrible catering. 22:50:18 not that conveneint to leave the conference center for lunch 22:51:01 working as intended 22:51:08 didn’t want to forget to resume logging tomorrow 23:23:10 juangj has joined #webdriver 23:31:33 juangj has joined #webdriver 00:05:41 juangj has left #webdriver 00:21:33 juangj_ has joined #webdriver 00:32:44 juangj has joined #webdriver 00:38:08 juangj_ has joined #webdriver 00:42:08 juangj has joined #webdriver 00:54:40 juangj has joined #webdriver 00:57:01 simonstewart has joined #webdriver 01:02:48 simonstewart has joined #webdriver 01:03:33 juangj_ has joined #webdriver 01:09:56 juangj has joined #webdriver 01:15:24 juangj_ has joined #webdriver 01:21:09 juangj_ has joined #webdriver 01:26:13 juangj has joined #webdriver 01:32:27 juangj_ has joined #webdriver 01:38:13 juangj_ has joined #webdriver 01:42:56 juangj has joined #webdriver 01:47:26 juangj_ has joined #webdriver 01:51:57 juangj has joined #webdriver 01:56:55 juangj_ has joined #webdriver 02:02:52 juangj_ has joined #webdriver 02:07:53 juangj has joined #webdriver 02:12:27 juangj_ has joined #webdriver 02:16:56 juangj has joined #webdriver 02:21:26 juangj_ has joined #webdriver 02:25:57 juangj has joined #webdriver 02:30:53 juangj_ has joined #webdriver 02:34:56 juangj has joined #webdriver 02:40:18 juangj_ has joined #webdriver 02:45:31 juangj_ has joined #webdriver 02:50:22 juangj has joined #webdriver 02:56:16 juangj_ has joined #webdriver 03:01:56 juangj_ has joined #webdriver 03:07:16 juangj has joined #webdriver 03:13:38 juangj_ has joined #webdriver 03:19:16 juangj_ has joined #webdriver 03:24:46 juangj has joined #webdriver 03:31:02 juangj_ has joined #webdriver 03:36:43 juangj_ has joined #webdriver 03:43:36 juangj_ has joined #webdriver 03:50:16 juangj_ has joined #webdriver 03:55:33 juangj has joined #webdriver 04:01:55 juangj_ has joined #webdriver 04:08:04 juangj_ has joined #webdriver 04:14:10 juangj_ has joined #webdriver 04:19:40 juangj has joined #webdriver 04:26:43 juangj_ has joined #webdriver 04:32:08 juangj_ has joined #webdriver 04:38:34 juangj_ has joined #webdriver 04:46:25 juangj has joined #webdriver 04:52:00 juangj_ has joined #webdriver 04:58:12 juangj_ has joined #webdriver 05:03:46 juangj has joined #webdriver 05:11:46 juangj_ has joined #webdriver 05:16:46 juangj has joined #webdriver 05:22:09 juangj_ has joined #webdriver 05:30:55 juangj_ has joined #webdriver 05:37:13 juangj_ has joined #webdriver 05:41:26 juangj has joined #webdriver 05:46:26 juangj_ has joined #webdriver 05:50:46 juangj has joined #webdriver 05:55:56 juangj_ has joined #webdriver 06:26:05 juangj has joined #webdriver 06:41:35 juangj_ has joined #webdriver 06:48:11 juangj_ has joined #webdriver 07:01:17 juangj_ has joined #webdriver 07:06:33 juangj has joined #webdriver 07:44:13 kmag2 has joined #webdriver 07:52:19 Does anyone have a rough idea of when extension automation will be discussed today? I don't want to take up space in the room longer than necessary. 08:17:30 RRSAgent: silence 08:51:36 Meeting: WebDriver F2F TPAC 20 September 2016 08:51:44 Chair: AutomatedTester 08:52:45 Agenda: https://www.w3.org/wiki/WebDriver/2016-TPAC-F2F 08:52:57 RRSAgent: please draft the minutes 08:52:57 I have made the request to generate http://www.w3.org/2016/09/19-webdriver-minutes.html ato 08:53:02 RRSAgent: please fix the wifi 08:53:02 I'm logging. I don't understand 'please fix the wifi', juangj_. Try /msg RRSAgent help 08:53:28 RRSAgent: start a new log 08:53:55 RRSAgent: please excuse us 08:53:55 I see 10 open action items saved in http://www.w3.org/2016/09/19-webdriver-actions.rdf : 08:53:55 ACTION: rbyers and sam to investigate possibility of investing in the tests. [1] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T09-17-53 08:53:55 ACTION: Note/Example on how this would be used [2] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T11-53-23 08:53:55 ACTION: DBURNS clean up jleyba's PR and get landed and then iterate as issues come up [3] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T11-54-09 08:53:55 ACTION: to mention somewhere, over the rainbow, keys injected by intermediary nodes must be namespaced with a vendor prefix [4] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T13-56-14 08:53:55 ACTION: add prose to "show a visual display that automation is currently running" to the specification [5] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T15-12-05 08:53:55 ACTION: Make Page load strategy more generic [6] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T15-25-40 08:53:55 ACTION: add error code for when we invoke page loading strategy and we hit a self-signed certificate [7] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T15-27-11 08:53:55 ACTION: to add insecure page check where it makes sense [8] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T15-30-13 08:53:55 ACTION: to investigate user prompt handling and insecure page detection to the processing model [9] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T15-30-42 08:53:55 ACTION: add a bug that allows safe listing of domains for V2 [10] 08:53:55 recorded in http://www.w3.org/2016/09/19-webdriver-irc#T15-41-18 08:54:33 plh has joined #webdriver