16:54:08 RRSAgent has joined #testing 16:54:08 logging to http://www.w3.org/2014/02/25-testing-irc 16:54:14 MarcFisher has joined #testing 16:55:22 Meeting: Browser testing & tools WG F2F, San Francisco, February 2014 16:55:29 Chair: wilhelm 16:55:37 Agenda: https://www.w3.org/wiki/WebDriver/2014-February-F2F 16:56:04 RRSAgent, draft minutes 16:56:04 I have made the request to generate http://www.w3.org/2014/02/25-testing-minutes.html wilhelm 16:56:34 RRSAgent, make logs public 17:03:17 lmclister has joined #testing 17:03:51 Shuotao_chris_ has joined #TESTING 17:04:27 JohnJansen has joined #testing 17:05:04 sam has joined #testing 17:06:15 AutomatedTester has joined #testing 17:08:35 sstewart6 has joined #testing 17:08:39 jimevans has joined #testing 17:08:51 lukeis has joined #testing 17:09:27 Automate_ has joined #testing 17:10:47 Scribe: wilhelm 17:11:10 Topic: Introductions 17:11:57 MarcFisher_ has joined #testing 17:12:37 MarcFisherII has joined #testing 17:14:10 Topic: State of the union 17:14:47 sstewart6: I've started adding URI endpoints to the spec. That should make it easier to write conforming implementations. 17:15:00 Automate_: I've been trying to make the spec look like a spec. 17:15:13 ... User interactions stawman discussed in June is landed. 17:15:20 ... Please raise bugs on this. 17:15:24 https://dvcs.w3.org/hg/webdriver/raw-file/tip/webdriver-spec.html 17:15:33 ... Going through the bugs, closing some. 17:15:54 sstewart6: We've moving towards Selenium 3. 17:16:03 ... Selenium is the example implementation of this. 17:16:11 ... Selenium 3 will be W3C compatible. 17:16:35 ... It has not shipped yet. 17:16:40 Topic: Agenda review 17:16:45 https://www.w3.org/wiki/WebDriver/2014-February-F2F 17:17:49 jimevans has joined #testing 17:17:52 test has joined #testing 17:17:53 jgriffin has joined #testing 17:18:37 mdas has joined #testing 17:18:39 seva has joined #testing 17:18:57 https://www.w3.org/wiki/WebDriver/2014-February-F2F 17:19:34 RRSAgent, make minutes 17:19:34 I have made the request to generate http://www.w3.org/2014/02/25-testing-minutes.html MikeSmith 17:19:49 dannin has joined #testing 17:19:56 RRSAgent, make logs public 17:20:10 lukeis: Frame searching bug? 17:20:16 Automate_: There is a section on bugs. 17:20:22 dannin has joined #testing 17:20:30 *switching (not searching) 17:20:53 Topic: Recap, actions from TPAC 17:21:20 sstewart6: Come up with a better name of interactable? 17:21:28 Automate_: No conclusion. 17:21:38 ato__: Suggested reachable. 17:21:42 isReachable 17:22:33 Automate_: Minutes from last time cover the consensus. 17:22:56 sstewart6: We had a discussion with P&F WG last meeting. 17:23:26 Automate_: We spoke to the webperf group last time, re: page visibility and element visibility. 17:23:39 Automate_: sstewart6 showed them how we'd want it to work. 17:23:49 Automate_: That was going to be in a future version of the spec. 17:23:58 ... They just pushed one of their specs to CR. 17:24:03 ... Mozilla has raised bugs on this. 17:24:14 sstewart6: We did rename section 10.1. 17:24:26 sstewart6: No progress on "Request elementfrompoint with a DOM relative coordinate instead of a viewport relative coordinate" 17:24:31 http://www.w3.org/2013/11/11-testing-minutes.html#ActionSummary 17:24:52 sstewart6: We might need to handle the visibility check ourselves. 17:25:01 MikeSmith: Has anyone said they want to work on this? 17:25:13 sstewart6: The closes we get is the webperf group. Use case is advertiser. 17:25:22 s/advertiser/advertisers 17:25:36 MikeSmith: Why did CSS not decide to do it? 17:25:43 Automate_: I raised a bug against CSSOM. 17:25:53 Automate_: I suspect it's lost along the way. 17:26:12 sstewart6: Discussed in 2012. CSS passed buck to DOM land, and the other way around. 17:26:38 MikeSmith: Make we could motivate Moz CSS rep to work on this... 17:26:43 Link? 17:28:29 ACTION: sstewart6 to talk to CSS WG about visibility detection 17:29:01 ACTION: Automate_ to speak to Tantek about his old action item on visibility and hit testing 17:29:15 Automate_: There is no good definition of hit testing anywhere. 17:29:27 http://www.w3.org/TR/cssom-view/ 17:29:33 JohnJansen: Covered in CSS OM View spec? 17:29:40 http://dev.w3.org/csswg/cssom-view/ 17:30:02 -> http://dev.w3.org/csswg/cssom-view/ CSSOM View Module 17:30:27 Automate_: Nobody wants to define this, as it's a big can of worms. 17:30:28 and the more generic CSSOM spec: http://www.w3.org/TR/cssom/ 17:30:34 -> http://dev.w3.org/csswg/cssom/ CSS Object Model (CSSOM) 17:30:51 sstewart6: Add scrollwheel support: no progress. 17:31:04 http://www.w3.org/2013/11/12-testing-minutes.html#ActionSummary 17:31:50 Automate_: First action on me is done. 17:32:03 Automate_: No progress on upstream of screenshot tests. Has not been high priority. 17:32:26 Automate_: Strawman of 17.2 is now in place. 17:33:11 MikeSmith: No progress on link from TR to editors draft. 17:33:21 MikeSmith: TR will point to editors draft. 17:34:30 MikeSmith: A recurring problem is that implementors use the outdated TR version of the spec, while they should be using the editors draft. 17:35:33 sstewart6: Some progress on identifying tests to move over from the open source project. 17:35:43 sstewart6: Placeholders have been added. 17:36:07 sstewart6: No progress on WCAG analysis. 17:36:31 sstewart6: Strawman for HTTP normalisation for the JSON Wire Protocol has been added to the spec. 17:36:51 lukeis: Is this section G? 17:36:59 sstewart6: That section will be automated based on content elsewhere in the spec. 17:37:13 https://dvcs.w3.org/hg/webdriver/raw-file/default/webdriver-spec.html#methods-2 17:37:40 MarcFisher has joined #testing 17:38:07 Automate_: The notes in the table - how would they be different from describing how the method is working? 17:38:19 sstewart6: The note will make it over to section G. 17:38:43 Automate_: We need to conscious that different parts of the spec will go out of sync. 17:38:53 sstewart6: Should be a reference to a particular section. 17:39:01 ... We could make the notes non-normative. 17:39:03 Automate_: Nah. 17:39:36 sstewart6: These are the URLs that all implementations will support. 17:39:40 Automate_: Moz will support these. 17:39:47 Automate_: ato has done work on this recently. 17:40:40 Automate_: web-platform-test will make it into the main Moz tree. 17:40:55 Automate_: For selendroid there's going to be interesting problem you need to solve. 17:41:12 sstewart6: Main problem is instanziating the browser... 17:41:41 lukeis: I will submit patches.. 17:42:20 sstewart6: Current URLs have a leading slash. They may not be in the root. 17:42:25 lukeis: We could have a prefix? 17:42:45 ACTION: sstewart6 to add prefix to JSON URLs 17:52:09 jimevans1 has joined #testing 17:54:04 MarcFisher has joined #testing 17:55:04 AutomatedTester has joined #testing 17:55:11 Topic: Current timeline of spec 17:55:23 sstewart6: Where are we? 17:55:36 sstewart6: We're not tracking as fast as we should. 17:55:42 AutomatedTester: Spec is, test suite is not. 17:56:16 AutomatedTester: Bugs have been raised on the spec 17:56:29 Ms2ger: :) 17:56:53 wilhelm: I reported some bugs on wooly language of the spec. 17:57:16 rhauck has joined #testing 17:57:32 AutomatedTester: Ms2ger will go through the spec and rip it apart. He has already given useful input. 17:57:43 AutomatedTester: (Cites examples.) 17:58:15 AutomatedTester: We have a lot of fluffy language. Describing features, but lacking in confromance requirements. 17:58:37 MikeSmith: Input from jgraham would also be useful here. 17:59:18 ato__: Progress on the test suite may be slow due to style differences in test suite. 17:59:37 ato__: Using the Python package makes it harder to test lower level things. 17:59:48 ato__: Capabilities are not exposed. 17:59:56 sstewart6: I'd use a raw HTTP library. 18:00:19 sstewart6: Set aside time to discuss the style of the suite. 18:00:29 Ms2ger: We'll do that. 18:00:54 ato__: We should switch to wptserve. 18:01:08 :) 18:01:15 ACTION: ato__ to switch to wptserve in webdriver test suite 18:01:33 wilhelm: Hi, this is me. 18:01:58 sstewart6: We're sort of on track with the spec, but not with the suite. 18:02:17 AutomatedTester: There will be a lot of changes needed to the spec, to be discovered as we work on the tests. 18:03:12 Topic: Charter 18:03:32 MikeSmith: You don't need to do anything! I need to get off my ass and do something. 18:04:03 MikeSmith: The charter needs some more detail on milestones. 18:05:30 MikeSmith: There is a heartbeat requirement about pushing to TR. 18:06:20 MikeSmith: We'll ask for a two year extension for the charter. 18:07:06 Topic: Bugs! Woo! 18:07:13 https://www.w3.org/Bugs/Public/show_bug.cgi?id=20860 18:07:39 https://www.w3.org/Bugs/Public/buglist.cgi?component=WebDriver&list_id=33041&product=Browser%20Test%2FTools%20WG&resolution=--- 18:09:12 https://www.w3.org/Bugs/Public/show_bug.cgi?id=21184 18:09:15 dannin has joined #testing 18:10:03 jimevans1: The use case is: suppose you have an element that is so large that even scrolling it into the viewport, the center will not be in the viewport. 18:10:16 jimevans1: The script won't be able to click the center. 18:10:46 MarcFisher: What if the center is otherwise obscured? 18:11:02 sstewart6: If the center is obscured: don't use click. Use interactions API. 18:11:24 jimevans1: Proposed: Click could still work by clicking on the midpoint of the visible area. 18:12:16 mdas: Why can't we just scroll to where we want to click? 18:12:24 jimevans1: We were lazy... 18:13:20 sstewart6: (Describes approach similar to what is proposed in the bug.) 18:14:06 (Conclusion to this issue is added to the bug.) 18:15:12 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24364 18:16:10 sstewart6: Use case: run test with a constrained viewport. Want to compare screenshots. 18:16:23 sstewart6: Better: Capture the top-level browsing context. 18:16:32 sstewart6: Or the current browsing context. 18:16:47 sstewart6: Chrome team was not happy with the whole DOM. 18:17:20 Shuotao_chris_: Lacking low-level tools for this... 18:17:37 sstewart6: If it's in the spec... 18:17:49 sstewart6: Stitching is an awful approach. 18:18:22 MarcFisher: Don't let the limitations of Chrome limit us here. 18:18:58 sstewart6: We resize IE windows to the document size in the IEdriver. 18:19:25 JohnJansen: Most of the time you don't need to worry about what's outside the viewport. 18:19:29 JohnJansen: Use a flag? 18:19:47 JohnJansen: It's better to target a specific area. 18:20:03 sstewart6: Element capture. 18:20:28 sstewart6: MS and Google is saying taking a screenshot of the entire page is difficult. 18:20:37 AutomatedTester: Moz implementation is a hack... 18:20:53 sstewart6: What is a good way to do this? I'd like to hear from the implementors. 18:21:14 sstewart6: Visible viewport? 18:21:32 JohnJansen: We'd like to have an option. Full viewport or the whole document. 18:22:39 sstewart6: All implementations must be able to capture the viewport. Capability for whole document. 18:22:51 ato: Why not just use element capture of the root element? 18:23:05 sstewart6: It will depend on the browser. You can't just assume it works. 18:23:25 AutomatedTester: If someone wanted to test their responsive web site, we don't actually support that. 18:24:12 sstewart6: When capturing the top level browsing context, maintain page width for this use case. 18:25:33 sstewart6: In level 2, we can describe the more complex case of rotation, etc. 18:26:22 sstewart6: All browsers must be able to capture the viewport. All browsers should be able to capture the entire document as if the window was resized vertically. Capability for the latter. 18:27:20 seva: How would you request either of these? 18:27:28 sstewart6: Capability. 18:27:50 sstewart6: We should prefer the full document. 18:28:15 JohnJansen: Chrome disagrees with making the full DOM default. If running tests against my site, I'd need to store images for both variants. 18:28:36 MarcFisher: Screenshotting just the element is more sensible. 18:29:39 JohnJansen: Use case of position:fixed; 18:29:47 sstewart6: We could add a flag on the wire to indicate size. 18:30:00 MarcFisher: It's a POST command. We can add values to it. 18:30:08 sstewart6: Capability on whether you can do these things. 18:30:16 sstewart6: Pass a parameter. 18:30:34 sstewart6: Default is as big as you can go. 18:31:00 ato: We should have a default. 18:31:54 seva: Interop is the argument here. If all browsers support viewport, we should default to that. 18:32:58 sstewart6: If you capture an element and the element is bigger than the viewport... 18:33:01 sstewart6: What do we do? 18:33:35 mdas: Use a separate canvas? 18:33:42 Shuotao_chris_: Won't work in ChromeDriver. 18:33:43 JohnJansen: Fixed 18:33:47 AutomatedTester: Why? 18:34:30 Shuotao_chris_: We don't have the low level support. 18:34:41 sstewart6: Fundamental constraint? 18:35:00 Shuotao_chris_: GPU team says no. They don't want to do a hack. 18:35:56 sstewart6: Shove the element into the top left corner and capture as much as you can. 18:36:22 sstewart6: Leave it undefined? 18:36:25 sstewart6: We could put a note in. 18:36:37 JohnJansen: (Quotes spec on this.) 18:37:45 JohnJansen: Two floats, side by side. In Chrome, there's allowed to be a overlap. In IE, no. Interop issue. We need to be able to catch that. 18:38:24 JohnJansen: For that bug, I know I need the parent element. Other times, I don't know. 18:38:30 JohnJansen: I prefer if it doesn't scroll. 18:38:40 sstewart6: Use case: long page, element is out of view. 18:38:59 JohnJansen: I'd rather scroll to view first. 18:39:08 sstewart6: There is no such feature. 18:39:54 sstewart6: Part of the audience is people without programming experience. We need to make this simple. 18:40:31 JohnJansen: For reftests, we could add "take screenshot without scrolling". 18:41:38 wilhelm: We need to support both use cases here. Reftests and magic scrolling to element. 18:42:40 sstewart6: Option of passing a parameter rather than a capability. 18:42:58 AutomatedTester: If parameter is not there, scroll. If it is there, don't. 18:43:54 ACTION: AutomatedTester to add a flag to take element screenshot without scrolling 18:44:29 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24633 18:45:00 sstewart6: Which option should it be? 18:45:13 jimevans1: Descendant. 18:45:43 https://www.w3.org/Bugs/Public/show_bug.cgi?id=20975 18:46:13 ACTION: sstewart6 to define that cookies can only be set against domains that are currently loaded 18:46:29 Lachy has joined #testing 18:46:31 lukeis: Use case is: set cookie before navigating to the site. 18:46:35 sstewart6: Don't do that. 18:46:41 lukeis: It should throw an exception. 18:46:52 sstewart6: I can add language for that. 18:47:10 sstewart6: People set cookies to avoid login. 18:47:28 sstewart6: They should navigate to a page, set a cookie, then reload. 18:47:46 sstewart6: This is to allow a pure JS implementation of this. 18:49:00 https://www.w3.org/Bugs/Public/show_bug.cgi?id=22653 18:49:59 ato: Greg had an opinion on this in June. 18:50:09 sstewart6: Use case in Maps. 18:50:12 RRSAgent, make mintues 18:50:12 I'm logging. I don't understand 'make mintues', MikeSmith. Try /msg RRSAgent help 18:50:17 RRSAgent, make minutes 18:50:17 I have made the request to generate http://www.w3.org/2014/02/25-testing-minutes.html MikeSmith 18:51:07 MarcFisher: What interaction would you want to do with the container? 18:51:12 AutomatedTester: Hover? 18:51:20 sstewart6: We need Greg to clarify. 18:52:10 https://www.w3.org/Bugs/Public/show_bug.cgi?id=22987 18:52:22 sstewart6: Punt to level 2. 18:53:16 https://www.w3.org/Bugs/Public/show_bug.cgi?id=23020 18:54:19 https://www.w3.org/Bugs/Public/show_bug.cgi?id=23791 18:54:36 jimevans1: No, just no? 18:55:27 MarcFisher: Definitely level 2. 18:55:41 sstewart6: I have no idea how to implement this. 18:56:23 https://www.w3.org/Bugs/Public/show_bug.cgi?id=23868 18:57:06 sstewart6: I don't think this is incorrect. Close? 18:57:20 sstewart6: The click on element is do what I mean. 18:57:41 sstewart6: Do as I mean APIs could be implemented in top of the interaction APIs. 18:57:49 sstewart6: Bleedthrough expected. 18:58:16 https://www.w3.org/Bugs/Public/show_bug.cgi?id=23869 18:58:51 https://dvcs.w3.org/hg/webdriver/raw-file/default/webdriver-spec.html#cookies 18:59:01 sstewart6: What other data would you like to return? 18:59:15 sstewart6: FF does a good job of this. IE returns name and value. 18:59:28 JohnJansen: We could return if it's third party, session cookie, secure cookie... 19:00:10 ACTION: AutomatedTester to add whether it's a session cookie, a secure cookie 19:00:50 ACTION: AutomatedTester to link to the cookies RFC to describe the data format for expiry 19:06:41 lmclister has joined #testing 19:09:07 mdas_ has joined #testing 19:13:24 ato_ has joined #testing 19:13:48 jimevans2 has joined #testing 19:14:35 timeless has joined #testing 19:19:04 https://www.w3.org/Bugs/Public/show_bug.cgi?id=23876 19:19:43 ato: We reached a conclusion in Boston, but spec is not updated. 19:20:30 AutomatedTester: Do we want to spec files going over the wire? 19:20:52 ACTION: sstewart6 to describe how we send files across the wire 19:21:50 https://www.w3.org/Bugs/Public/show_bug.cgi?id=23949 19:21:58 ato: This is in level 2. 19:22:03 https://www.w3.org/Bugs/Public/show_bug.cgi?id=23950 19:22:39 ato: Since we're adding the argument to take screenshot, we'll need this. 19:22:50 sstewart6: Spec says you can pass whatever across the wire. 19:24:45 https://www.w3.org/Bugs/Public/show_bug.cgi?id=23972 19:24:53 sstewart6: I'm in favour of this. 19:24:55 JohnJansen: That' fine. 19:25:09 https://dvcs.w3.org/hg/webdriver/raw-file/default/webdriver-spec.html#platform-names 19:25:39 sstewart6: Do we want to go lowercase? 19:25:42 (Yes.) 19:25:52 ACTION: sstewart6 to lowercase platform names 19:26:52 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24063 19:27:06 sstewart6: That's legit. 19:27:13 sstewart6: I'll soften the language to SHOULD. 19:28:30 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24132 19:28:39 sstewart6: This should be in level 1. 19:28:48 sstewart6: This MUST be in level 1. 19:29:05 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24133 19:29:16 sstewart6: I'll take that. 19:29:31 sstewart6: INteresting case of quit mulitple times. 19:29:40 lukeis: Case of close last window. 19:29:53 AutomatedTester: Language is fluffy, but says you should close... 19:30:00 zcorpan has joined #testing 19:30:13 https://dvcs.w3.org/hg/webdriver/raw-file/default/webdriver-spec.html#closing-windows 19:30:50 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24225 19:32:46 sstewart6: We could drop id. This is possible with CSS selectors. 19:33:12 sstewart6: We could also drop the capabilities. 19:35:10 sstewart6: The language bindings can still support id. But the remote end won't need to. 19:36:18 seva: This may confuse other audiences. 19:37:15 seva: Does the spec cover language bindings? 19:37:17 sstewart6: No. 19:38:31 lukeis: For native language bindings, id is still valid. 19:41:25 sstewart6: We will remove id, not implement classname. We will remove capability for CSS selector. 19:42:41 ACTION: sstewart6 to remove id location strategy 19:42:59 ACTION: sstewart6 to remove CSS selector capability (it's assumed) 19:43:18 MarcFisher: Add note that those issues can be handled on the local end? 19:43:53 ACTION: sstewart6 to add a note that you can use extension mechanisms to add location strategies 19:44:03 JohnJansen: We don't support XPath. 19:44:38 JohnJansen: Must we have a must for XPath? 19:45:08 sstewart6: XPath is commonly used by test authors. 19:45:18 sstewart6: There is a JS library for this. 19:46:05 sstewart6: All it needs to do is to appear to support it. Translating to querySelectorAll is fine. 19:46:21 JohnJansen: Yes, we can translate it on our end. 19:47:51 MikeSmith: Why do we keep XPath? 19:47:54 sstewart6: It's popular. 19:48:06 jimevans1: It's the only way to select things via visible text. 19:49:24 https://code.google.com/p/wicked-good-xpath/ 19:49:25 sstewart6: It's popular among QA. 19:49:35 wilhelm: Coud we subset it? So we don't need all of XPath? 19:49:46 ato: That's not a bad idea. 19:49:58 sstewart6: The problem is there are so many existing tests that rely on this. 19:50:05 JohnJansen: Should instead of must? 19:50:29 sstewart6: I don't want to break existing tests. 19:50:54 jimevans1: Traversal use cases are also not overed by selectors. 19:51:17 ato: Could we keep this in the language bindings? 19:51:29 sstewart6: Or keep it as is. More efficient for the mobile use case. 19:51:37 sstewart6: I hate it, but we need to keep XPath. 19:52:31 Lachy has joined #testing 19:52:39 mdas_: Deprecation warning? 19:52:47 MikeSmith: Little impact. 19:53:41 wilhelm: Can we start the long march towards removing the use cases for XPath by subsetting? 19:53:47 sstewart6: Yes, but not in level 1. 19:54:08 sstewart6: XPath must be supported, but not neccessarily in the browser itself. 19:54:28 JohnJansen: Our driver won't support XPath natively. 19:54:38 JohnJansen: We'll have to write a translator. 19:54:50 JohnJansen: We won't write our tests using XPath. 19:55:44 sstewart6: We put this as a must. We ask Google, Salesforce, Facebook about the prevalence of XPath. 19:55:51 ato: What does wpt do here? 19:56:02 JohnJansen: We're doing querySelectorAll for wpt. 19:56:19 lukeis: We have to look through RC code... 19:56:56 JohnJansen: Interesting data point: How many can be transslated to querySelectorAll? 19:57:16 sstewart6: If your translator is avaible, people could run their tests to see what happens. 19:57:25 ... We'll revisit this issue when we have data. 19:57:38 seva: We will not define select by text? 19:57:44 sstewart6: Not in level 1. 19:59:32 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24373 19:59:32 So there's no confusion: The IE team is writing a web driver implementation for IE11+ 19:59:56 :)) 20:00:16 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24634 20:02:04 sstewart6: It's a must, really. Even if it has no size, it looks like the body element is there. 20:02:39 lukeis: I'm okay with saying the body is always visible. 20:04:42 jgriffin has joined #testing 20:06:15 mdas has joined #testing 20:07:20 jimevans2 has joined #testing 20:07:30 ACTION: ato to research root element behaviour in HTML and XML 20:07:37 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24635 20:29:59 AutomatedTester has joined #testing 20:30:52 mdas_ has joined #testing 20:30:59 sam has joined #testing 20:35:46 heycam has joined #testing 20:38:55 sam has joined #testing 20:42:12 abarsto has joined #testing 20:50:04 Shuotao has joined #TESTING 20:51:30 jgriffin has joined #testing 20:51:55 sam has joined #testing 21:15:35 Lachy has joined #testing 21:16:33 sam_ has joined #testing 21:17:26 AutomatedTester has joined #testing 21:21:27 Automate_ has joined #testing 21:24:49 scribe: MikeSmith 21:25:00 RRSAgent, make minutes 21:25:00 I have made the request to generate http://www.w3.org/2014/02/25-testing-minutes.html MikeSmith 21:26:16 Present+ MikeSmith 21:26:29 Present+ JohnJansen 21:26:51 Present+ wilhelm 21:26:51 Present+ seva 21:26:53 Present+ MarcFisher 21:26:57 Present+ LukeInmanSemerau 21:26:59 Present+ ato 21:27:05 Present+ jimevans 21:27:07 Present+ mdas 21:27:09 Present+ SimonStewart 21:27:14 Present+ samuong 21:27:15 Present+ DavidBurns 21:27:19 Present+ ShuotaoGao 21:27:24 dannin has joined #testing 21:27:47 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24635 21:27:50 Present + Dale Annin 21:27:55 RRSAgent, make minutes 21:27:55 I have made the request to generate http://www.w3.org/2014/02/25-testing-minutes.html MikeSmith 21:28:13 switchToFrame should only accept a WebElement or number argument 21:28:25 sstewart6: why should it not? 21:28:44 Automate_: everybody except IE doesn't follow the spec 21:28:50 Lachy has joined #testing 21:29:04 MarcFisher: or we could just get rid of the index 21:29:35 Present+ dannin 21:30:17 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24662 21:30:28 Automate_: see that bug 21:31:14 Present+ DavidBurns 21:31:14 AutomatedTester: discussion among Hixie and bz 21:32:37 sstewart6: what's wrong with us retaining the number and equatin 21:38:02 [discussion of how to address the issue] 21:39:01 sstewart6: if I'm a developer and I want to switch to frame at index 1, how do I implement that? 21:39:12 mdas: can't you get the frame element 21:39:27 jimevans: not across domains 21:39:44 AutomatedTester: can see it but can't see what's inside it 21:41:05 sstewart6: spec currently just says, whatever frame would be given back? 21:41:32 MarcFisher: but that may not produce the same frame across browsers? 21:41:54 s/across browsers?/across browsers/ 21:42:15 MarcFisher: the problem is that the current behavior is not useful 21:42:30 sstewart6: it may be sufficiently useful 21:42:41 sstewart6: question is whether this is our problem to solve 21:43:15 ato: we could defer this to the next f2f 21:47:38 sstewart6: for us I don't think it matters 21:48:18 sstewart6: remove the locaters by ID and name 21:48:29 ... keep index and webElement 21:49:12 ... and add a note that webElement is the preferred for the reason that index won't give you the same frame across browser engines 21:50:57 lukeis: [want to suggest we discuss problem of switching from a frame to its parent frame] 21:51:45 sstewart6: what do people think about switching to parent? quick vote 21:51:55 [everybody likes it] 21:52:07 sstewart6: ok we'll do it then 21:54:37 [agreement about speccing it by adding descriptive string (instead of say, -1)] 21:55:02 sstewart6: pluse new endpoint 21:55:15 JohnJansen: one other thing about frames 21:55:52 action: Luke to identify new endpoint for hooking switch to parent into 21:56:11 action: Simon to define frame in section 6.1 21:57:00 RRSAgent, make minutes 21:57:00 I have made the request to generate http://www.w3.org/2014/02/25-testing-minutes.html MikeSmith 21:57:32 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24791 21:58:28 Drop reference to HTML4 from the "Interactable elements" chapter 21:58:43 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24792 22:02:58 action: David to review references to ensure they meet transition requirements 22:03:39 "Page load strategies" constants are ambiguous 22:03:45 sstewart6: I will fix that 22:04:41 https://www.w3.org/Bugs/Public/show_bug.cgi?id=24794 22:04:53 HTTPS requirements are inconsistent 22:04:59 sstewart6: I will fixe that 22:05:31 https://www.w3.org/Bugs/Public/show_bug.cgi?id=20947 22:05:50 Click does not mention if it should/shouldnt wait for page loads if its noticed ( 22:06:01 sstewart6: that's deliberate 22:06:38 https://www.w3.org/Bugs/Public/show_bug.cgi?id=20947 22:19:25 [discussing how to identify use case of how to log what command caused a failure] 22:19:50 https://dvcs.w3.org/hg/webdriver/raw-file/default/webdriver-spec.html#extending-the-protocol 22:19:55 [noting that logging still needs to be written] 22:20:43 sstewart6: that section describes how to deal with this right now 22:21:54 example of extending the protocol: https://github.com/selendroid/selendroid/commit/d275f3a10b63b3fb9616f0bc677b3262addd6c95 22:22:31 sstewart6: I will attempt add a [placeholder] for logging API [soon] 22:26:00 Lachy has joined #testing 22:33:47 Lachy has joined #testing 22:37:02 Lachy has joined #testing 22:37:45 Topic: Clarifications 22:38:35 JohnJansen: in 4.1 about creating session 22:38:49 ... shoudl that autoatically lauch a browser window? 22:39:01 ... or can it connet to an existing window? 22:39:23 sstewart6: turns out that connecting to an existing window only can be made to work well in IE 22:39:47 [mention that it's possible with Marionette] 22:40:19 mdas: you mean browser window or tab? 22:40:31 sstewart6: new browser instance 22:42:07 sstewart6: new session brings up an independent session 22:42:54 mdas: in this case we have someone who wants to connect to a particular tab 22:43:05 sstewart6: so they need to know the session id 22:43:16 sstewart6: just generate one 22:44:09 sstewart6: there is not an existing command but there are ways to do it 22:45:12 ... the thing is of course you need to start the browser ahead of time in some session that would allow it 22:45:53 [Simon reads from section of spec about generation of session IDs] 22:46:24 lukeis: do we not have an invalid-session error? 22:46:41 sstewart6: please raise a bug for that 22:46:48 JohnJansen: 6.5 Windos 22:47:02 ... we need a minimize Window command 22:47:06 dannin has joined #testing 22:47:19 ... and where does the center fo the window 22:47:25 sstewart6: undefined 22:47:34 sstewart6: would you like for us to define it? 22:48:32 JohnJansen: so yes we would like to be able to test a minimized and then back to maximized 22:48:57 action: John to send some spec language for window minimize 22:49:11 JohnJansen: what is windowID? 22:49:27 sstewart6: unique handle used to refer to the window 22:50:02 jimevans: on Windows it assigns a GUID 22:50:25 JohnJansen: execute async script 22:50:41 ... we're not clear that it'S trying to do that execute script can't 22:50:48 sstewart6: avoids the need to do polling 22:51:08 ... just have a callback to get executed 22:52:37 MarcFisher: allows the JS event quite tcontinue 22:53:20 lukeis: we do this in the Selenium source 22:54:25 action: Luke to port Seleniium async script test to spec testsuite 22:54:46 MarcFisher: there's also somethingn used for testing Angular 22:55:02 JohnJansen: how does one click on something other than the center of an element? 22:55:11 MarcFisher: 14.2.1.1 22:55:30 ... takes a webelement and two numbers 22:56:18 JohnJansen: modal dialogs 22:56:35 ... looks like a lot of stuff has been added 22:57:35 JohnJansen: about not needing focus 22:57:58 sstewart6: depends on the implementation 22:59:30 sstewart6: strawman is you give the credentials at the start of session 23:00:04 ... I've not been able to get it work cleanly when I was experimenting 23:00:30 ... but we've gone 7 years without it, seems like we can move it to Level 2 23:00:47 JohnJansen: getElementText 23:01:01 ... does that still point to something nonexistent? 23:01:07 sstewart6: yeah you're right 23:01:21 ... dagnabbit 23:01:37 Shoot 23:02:18 action: Add definition for getElementText to the appropriate section of spec 23:02:51 JohnJansen: can WebDriver find noscript elements? 23:02:58 sstewart6: yeah if it's in the DOM 23:03:39 JohnJansen: touch? 23:04:21 AutomatedTester: something we need to talk about,given that Touch Events is being replaced by Pointer Events 23:04:43 I've added some agenda items for tomorrow: https://www.w3.org/wiki/WebDriver/2014-February-F2F 23:04:55 mdas: don't know about the order of events so it's not something that should be in teh spec 23:05:06 sstewart6: browser knows the order of events 23:05:23 AutomatedTester: activation triggers based on DOM Events spec 23:06:20 JohnJansen: no gesture? 23:06:32 sstewart6: multi-action supports it 23:07:26 AutomatedTester: there are differences in what a flick is across browsers 23:07:31 We should kill "action_chain" in the notes 23:07:34 "actions" 23:08:08 JohnJansen: can't write a gesture test that works in all browsers? 23:08:46 AutomatedTester: the EndPoint isn't there 23:08:46 Jo so the right thing to do is the atomic action? 23:09:40 s/Jo/JohnJansen: 23:09:49 RRSAgent, make minutes 23:09:49 I have made the request to generate http://www.w3.org/2014/02/25-testing-minutes.html MikeSmith 23:10:48 sstewart6: anybody else have queries? 23:10:56 lukeis: here's our TouchActions object (for single finger) https://bugzilla.mozilla.org/show_bug.cgi?id=976807 23:10:57 oops 23:11:00 http://mxr.mozilla.org/mozilla-central/source/testing/marionette/client/marionette/marionette.py#178 23:11:02 dannin: speed up execution 23:11:16 and MultiActions(http://mxr.mozilla.org/mozilla-central/source/testing/marionette/client/marionette/marionette.py#380) 23:11:30 glenn has joined #testing 23:12:07 AutomatedTester: we should be doing things as fast as possible, and the client code [will need to manage timing] 23:12:43 s/speed up execution/speed of execution 23:12:57 http://selenium.googlecode.com/git/docs/api/java/org/openqa/selenium/support/ui/Wait.html 23:13:09 http://selenium.googlecode.com/git/docs/api/java/org/openqa/selenium/support/ui/ExpectedConditions.html 23:13:13 Those are docs links 23:14:26 lukeis has joined #testing 23:16:01 RRSAgent, make minutes 23:16:01 I have made the request to generate http://www.w3.org/2014/02/25-testing-minutes.html MikeSmith 23:19:16 One of the security chaps at work took a look at the fingerprinting part of the spec 23:19:20 and then linked me to this: http://en.wikipedia.org/wiki/Evil_bit 23:20:03 sam has joined #testing 23:21:58 funny that article lists Do Not Track in the see also 23:22:07 Topic: Conformance Suite 23:23:07 https://github.com/w3c/web-platform-tests/tree/master/webdriver 23:24:05 sstewart6: piecemeal and willy-nilly 23:24:29 ... describes how we are currently writing the conformance tests 23:24:56 lukeis: I remember hearing that each test must have its own web page 23:25:03 https://github.com/operasoftware/presto-testo/tree/master/core/standards/wf1-watir2/interactive 23:25:17 wilhelm: those have some good exxamples 23:27:22 wilhelm: we should do things in such a way that it integrates with the conventions of existing w-p-t testsuite 23:34:21 http://www.quirksmode.org/blog/archives/2009/09/the_html5_drag.html 23:35:00 That's why you need events at the OS level rather than just creating them on the DOM 23:39:34 Action: add language clarifying that drag and drop between frames in different domains should (must?) be supported 23:40:59 action: Andreas TT to write some example tests for cases discussed at f2f, including handlers to add to wptserve 23:48:09 [discussion of how to enable running of tests without needing to pull in third-party open-source code] 23:51:12 lukeis: well if you're allowed to look at Apache2 code.. 23:51:48 MarcFisher: I think we should have a separate implementation in the w-p-t repo would be good. Can be small 23:53:03 http://www.w3.org/Consortium/Legal/2008/04-testsuite-copyright.html 23:53:05 action: Marc to lead work on separate minimal implementation of spec for inclusion in w-p-t repo 23:53:48 License of WPT: https://github.com/w3c/web-platform-tests/blob/master/CONTRIBUTING.md 23:53:52 lukeis: just a remote implementation? 23:53:56 MarcFisher: yeah 23:55:47 action: wilhelm to work on making a small canonical set of tests that integrate with Marc's implementation