07:12:15 RRSAgent has joined #mobileok 07:12:15 logging to http://www.w3.org/2007/09/04-mobileok-irc 07:12:19 Zakim has joined #mobileok 07:12:25 RRSAgent, make log public 07:12:38 Meeting: mobileOK checker Task Force F2F, day 1 08:29:13 roland has joined #mobileok 08:36:58 jo has joined #mobileok 08:37:11 srowen has joined #mobileok 08:37:33 jo has changed the topic to: BPWG Roundabout Engineering Task FOrce 08:37:48 jo has changed the topic to: BPWG Roundabout Engineering Task Force 08:38:32 Chair: Sean 08:38:54 Meeting: BPWG Checker Task Force, Sophia Antipolis, Day 1 08:39:03 scribe: Jo 08:39:07 scribenick: jo 08:39:18 rrsagent, make logs public 08:39:25 rrsagent, draft minutes 08:39:25 I have made the request to generate http://www.w3.org/2007/09/04-mobileok-minutes.html jo 08:44:37 srowe1 has joined #mobileok 08:44:46 Testing 08:45:53 jo has joined #mobileok 08:46:22 Present: Sean, Dom, Nacho, Roland, Ruadhan, Abel, Miguel, Jo 08:46:31 RRSAgent, draft minutes 08:46:32 I have made the request to generate http://www.w3.org/2007/09/04-mobileok-minutes.html jo 08:47:15 Topic: Agneda 08:47:23 s/Agneda/Agenda 08:47:53 Sean: Today mostly about where we are and raising issues and problems, things we need to get done 08:48:12 ... tomorrow about solving and prioritizing issues 08:48:26 ... Thursday about doing some collaborative work 08:48:35 rrsagent, please draft minutes 08:48:35 I have made the request to generate http://www.w3.org/2007/09/04-mobileok-minutes.html jo 08:49:45 Agenda: http://lists.w3.org/Archives/Public/public-mobileok-checker/2007Aug/0084.html 08:50:14 abel has joined #mobileok 08:50:17 Sean: agenda edited due to late start (roundabout factor) 08:50:20 miguel has joined #mobileok 08:50:25 Topic: Review of Laura's work 08:50:26 miguel has left #mobileok 08:50:52 Sean: Think Laura did the following tests: 08:51:05 3.1 AUTO_REFRESH (partial) and REDIRECTION 08:51:05 3.2 CACHING 08:51:05 3.3 CHARACTER_ENCODING_SUPPORT and CHARACTER_ENCODING_USE 08:51:05 3.4 CONTENT_FORMAT_SUPPORT and VALID_MARKUP 08:51:05 3.5 DEFAULT_INPUT_MODE 08:51:06 3.6 EXTERNAL_RESOURCES 08:51:08 3.7 GRAPHICS_FOR_SPACING 08:51:10 3.8 IMAGE_MAPS 08:51:10 miguel has joined #mobileok 08:51:12 3.9 IMAGES_RESIZING and IMAGES_SPECIFY_SIZE 08:51:14 3.11 MEASURES 08:51:16 3.20 STYLE_SHEETS_SUPPORT (partial) 08:51:50 sean: need to review in detail but think they are substantially working, good job, probably ready for Beta 08:52:00 ... some of the issues that came up: 08:52:24 ... overall test application - command line runner 08:52:35 ... let's try it against google 08:52:48 ... really slow start up 10-15 secs 08:54:14 ruadhan has joined #mobileok 08:55:28 ... shouldn't be this slow 08:55:34 ... [raisis issue] 08:55:43 s/raisis/raises/ 08:56:08 Ruadhan: installed resolver for DTDs so shouldn't be that 08:56:32 Sean: looks at moki doc 08:57:28 jo: need to resolve how multiple references to the same thing is handled in moki doc 08:57:42 Sean: think that is done 08:59:28 jo: need to refer to where the reference is that causes an image to retrieved 08:59:52 ... e.g. an image that is retrieved by an imported style sheet that imports a style sheet 09:00:11 dom: parsing errors won't pick this up 09:01:05 jo: need to state what the rule is for equivalence of URIs 09:01:22 ... just needs to be stated and document 09:05:11 sean: I think this complicates the code considerably more than it seems 09:06:07 jo: I think it is important from the point of helping implementors find out e.g. where something has gone wrong and why a document has been retrieved 09:06:30 dom: we should at least record the source document if not from the line number 09:06:36 ... think this would be sueful 09:06:42 s/sueful/useful/ 09:07:47 Jo: think that we should amke an issue about recording the line no and source document that caused a retrieval 09:07:56 s/amke/make/ 09:08:21 dom has joined #mobileok 09:08:25 nacho has joined #mobileok 09:09:00 [sean raises ISSUE-210] 09:10:09 jo: should I make the HTTP thing a spearate namespace 09:10:20 dom: no lets keep it simple for now 09:10:37 s/spearate/separate/ 09:12:41 jo: we should make the element names MarkupValidity and MobileValidity more clearly different 09:12:49 ... more meaningful 09:13:19 [sean raises ISSUE-211] 09:14:16 sean: be aware of the knock-on effect on style sheets 09:14:38 ... everything will need to be checked for references 09:14:57 Abel: extraneous characters are not being checked properly yet 09:22:10 Sean: do we have a problem with the character encoding? 09:23:29 TODO: complete test on extraneous characters 09:23:45 TODO: add "about me" node (info about implementation libraries, versions, etc) 09:23:57 TODO: missing namespaced in parsed/tidy document 09:24:43 TODO: show whether the parsed document has been tidied 09:24:58 TODO: encoding output not showing properly 09:25:29 -> editors draft http://www.w3.org/2005/MWI/BPWG/Group/Drafts/mobileOK-Basic-1.0-Tests/070824 09:25:54 nacho has joined #mobileok 09:25:59 -> http://www.w3.org/2005/MWI/BPWG/Group/Drafts/mobileOK-Basic-1.0-Tests/070824 mobileOK Basic latest editors draft 09:27:06 Sean: hover is invalid CSS? 09:27:30 jo: it's not CSS 1 - anyway it shouldnot say 'invalid' it reults only in a warn 09:28:30 sean: yes we should probably make it consistent and not say it is a fail 09:29:17 TODO: modify moki not to say "fail" for warns on CSS (distinguish errors from warnings) 09:29:27 TODO: complete stylesheet_use to pick up the warnings 09:31:54 TODO: omit when column undetermined 09:32:27 [discussion about the fact that we don't ever have a column no so should be omitted for clarity] 09:33:26 Abel: we're not checking inline styles at this time (style='background-image:url()') 09:33:36 ... we can have a look at this 09:34:13 TODO: deal with inline stylesheets 09:34:33 s/stylesheets/styles defined in attributes/ 09:38:33 Zakim has left #mobileok 09:38:43 sean: we should check for style attribute when running the XSLT 09:39:50 abel: we can put stylesheet type as "inline" or something 09:40:36 jo: it would make more sense to have the CSS results all in one place 09:40:54 sean: but it is, having stuff in the moki document is merely a conveience 09:41:11 convenience 09:41:26 s/conveience/convenience 09:41:41 s/convenience// 09:43:49 TODO: delete stylesheetssupporttest.xsl 09:44:37 [the latter is done] 09:44:44 miguel: stylesheetsupport.xsl was for when we serialised it as XML 09:46:09 sean: issue about finding line and column 09:46:30 dom: we should just do our best efforts as there is only one line in attributes anyway 09:46:46 (and they can only be in the markup document, by definition) 09:47:22 sean: should we just make this an inline type in the moki without line number 09:47:26 RRSAgent, draft minutes 09:47:26 I have made the request to generate http://www.w3.org/2007/09/04-mobileok-minutes.html dom 09:47:33 [Agrred that thiswould be the approach] 09:47:48 s/Agrred/Agreed/ 09:50:52 nacho_ has joined #mobileok 09:52:22 Sean: links ... we don't have the body in the moki document 09:52:56 jo: we cant look at meta if we don't have the body 09:53:17 Sean: we should at least look at this to see what it is doing 09:53:18 nacho has joined #mobileok 09:54:11 nacho has joined #mobileok 09:54:19 ... need to check whether the body is omitted on links a) because it is application/xhtml or b) because the charset was already specified so there is no need for the body 09:54:37 sean: so the question is when should the body be recorded 09:55:03 ... a) we should record bodies despite the bloat 09:55:18 ... b) we should not record unknown or binary 09:59:56 nacho_ has joined #mobileok 10:01:30 nacho has joined #mobileok 10:03:26 .. c) not for link targets either 10:04:57 [jo raised an issue on LINK_TARGET_FORMAT, ISSUE-212 making clear that the document body does not need to be examined] 10:12:17 [raised ISSUE-213 on objects etc ] 10:12:46 RESOLUTION: Record the body only of external CSS 10:13:27 nacho_ has joined #mobileok 10:17:12 TODO: Cahce Control test (and others) should only be carried out on the final redirect of any particular request 10:17:45 TODO: Results need to be labelled with the document that they are moaning about if it is not the primary doc 10:18:00 s/Cahce/Cache/ 10:24:23 Sean: meta refresh 10:24:47 jo: I think we should stop if we see refresh because the rest of the results are bougus 10:24:58 s/bougus/bogus/ 10:25:38 sean: I think we should just leave it as it is 10:29:00 nacho has joined #mobileok 10:29:17 [Sean raises ISSUE-214 on whether it is sensible to stop or not] 10:39:08 dom has joined #mobileok 10:39:35 -> http://lists.w3.org/Archives/Public/www-validator/2003Jul/0174.html someone complaining about the markup validator not following meta-refresh (and life, universe , and everything) 10:40:52 I have made the request to generate http://www.w3.org/2007/09/04-mobileok-minutes.html dom 11:38:41 dom has joined #mobileok 11:40:36 miguel has joined #mobileok 11:42:57 j1 has joined #mobileOK 11:46:28 [continuing after lunch] 11:46:39 Sean: let's carry on with looking at the moki document 11:48:19 ... should we use copy of text in the tests document or edited a bit 11:48:26 miguel has joined #mobileok 11:50:29 ... OK that's about it from me, I am going to get a bit more involved from now 11:50:39 ScirbeNick: srowe1 11:50:49 Scribenick: Sean 11:51:04 ScirbeNick: srowe1 11:51:07 scribenick: srowe1 11:53:15 roland: finished all my tests but STYLE_SHEETS_USE-5 and OBJECTS_OR_SCRIPT-6 11:54:01 focused on XSLT and not junit tests 11:54:10 nacho has joined #mobileok 11:54:40 have been using moki and saxon+xslt, writing success and failure tests 11:55:16 have problems running the test implementation 11:55:30 srowe1: only need to run 'ant' 11:55:38 roland: yes, tests fail 11:55:57 need to wait until tests don't fail 11:56:29 srowe1: should be basically runinng, building now so report problems to list 11:57:35 roland: can also write junit tests 11:58:35 srowe1: should not need to write junit tests if not writing java code 11:58:53 roland: rename functions.xsl to common.xsl? 11:59:35 dom: seems Ok to leave it as is 12:00:15 roland: xpath and moki document may not explain the test. need to include references to mobileok basic document 12:00:33 leads us to discuss ids and names 12:00:53 latest draft has IDs in document 12:01:25 need to agree on naming convention 12:04:32 don't see, where is the test_ syntax used? 12:04:49 the IDs in the new basic tests draft 12:10:32 (much discussion about current conventions) 12:11:17 PROPOSED RESOLUTION: change 'test_x' anchors in mobileOK Basic doc to 'X' 12:12:27 PROPOSED RESOLUTION: for tests related to multiple BPs, use the name of the first one (e.g. AUTO_REFRESH, not AUTO_REFRESH_REDIRECTION) 12:15:55 PROPOSED RESOLUTION: leave current fragment identifiers for any test conditions that don't directly map to best practices 12:17:58 RESOLUTION: change 'test_x' anchors in mobileOK Basic doc to 'X' 12:18:05 RESOLUTION: for tests related to multiple BPs, use the name of the first one (e.g. AUTO_REFRESH, not AUTO_REFRESH_REDIRECTION) 12:18:10 RESOLUTION: leave current fragment identifiers for any test conditions that don't directly map to best practices 12:18:40 roland: being consistent lets one automatically look for differences between mobileOK Basic document and test output 12:19:32 roland: some tests do not have xhtml namespaces 12:20:15 http://lists.w3.org/Archives/Public/public-mobileok-checker/2007Jul/0080 12:21:44 srowe1: solving html xmlns problem will solve this problem too 12:22:04 roland: laura finished some tests -- who owns her tests now? 12:22:06 srowe1: I will 12:23:00 let's look at the status in the google doc 12:23:12 dom: let's distinguish between coding done and test suites complete 12:24:18 > http://docs.google.com/View?docid=dgh5r6zs_5cb7gz3 mobileOK test implementation on google docs 12:25:33 let's update the document 12:25:39 I can own the first 9 now, all should be completed 12:26:42 plus MEASURES STYLE_SHEETS_SUPPORT 12:26:52 roland: by 'finished' I mean 'coding done' -- will update 12:28:50 srowe1: roland, sounds like status is you have written implementations in xslt but haven't been able to write tests 12:29:11 roland: yes and have found some bugs / unnecessarily complicated expressions in XSL, and fixed those 12:30:32 topics for tomorrow - what will happen when mobileOK goes live? bugs, maintenance, etc.? 12:31:55 srowe1: think we need a bug tracker for people to report bugs. I will try to stay involved after release and hope everyone can. what else? 12:32:03 roland: yes, what are next steps? 12:33:15 I have added a mobileok checker product in http://www.w3.org/Bugs/Public/ ] 12:33:21 s/I/[I/ 12:33:31 srowe1: how are we going to put this out with a public web interface, to get a lot of usage and see bugs? 12:34:04 not sure ready.mobi can just use this since it will be buggy 12:34:28 ruadhan: could put out a beta version for people to use 'at their own risk' 12:35:07 would have to run by james 12:35:47 j1: not clear how comprehensive the tests we have here are 12:36:14 not sure we have all positive and negative tests for tests 12:36:23 srowe1: yes full regression test suite is essential 12:37:45 how about putting this up as a beta at validator.w3.org/mobile? 12:38:03 dom: yes as soon as performance issues are solved. can wrap the java library in python 12:38:31 critical to a) implement all tests and b) fix performance first 12:38:41 the more we have regression tests the better I feel 12:42:22 srowe1: think we need to first finish this (plus performance issues) and write regression tests 12:42:34 then put it up at w3.org, let it prove itself, collect bugs 12:42:44 then have ruadhan look at ready.mobi beta based on it 12:42:54 look at differences with current implementation to find more bugs 12:43:00 but that's not on the radar yet 12:44:21 roland: when we launch a service there are many administrative concerns like errors, logs, performance. who will monitor this? 12:44:57 dom: won't be a problem, I will be administering initially 12:48:10 I have made the request to generate http://www.w3.org/2007/09/04-mobileok-minutes.html dom 13:15:23 roland has joined #mobileok 13:18:39 we have a reservation for tonight at: 13:18:39 Restaurant la Daurade 13:18:39 44 bd Aguillon 13:18:39 06600 Antibes 13:28:44 abel: LINK_TARGET_FORMAT has some issues 13:29:27 miguel: https connections can be handled by apache http client, but mobileOK basic tests say in 2.3.3, 13:29:39 we have to check certificate validity and so on 13:30:33 not sure if http client handles invalid certificate 13:30:52 need to implement socket connection to see if certificate is valid or not 13:31:08 but don't stop test 13:34:32 srowe1: is the issue just checking for certificate expiration? 13:34:48 miguel: note that client will accept self-signed certificates, good 13:36:20 srowe1: client will fail fast if HTTPS certificate is invalid 13:38:51 the TODO concerns handling expired certificates 13:39:30 miguel: need to define how to request forms with GET 13:40:11 for linked results, we need at least information to carry out consistence of content type test 13:42:00 srowe1: first point is about forms. you are noting that we are not handling form inputs with actual values when GETting the form action URI 13:42:12 dom: yes we would need to do that. But I think we should not handle forms at all 13:43:42 this is just for a warn, after all 13:52:55 TODO: deal properly with GET forms (i.e. include empty/default values for each form element) 13:53:15 dom: parsing the input elements and forming URI is not so bad 13:53:34 (digression on name "Visible Linked Resources") 13:53:49 miguel: I think we will get back errors of blank pages in response many times 13:54:02 dom: yes, results are likely to be useless 13:54:13 j1: all we are looking for is content type really, not results 13:54:41 j1: difference between HEAD and GET 13:54:54 dom: according to HTTP should return the same headers 13:55:13 j1: all we care about is content type 13:55:30 miguel: we will usually just get errors anyway 13:56:09 we aren't testing the "real" case anyway 13:56:29 can get different pages in response to a form 13:57:30 srowe1: a bit better to request the form properly so we're more likely to test a 'real' case. Can never test all cases. 13:57:49 dom: just seems like a bunch of effort for little 13:58:10 j1: will catch a small but useful number of cases, like using a form for a push-button when it could be a hyperlink 14:01:01 srowe1: miguel your other point was the same we discussed this morning -- whether we need to keep body of linked resources? 14:02:18 related to ISSUE-212 14:02:19 http://www.w3.org/2005/MWI/BPWG/Group/track/issues/212 14:03:11 srowe1: not an issue if we decide to not examine body of linked resources 14:03:39 miguel: MINIMIZE 14:04:12 still need to exclude pre, style, script, etc. 14:08:23 also need to not use Character.isWhitespace() 14:08:32 roland: why do we exclude style and script? 14:09:10 j1: we could re-serialize CSS and compare with original to detect extra whitespace 14:09:18 srowe1: is whitespace ever significant? 14:09:24 in CSS? 14:10:14 dom: a string literal with multiple spaces, for example, shouldn't be counted against the page in