20:04:38 RRSAgent has joined #html-a11y 20:04:38 logging to http://www.w3.org/2011/01/10-html-a11y-irc 20:04:40 RRSAgent, make logs world 20:04:40 Zakim has joined #html-a11y 20:04:42 Zakim, this will be 2119 20:04:42 ok, trackbot; I see WAI_PFWG(A11Y)3:00PM scheduled to start 4 minutes ago 20:04:43 Meeting: HTML Accessibility Task Force Teleconference 20:04:43 Date: 10 January 2011 20:05:06 zakim, i am Gregory_Rosmaita 20:05:06 sorry, oedipus, I do not see a party named 'Gregory_Rosmaita' 20:05:25 zakim, who is on the phone? 20:05:25 WAI_PFWG(A11Y)3:00PM has not yet started, oedipus 20:05:26 On IRC I see RRSAgent, richardschwerdtfe, oedipus, MikeSmith, jongunderson, MichaelC, sideshow, trackbot 20:05:52 Meeting: HTML Canvas Accessibility subteam meeting 20:06:03 zakim, this is WAI_PFWG(A11Y) 20:06:03 ok, oedipus; that matches WAI_PFWG(A11Y)3:00PM 20:06:11 zakim, who is on the phone 20:06:11 I don't understand 'who is on the phone', oedipus 20:06:13 zakim, who is on the phone? 20:06:13 On the phone I see +1.802.362.aaaa, Rich, +1.802.362.aabb, +1.949.637.aacc, Gregory_Rosmaita 20:06:36 regrets: Frank_Oliver 20:07:03 can you call in Gregory? 20:07:09 i'm on the phone 20:07:19 zakim, who is here? 20:07:19 On the phone I see +1.802.362.aaaa, Rich, +1.802.362.aabb, +1.949.637.aacc, Gregory_Rosmaita 20:07:21 On IRC I see RRSAgent, richardschwerdtfe, oedipus, MikeSmith, jongunderson, MichaelC, sideshow, trackbot 20:07:57 zakim, aacc is Chuck_Pritchard 20:07:57 +Chuck_Pritchard; got it 20:08:08 scribe: Gregory_Rosmaita 20:08:11 scribenick: oedipus 20:08:24 TOPIC: State of Canvas A11y 20:08:28 Tim Lalor: senior engineer, AISquared (make ZoomText) 20:09:08 Shawn Warren from AI Squared 20:09:27 zakim, aaaa is Tim_Lalor 20:09:27 +Tim_Lalor; got it 20:09:40 zakim, aabb is Shawn_Warren 20:09:40 +Shawn_Warren; got it 20:09:45 zakim, who is here? 20:09:45 On the phone I see Tim_Lalor, Rich, Shawn_Warren, Chuck_Pritchard, Gregory_Rosmaita 20:09:47 On IRC I see RRSAgent, richardschwerdtfe, oedipus, MikeSmith, jongunderson, MichaelC, sideshow, trackbot 20:09:51 I have made the request to generate http://www.w3.org/2011/01/10-html-a11y-minutes.html oedipus 20:10:23 HTML_Canvas_2DContext120910.html: http://lists.w3.org/Archives/Public/public-canvas-api/2011JanMar/att-0002/HTML_Canvas_2DContext120910.html 20:10:26 CanvasEditor.html: http://lists.w3.org/Archives/Public/public-canvas-api/2011JanMar/att-0002/CanvasEditor.html 20:10:29 HTML_Canvas_Element.html: http://lists.w3.org/Archives/Public/public-canvas-api/2011JanMar/att-0002/HTML_Canvas_Element.html 20:10:30 swarren has joined #html-a11y 20:10:47 Downchuck has joined #html-a11y 20:10:51 -Tim_Lalor 20:10:57 Hi 20:11:12 agenda: http://lists.w3.org/Archives/Public/public-canvas-api/2011JanMar/0002.html 20:11:18 I have made the request to generate http://www.w3.org/2011/01/10-html-a11y-minutes.html oedipus 20:12:01 CP: magnification brings unique challanges -- doing zoom doesn't garuntee magnification 20:12:07 RS: what canvas is in HTML5 20:12:40 RS: canvas isn't a lot different from windows -- drawing to canvas in windows environment -- big issue for a11y -- how to convey info to an accessibility API on any given platform 20:12:46 RS: got fairly long way along 20:13:04 RS: created inside of CANVAS (uses javascript to draw items on canvas) 20:13:54 RS: inside of CANVAS to make accessible, created sub-tree in UA so that can create HTML elements representative of objects drawn to canvas can be mapped to a11y API -- could alos markup with ARIA -- all would populate a11y API 20:14:25 RS: magnification problems: DOM MVC via javascript, what is in sub-tree isn't drawn on canvas -- positions of elements don't map to what one actually sees on canvas 20:14:34 RS: no a11y API where js can do stuff like that 20:14:44 RS: what info is absolutely essential for screen magnification? 20:15:24 RS: proposal - FocusRing would be trackable from a11y APIs 20:15:39 RS: caret positioning proposal -- is this enough for magnification? 20:16:11 RS: clipping of text and exposition of clipped text -- issue for magnification if no positioning info -- other strategies? 20:16:27 RS: move focus position to content -- moves focus position on screen? 20:16:46 RS: trying to walk fine line: what is necessary for author to do and AT to have 20:16:59 TL: looks like CANVAS is opaque to us right now 20:17:35 TL: few pieces: focus events are key -- need to know where to track the view -- if can capture focus event, will help us understand where viewport of magnifier should focus on -- FocusRing 20:17:53 TL: caret tracking also fundamental for screen mag -- maintain in view and wrap in locator 20:18:08 RS: have to get WG sign-off on FocusRing proposal -- waiting for MS feedback 20:18:33 RS: changes to spec that refer to that -- example of 2 checkboxes (don't have FocusRing drawing in API) 20:18:41 CanvasEditor.html: http://lists.w3.org/Archives/Public/public-canvas-api/2011JanMar/att-0002/CanvasEditor.html 20:18:56 TL: used ARIA-selection of "no-width" for caret 20:19:11 RS: for caret istelf, yes -- proposal is caret selection would know if RTE 20:19:30 RS: added API to 2D Canvas context http://lists.w3.org/Archives/Public/public-canvas-api/2011JanMar/att-0002/HTML_Canvas_2DContext120910.html 20:19:45 RS: use actual textfield or checkbox in subtree -- process as usual, provide positioning info 20:20:05 TL: scrolling into view as content consumed and presented to user, need to highlight words 20:20:47 TL: imagine canvas a single sentence clipped by bounding rectange; need to drive presentation of canvas (scroll to left) -- 2 parts: position info; being able to drive viewport of canvas itself 20:21:04 RS: charles is our resident canvas expert 20:21:14 RS: can't markup position of text in sub-tree 20:21:22 CP: can't do with textarea -- no API for this 20:21:41 SW: have ScroolTo -- API not there -- nothing to model on to write in standards 20:22:06 SW: done RTE with scroll bars; know where cursor is; TEXTAREA element is quite basic; contenteditable also very basic 20:22:35 RS: question: if have ability to move caret position thorugh a11y APIs, would that be picked up by app for positioning 20:22:55 SW: will work if trying to navigate between text; but if want to scroll down 20 pixels, how does one do that? 20:23:25 SW: single-line text editing with input box laid over picture -- if type a lot, shifts to left -- HTML forms a "bit" deficient in this area 20:23:32 TL: static content and dynamic content 20:23:56 TL: is there way to scroll data content so can use highlight as march across section; scroll when reach right edge 20:24:29 SW: setting caret position good enough for most of that -- can be recalculated before scroll -- automatic word-wrapping a BIG problem 20:25:01 SW: looking at windows API -- magnifier is a sub-window that accesses same content at diff zoom level and may have diff selection objects 20:25:29 SW: another issue: when zoom in using UA zoom, CANVAS doesn't know how to handle content -- ensure not blurry -- pixel offset needs to be tackled 20:26:00 TL: selection and caret location: 1 distinct case is diff controls and selection events for multiple characters and words selected 20:26:15 TL: raised as events? caret move with selection? or mouse selection across text 20:26:22 CP: have OnSelectStart 20:26:30 CP: related to input method edititors 20:26:58 CP: onSelectStart only selection event -- more would be helpful 20:27:34 CP: some push-back on input method editinig -- should it be up to OS, browser vendor? when UA vendor hasn't implemented, what to do? 20:27:52 CP: this is a good use case -- can't get anywhere without additions to APIs 20:27:55 CP: will help counter push-back 20:28:01 CP: bare essentials necessary 20:28:16 CP: need scroll events and selection events that work in TEXTAREA 20:28:56 TL: help us in dynamic area - -when user typing to know what selected -- could span more than is visible -- helps to know what user is actually selecting so can keep scrolling view and can tell user what is happening 20:29:33 TL: watch text and background colors 20:29:49 TL: when API available, use it; when not available, have heuristics 20:29:58 CP: list of API holes? 20:30:11 CP: or incomplete implementation of API 20:31:00 RS: AT immunity -- have to be cognizant of propritary methods 20:31:11 TL: use open standards -- focus on APIs not heuristics 20:31:42 CP: heuristics too hairy for me -- you guys know the standards -- if anything you can share for input method would be appreciated 20:31:56 TL: using MSAA standard Windows events and UIA 20:32:04 TL: evaluating UIA's integrity 20:32:18 GJR: IAccessible2? 20:32:29 TL: playing with it--in roadmap -- other higher priorities 20:32:43 RS: can you post what window events and APIs you are using? 20:32:53 TL: window events is a kind of alchemy 20:33:00 TL: other APIs pretty self-explanatory 20:33:17 RS: use MSAA standard windows events for showing/hiding? 20:33:41 TL: selection: MSAA provides data on current selection, comparison to cached version, 20:33:50 RS: IA2 does selcetion changing 20:34:04 RS: selection change events at high level -- how tell if something scrolled off screen? 20:34:27 TL: those are used in some scenarios, but use API to compute visability 20:34:52 TL: couple of levels of visability: visible on page; rendered but clipped; not rendered anywhere (on or off screen) 20:35:07 TL: where heuristics come into play -- if user scrolls, then render 20:35:17 CP: requestAnimationFrame similar 20:35:34 CP: what would the API be if one were available? 20:35:49 CP: API that reduces need for heuristics? 20:36:02 CP: UA devs need to know what needs to be there 20:36:27 RS: take content and select it -- aria-selected -- could mark area -- receive notification events under the covers 20:36:31 RS: positioning info 20:36:44 CP: what positioning info is needed? 20:37:24 TL: CANVAS completely contains text, would like to highlight each word inside of canvas in a sequence -- speak word and highlight even if not editable -- positioning critical to displaying highlight 20:37:32 CP: can you get away with next word? 20:37:52 TL: if way to enumerate can wrap rectangle around it 20:37:59 CP: as long as going word-to-word is feasible 20:38:18 CP: problem with older verions of IE -- but enumerating works 20:38:33 RS: suggesting notification from AT to enumerate words? 20:38:56 CP: getNextElement or getNextChild --- from current position go to next word 20:39:07 RS: how AT call into UA to get info? 20:39:27 RS: can provide functionality via javascript -- need to get to next word and speak it and highlight it 20:39:40 CP: when highlighting interacting with DOM or IME 20:39:47 davidb has joined #html-a11y 20:39:57 TL: when highlighting may leave UA rendering alone before write anything to screen 20:40:13 RS: canvas author draws pre-rasterized text 20:40:20 CP: optimized to be pre-rastorized 20:40:28 RS: how to highlight once happens? 20:41:00 CP: going to need to determine if caret moves 20:41:50 TL: know where next word is or next sentence -- in our own way, can do highlighting as goes to screen -- flatten image, so canvas not effective -- can't use canvas to do stuff inside canvas -- have own tech to highlight regardless 20:42:21 TL: hesistant to move cursor around -- prefer to not move cursor 20:42:29 CP: FF allows multiple selection ranges 20:42:46 CP: 2 people may have 2 diff cursors moving -- virtual or secondary cursor use case? 20:43:05 CP: like concept of bringing that in -- here is virtual cursor, what is next word? 20:43:26 CP: need L,W,H for same purpose? 20:43:50 RS: each a11y API on windows has notion of bounding recatangles -- can compute rectangle and then highlight it 20:44:10 RS: can't expect author to write in position info for all text -- need to have second virtual cursor? 20:44:50 CP: for best case, need virtual window to do scroll and adjust to new pixel ratio -- make sense if virtual window had cursor, scrolling and own DPI ratio 20:44:55 RS: how to do for spec? 20:45:09 AbstractView 20:45:17 CP: got to go all the way to AbstractView 20:45:28 CP: none of this has to do strictly with canvas, right? 20:45:43 CP: using AbstractView with CANVAS, but isn't "of canvas" 20:45:51 RS: 1-to-1 mapping in a11y APIs 20:46:17 RS: 1-to-1 mapping tying into layout engine -- canvas is seperate 20:46:35 RS: view of canvas is separate from DOM -- not wired together -- can forsee problem with SVG as well 20:47:03 RS: when deal with MS Office, most AT vendors access office through proprietary DOM --- does AISquared do that? 20:47:14 http://www.w3.org/TR/DOM-Level-2-Views/views.html 20:47:20 TL: use Word Object Model to get content -- have to use others to get application support 20:47:30 TL: toolbars, etc. reflected in MSAA 20:48:18 TL: if object model too slow, then might do own analysis -- a lot of techs to get same info -- can talk to object model, subscribe to MSSAA event or graphics stack 20:48:27 TL: use "content model" to get content of document 20:48:36 RS: how map through layers? 20:48:52 RS: if select text, how map positioning info -- look at cached drawing calls or OSM? 20:49:00 http://msdn.microsoft.com/en-us/library/kw65a0we(v=vs.80).aspx 20:49:08 TL: in Excel had to do translations and calculations based on mapping mode 20:49:33 TL: convert between object model and pixels -- may have to go through hoops to get to screen 20:49:51 RS: similar situation with CANVAS -- providing a DOM 20:50:05 RS: does Office object model provide positioning? device context? 20:50:42 TL: have had challenges with PDF document -- depending on how query, may get "page relevant" -- each DOM needs a bit of massaging 20:50:54 RS: what do we need to do in canvas -- how to get info to AT dev 20:51:46 TL: if there is a virtual canvas, real-life canvas may only be a portion of that -- don't want author to provide positioning -- coordinates on virtual canvas and calculate to render in viewport 20:51:52 RS: is that consistent mapping? 20:52:02 CP: larger bitmap area or virtual coordinate system? 20:52:09 TL: can think of it both ways -- 20:52:16 CP: optimal not to have bitmap 20:52:34 CP: AbstactView for canvas seems a good fit 20:53:00 TL: coordinate is x,y in virtual canvas (may be outside of bitmap) 20:53:11 RS: with canvas sub-tree how to give abstract coordinates? 20:53:36 TL: top left of any canvas is 0,0; after that, best model is SVG coordination -- what need in CANVAS 20:53:51 TL: use virtual for topmost level 20:54:03 RS: dev pushback? 20:54:39 TL: AbstactView for canvas may be politically tricky but needed; already in SVG, but can't zoom into SVG with magnifier 20:54:56 TL: seems that this is right solution 20:55:45 s/TL: coordinate is x,y in virtual canvas (may be outside of bitmap)/CP: coordinate is x,y in virtual canvas (may be outside of bitmap)/ 20:56:03 http://msdn.microsoft.com/en-us/library/microsoft.office.interop.word.selection.startof.aspx 20:56:04 s/TL: top left of any canvas is 0,0; after that, best model is SVG coordination -- what need in CANVAS/CP: top left of any canvas is 0,0; after that, best model is SVG coordination -- what need in CANVAS/ 20:56:10 somewhat interesting link on word selection 20:56:28 s/TL: AbstactView for canvas may be politically tricky but needed; already in SVG, but can't zoom into SVG with magnifier/CP: AbstactView for canvas may be politically tricky but needed; already in SVG, but can't zoom into SVG with magnifier/ 20:56:56 RS: would like to get AISquared feedback at meetings - email is ok, but being on call is very helpful 20:57:05 https://03.chat.mibbit.com/?url=irc%3A%2F%2Firc.w3.org%3A6665 20:57:11 i just used that one for quick access 20:57:41 RS: CP please float AbstactView by WG? 20:58:02 CP: may be best to float before SVG WG before going to HTML WG 20:58:16 RS: alternate proposals for caret and FocusRing proposals 20:58:21 RS: FrankO says "drop" 20:58:39 RS: IME stuff happening at google --people will use canvas for this (editing) 20:58:55 CP: guy working on IME not dropping it 20:59:16 RS: concern: don't want to have HTML5 go out and say "we'll fix in next point release" 20:59:32 CP: good to get methods for canvas in there -- IME in canvas drives people nuts 20:59:52 CP: APIs for canvas are simple -- bit of tweaking and feedback should work 21:00:11 CP: treading warily in WHAT WG space 21:00:22 RS: FocusRing a no-brainer 21:00:46 TL: can't mange input="text" -- scrolls itself 21:00:52 RS: thanks to TL and SW for attending 21:01:25 [adjourned] 21:01:25 -Chuck_Pritchard 21:01:27 -Shawn_Warren 21:01:33 -Rich 21:01:34 WAI_PFWG(A11Y)3:00PM has ended 21:01:35 Attendees were +1.802.362.aaaa, Rich, +1.802.362.aabb, +1.949.637.aacc, Gregory_Rosmaita, Chuck_Pritchard, Tim_Lalor, Shawn_Warren 21:01:43 Zakim has left #html-a11y 21:02:04 I have made the request to generate http://www.w3.org/2011/01/10-html-a11y-minutes.html oedipus 21:02:26 chair: Rich 21:02:29 I have made the request to generate http://www.w3.org/2011/01/10-html-a11y-minutes.html oedipus 21:03:01 present- +1.802.362.aaaa, +1.802.362.aabb, +1.949.637.aacc 21:03:03 I have made the request to generate http://www.w3.org/2011/01/10-html-a11y-minutes.html oedipus 21:03:57 i/TL: used ARIA-selection of "no-width" for caret/TOPIC: What is needed for Screen Magnification Support for CANVAS?/ 21:03:58 I have made the request to generate http://www.w3.org/2011/01/10-html-a11y-minutes.html oedipus 21:04:51 meeting: CANVAS Subteam of HTML A11y TF 21:04:53 I have made the request to generate http://www.w3.org/2011/01/10-html-a11y-minutes.html oedipus 21:05:26 meeting+ CANVAS Subteam of HTML A11y TF 21:05:29 I have made the request to generate http://www.w3.org/2011/01/10-html-a11y-minutes.html oedipus 21:11:52 rrsagent, please part 21:11:52 I see no action items