W3C

Results of Questionnaire Add "Evaluating Procedures" Protocol as exploratory content

The results of this questionnaire are available to anybody.

This questionnaire was open from 2022-07-29 to 2022-08-01.

7 answers have been received.

Jump to results for question:

  1. Comments and Concerns to include into a draft editor's note
  2. Add "Evaluating Procedures" Proposal into testing section (replacing procedures) as Exploratory

1. Comments and Concerns to include into a draft editor's note

Please review the editor's note at the top of section 5 and then include any additional comments, questions or concerns you wish to include in an editor's note for this exploratory content.

Details

Responder Comments and Concerns to include into a draft editor's note
Jennifer Strickland This work should remain exploratory until WCAG3 evolves testing and conformance. Please explain any possible reasoning for why this would be included in testing. In the Editor's Note I don't see anything that explains this. Rather I see a list of questions and some clarifications of terminology.
Gundula Niemann It should say "An outcome" (first words)

Jaunita George
Mary Jo Mueller IMO, the list of questions is very extensive and the editor's note doesn't indicate if these are questions that you are seeking input on or simply questions that the group intends to answer in future draft content.

If response to the questions is being sought, some of the questions are too broad or can be interpreted in different ways so readers may not really know what is being asked and how to respond. As one example: The current question, "Is it possible to localize it into different languages?" Does this mean, "Can/should a protocol be localized (translated) into different languages?" or "Is there a need to have protocols that are specific to a locale or type of language (e.g. right to left, left to right, to support Kanji or other symbol-based writing)?" Do you want the responder to give some examples? If so, ask for them.
Jeanne F Spellman We would want an example between small and large >5FTE and <25 FTE -- but that is assumed and not relevant to the examples. We should consider the evaluations in total as well as individual, because I think that the examples are too heavy weight if an organization were doing multiple outcomes all requiring similar examples.
Bruce Bailey
Rachael Bradley Montgomery

2. Add "Evaluating Procedures" Proposal into testing section (replacing procedures) as Exploratory

Do you support adding the "Evaluating Procedures" proposal into the testing section (replacing procedures) as Exploratory?

Summary

ChoiceAll responders
Results
yes 5
no 2

Details

Responder Add "Evaluating Procedures" Proposal into testing section (replacing procedures) as ExploratoryComments
Jennifer Strickland no I don't understand how the "Evaluating Procedures" proposal fits into testing.

First, what is Testing in WCAG3? Do we have that yet? Why would we add anything to it? I'm not putting my money into an account that will some day be created.

Second, Protocols are not to be used to assert conformance with any standard. Rather, protocols serve to show the effort made to evaluate *subjective* WCAG guidelines that cannot be measured objectively. Using an established protocol as a guide to evaluate subjective outcomes is a way that folks developing digital services can meet the spirit of WCAG subjective outcomes.

In an ideal world, WCAG would provide what protocols do — the reality is WCAG lacks the volunteers and effective processes to output the guidance for all the subjective outcomes. WCAG is busting at the seams in desperate need of more volunteers, functional processes that those volunteers can effectively output guidelines, and accessible, equitable, and inclusive methods to participate in WCAG.
Gundula Niemann no
To me it is not clear whether an " outcome evaluation procedure" describes how a company plans to go or how it went.
On one hand it says "Outcome implementation procedures describe inputs to the process such as documentation of steps, actions taken, date completed, ..." which suggests the way was already gone.

On the other hand example 1 it says "This procedure aims to ensure that ...". which suggests the way is planned to go.

In order to clearly suggest the meaning I suggest to also change the name, for example to "method" (if this is meant) or journal / logbook (if this is meant).
Jaunita George yes
Mary Jo Mueller yes It's fine adding it, though there are some terms and abbreviations used that have no definition that could hinder understanding of the content. e.g. "FTE assignments" where "FTE" is never spelled out. Use of "assertion" vs. "declaration" vs. "statement" in the questions vs. the use of "outcome implementation procedures" in the draft content. This makes it difficult to determine if you're talking about something else or the same thing by different terms.
Jeanne F Spellman yes This is a great start that will allow us to include guidance into WCAG3 that could not be included in the WCAG 2.x structure.
Bruce Bailey yes
Rachael Bradley Montgomery yes

More details on responses

  • Jennifer Strickland: last responded on 29, July 2022 at 14:33 (UTC)
  • Gundula Niemann: last responded on 1, August 2022 at 12:32 (UTC)
  • Jaunita George: last responded on 1, August 2022 at 13:29 (UTC)
  • Mary Jo Mueller: last responded on 1, August 2022 at 22:00 (UTC)
  • Jeanne F Spellman: last responded on 1, August 2022 at 23:40 (UTC)
  • Bruce Bailey: last responded on 2, August 2022 at 14:12 (UTC)
  • Rachael Bradley Montgomery: last responded on 2, August 2022 at 14:33 (UTC)

Non-responders

The following persons have not answered the questionnaire:

  1. Gregg Vanderheiden
  2. Chris Wilson
  3. Lisa Seeman-Horwitz
  4. Janina Sajka
  5. Shawn Lawton Henry
  6. Katie Haritos-Shea
  7. Shadi Abou-Zahra
  8. Chus Garcia
  9. Steve Faulkner
  10. Patrick Lauke
  11. David MacDonald
  12. Gez Lemon
  13. Makoto Ueki
  14. Peter Korn
  15. Preety Kumar
  16. Georgios Grigoriadis
  17. Stefan Schnabel
  18. Romain Deltour
  19. Laura Carlson
  20. Chris Blouch
  21. Jedi Lin
  22. Wilco Fiers
  23. Kimberly Patch
  24. Glenda Sims
  25. Ian Pouncey
  26. Alastair Campbell
  27. Léonie Watson
  28. David Sloan
  29. John Kirkwood
  30. Detlev Fischer
  31. Reinaldo Ferraz
  32. Matt Garrish
  33. Mike Gifford
  34. Loïc Martínez Normand
  35. Mike Pluke
  36. Justine Pascalides
  37. Chris Loiselle
  38. Tzviya Siegman
  39. Jan McSorley
  40. Sailesh Panchang
  41. Cristina Mussinelli
  42. Jonathan Avila
  43. John Rochford
  44. Sarah Horton
  45. Sujasree Kurapati
  46. Jatin Vaishnav
  47. Sam Ogami
  48. Kevin White
  49. E.A. Draffan
  50. Paul Bohman
  51. JaEun Jemma Ku
  52. 骅 杨
  53. Victoria Clark
  54. Avneesh Singh
  55. Mitchell Evan
  56. Michael Gower
  57. biao liu
  58. Scott McCormack
  59. Denis Boudreau
  60. Francis Storr
  61. Rick Johnson
  62. David Swallow
  63. Aparna Pasi
  64. Gregorio Pellegrino
  65. Melanie Philipp
  66. Jake Abma
  67. Nicole Windmann
  68. Oliver Keim
  69. Ruoxi Ran
  70. Wendy Reid
  71. Scott O'Hara
  72. Charles Adams
  73. Muhammad Saleem
  74. Amani Ali
  75. Trevor Bostic
  76. Jamie Herrera
  77. Shinya Takami
  78. Karen Herr
  79. Kathy Eng
  80. Cybele Sack
  81. Audrey Maniez
  82. Jennifer Delisi
  83. Arthur Soroken
  84. Daniel Bjorge
  85. Kai Recke
  86. David Fazio
  87. Daniel Montalvo
  88. Mario Chacón-Rivas
  89. Michael Gilbert
  90. Caryn Pagel
  91. Achraf Othman
  92. Helen Burge
  93. Fernanda Bonnin
  94. Jared Batterman
  95. Raja Kushalnagar
  96. Jan Williams
  97. Todd Libby
  98. Isabel Holdsworth
  99. Julia Chen
  100. Marcos Franco Murillo
  101. Yutaka Suzuki
  102. Azlan Cuttilan
  103. Joe Humbert
  104. Ben Tillyer
  105. Charu Pandhi
  106. Poornima Badhan Subramanian
  107. Alain Vagner
  108. Roberto Scano
  109. Rain Breaw Michaels
  110. Kun Zhang
  111. Regina Sanchez
  112. Shawn Thompson
  113. Thomas Brunet
  114. Kenny Dunsin
  115. Jen Goulden
  116. Mike Beganyi
  117. Ronny Hendriks
  118. Breixo Pastoriza Barcia
  119. Olivia Hogan-Stark
  120. Rashmi Katakwar
  121. Julie Rawe
  122. Duff Johnson
  123. Laura Miller
  124. Will Creedle
  125. Shikha Nikhil Dwivedi
  126. Marie Csanady
  127. Meenakshi Das
  128. Perrin Anto
  129. Stephanie Louraine
  130. Rachele DiTullio
  131. Jan Jaap de Groot
  132. Rebecca Monteleone
  133. Ian Kersey
  134. Peter Bossley
  135. Anastasia Lanz
  136. Michael Keane
  137. Chiara De Martin
  138. Giacomo Petri
  139. Andrew Barakat
  140. Devanshu Chandra
  141. Xiao (Helen) Zhou
  142. Bryan Trogdon
  143. Mary Ann (MJ) Jawili
  144. 禹佳 陶
  145. 锦澄 王
  146. Stephen James
  147. Jay Mullen
  148. Thorsten Katzmann
  149. Tony Holland
  150. Kent Boucher
  151. Abbey Davis
  152. Phil Day
  153. Julia Kim
  154. Michelle Lana
  155. David Williams
  156. Mikayla Thompson
  157. Catherine Droege
  158. James Edwards
  159. Eric Hind
  160. Quintin Balsdon
  161. Mario Batušić
  162. David Cox
  163. Sazzad Mahamud
  164. Katy Brickley
  165. Kimberly Sarabia
  166. Corey Hinshaw
  167. Ashley Firth
  168. Daniel Harper-Wain
  169. Kiara Stewart
  170. DJ Chase
  171. Suji Sreerama
  172. Lori Oakley
  173. David Middleton
  174. Alyssa Priddy
  175. Young Choi
  176. Nichole Bui
  177. Julie Romanowski
  178. Eloisa Guerrero
  179. Daniel Henderson-Ede
  180. George Kuan
  181. YAPING LIN
  182. Justin Wilson
  183. Tiffany Burtin
  184. Shane Dittmar
  185. Nayan Padrai
  186. Niamh Kelly
  187. Matt Argomaniz Matthew Argomaniz
  188. Frankie Wolf
  189. Kimberly McGee
  190. Ahson Rana
  191. Carolina Crespo
  192. humor927 humor927
  193. Samantha McDaniel
  194. Matthäus Rojek
  195. Phong Tony Le
  196. Bram Janssens
  197. Graham Ritchie
  198. Aleksandar Cindrikj
  199. Jeroen Hulscher
  200. Alina Vayntrub
  201. Marco Sabidussi
  202. John Toles
  203. Jeanne Erickson Cooley
  204. Theo Hale
  205. Gert-Jan Vercauteren
  206. Karla Rubiano
  207. Aashutosh K
  208. Hidde de Vries
  209. Julian Kittelson-Aldred
  210. Roland Buss
  211. Aditya Surendranath
  212. Avon Kuo
  213. Elizabeth Patrick
  214. Nat Tarnoff
  215. Filippo Zorzi
  216. Mike Pedersen
  217. Rachael Yomtoob
  218. Oliver Habersetzer

Send an email to all the non-responders.


Compact view of the results / list of email addresses of the responders

WBS home / Questionnaires / WG questionnaires / Answer this questionnaire