W3C

Results of Questionnaire Approval of Evaluation Videos 1-4 and 5

The results of this questionnaire are available to anybody. In addition, answers are sent to the following email addresses: shawn@w3.org, shadi+EOsurvey@w3.org

This questionnaire was open from 2020-02-06 to 2020-02-13.

10 answers have been received.

Jump to results for question:

  1. About this survey
  2. Review level
  3. Review and approval Videos 1-4
  4. [NEW] Review and approval Video 5

1. About this survey

This is an Approval to Publish (Butterfly Review) for:

  • Video 1: Evaluating Web Accessibility: Resources Overview
  • Video 2: Easy Checks for Web Accessibility
  • Video 3: Tools for Evaluating Web Accessibility
  • Video 4: Web Accessibility Conformance Evaluation
  • [NEW] Video 5: Involving Users in Web Accessibility Evaluation

Note: no more changes can be made to these videos, only fixing bugs related to the implementation of this final version (some bugs already noted below).

Download the final version of Videos 1-4 (large file) and compare to final set of comments (docx format) as needed. (Download for Video 5 is provided separately in question 4 below)

Details

Responder
Sharron Rush
Brent Bakken
Kris Anne Kinney
Lewis Phillips
Shawn Henry All videos:
[ED-low] I find the sound effects with the icons of “Essential for some, useful for all” a bit sharp.

[ED-low] Background music:
I guess I assumed that we would have the same background music for all videos. I guess it's OK to have different music.
* Video 1 – a bit too attention-getting, especially at the beginning.
* Video 2 – a bit too attention-getting, especially at the beginning.
* Video 3 – OK.
* Video 4 – OK.
* Video 5 – like it. I think this is a different style of music.

I think the first are very guitar-y at the beginning and that’s what pulls my attention to the music. Probably just a personal thing.

(I like how the music concludes at the end of the videos.)
Kevin White
Eric Eggert
Helen Burge
Howard Kramer
Daniel Montalvo All these videos are great, I really like them!

[[Not blocking publication]] -- I would prefer to have the sound effects a bit quieter. At their current volume, I find them a bit distracting, especially when the VoiceOver artist is speaking. If this is not allowed (or too complicated to ask for) at this phase, I would try to concentrate on turning down the volume of the bubble sounds and those of the closing section "Essential for some, useful for all".

2. Review level

summary | by responder | by choice

Summary

ChoiceAll responders
Results
I reviewed the videos thoroughly. 8
I skimmed the videos. 1
I need more time, and will review by the date provided below. 1
I didn't get to it, and will not in the near future.

Skip to view by choice.

View by responder

Details

Responder Review levelComments
Sharron Rush
  • I reviewed the videos thoroughly.
Brent Bakken
  • I reviewed the videos thoroughly.
Kris Anne Kinney
  • I reviewed the videos thoroughly.
I found myself spelling every word to make sure nothing was spelled wrong. So I had to watch them twice and stop spelling!
Lewis Phillips
  • I reviewed the videos thoroughly.
Shawn Henry
  • I reviewed the videos thoroughly.
Kevin White
  • I reviewed the videos thoroughly.
Eric Eggert
  • I reviewed the videos thoroughly.
Helen Burge
  • I skimmed the videos.
Howard Kramer
  • I need more time, and will review by the date provided below.
2/20/20
Daniel Montalvo
  • I reviewed the videos thoroughly.

View by choice

ChoiceResponders
I reviewed the videos thoroughly.
  • Sharron Rush
  • Brent Bakken
  • Kris Anne Kinney
  • Lewis Phillips
  • Shawn Henry
  • Kevin White
  • Eric Eggert
  • Daniel Montalvo
I skimmed the videos.
  • Helen Burge
I need more time, and will review by the date provided below.
  • Howard Kramer
I didn't get to it, and will not in the near future.

3. Review and approval Videos 1-4

summary | by responder | by choice

The following bugs have already been identified and will be fixed before publication:

  • Video 1, at 1:17 progress animation bumpy (compare to Video 4 at 1:44)
  • Video 3, at 0:48 bubbles are not symmetrical and look slightly misplaced
  • Video 3, at 0:54 pen is pointing in the wrong direction (opposite to brush)
  • Video 3, at 1:40 sound effect don't match visual timing (last sound extra?)
  • Video 4, at 1:06 "mdash" missing between "WCAG-EM" and "Website"

Summary

ChoiceAll responders
Results
I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos. 7
I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix. 2
I do not support publishing videos 1-4 as they are. In addition to the above listed bugs, also the ones listed below and marked with [!!] must get fixed before publication.
I do not support publishing videos 1-4 because of the comments below marked as [X].
I abstain (not vote) and accept the decisions of the Working Group 1

Skip to view by choice.

View by responder

Details

Responder Review and approval Videos 1-4Comments
Sharron Rush
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Nicely done!
Brent Bakken
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
Videos are great. One little nit-pick. the final *visual* sequence in all videos before the title and website (computer and 5 attribute circles) seems to be inconsistent. (I will not block publication for this issue)
- In video 1, the voice (5th) circle is not as far out as the hand (1st) circle making them seem not symmetrical.
- In video 2, better, but in this version the voice (5th) circle jumps up slightly at the end when it slides in place. Symmetrical alignment is still a bit off.
- In video 3, issue is same as video 1. The 1st and 5th circles are not the same distance from the computer.
- Video 4, this is the best rendered version of this sequence. The circles are more symmetrically aligned and spacing seems right. Apply this to the others.
Kris Anne Kinney
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Lewis Phillips
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Shawn Henry
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
I support publishing the videos as they are. I am compelled to note the following. All are [ED-low] and I assume not worth addressing.

All videos:
[ED-low] I find the sound effects with the icons of “Essential for some, useful for all” a bit sharp.

Video 1:
[ED-low] 1:47 throughout, a green checkmark makes me think good! and a red X makes me think bad. So when I see red and green boxes here, I assume the red are things that need to be addressed and the green are things that are good. So it’s a bit odd that the green things get included in “prioritize the issues you need to address first”. (I guess I missed this in previous reviews.:(

Video 4:
[ED-low] 1:49 – geesh, this still looks like a piece of paper in a computer, instead of a web form. sign. no biggie, at least it’s in a computer.

Video 3:
[ED-low] 1:22-1:29 the tools are paper instead of online. I guess I missed that before. sigh. Oh well, no biggie.
Kevin White
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Eric Eggert
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
I find them great. I have not noticed any of the bugs above, but I support them fixed :-) I really like the added sound effects. Makes them really lively. Let’s get them out there!!
Helen Burge
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Howard Kramer
  • I abstain (not vote) and accept the decisions of the Working Group
Daniel Montalvo
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.

View by choice

ChoiceResponders
I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
  • Sharron Rush
  • Kris Anne Kinney
  • Lewis Phillips
  • Kevin White
  • Eric Eggert
  • Helen Burge
  • Daniel Montalvo
I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
  • Brent Bakken
  • Shawn Henry
I do not support publishing videos 1-4 as they are. In addition to the above listed bugs, also the ones listed below and marked with [!!] must get fixed before publication.
I do not support publishing videos 1-4 because of the comments below marked as [X].
I abstain (not vote) and accept the decisions of the Working Group
  • Howard Kramer

4. [NEW] Review and approval Video 5

summary | by responder | by choice

Please review Video 5 (mp4 format). The following bugs have already been identified and will be fixed before publishing:

  • Video 5, at 0:43 light bulb should appear above the mortarboard
  • Video 5, at 0:59 people should getting more from the center outwards

Summary

ChoiceAll responders
Results
I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos. 5
I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix. 4
I do not support publishing video 5 as is. In addition to the above listed bugs, also the ones listed below and marked with [!!] must get fixed before publication.
I do not support publishing video 5 because of the comments below marked as [X].
I abstain (not vote) and accept the decisions of the Working Group 1

Skip to view by choice.

View by responder

Details

Responder [NEW] Review and approval Video 5Comments
Sharron Rush
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Brent Bakken
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
This video is much improved. It is now more unified and the visuals match the audio much closer.
One small comment... Same as comment I provided in question 3 of this survey. Final sequence timing of circle flyouts is not even. Pattern this after how it was done in video #4.
Kris Anne Kinney
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Lewis Phillips
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Shawn Henry
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
I support publishing the videos as they are. I am compelled to note the following. All are [ED-low] and I assume not worth addressing.

0:55 the outer icons get smaller for no reason. no biggie, it just caught my attention and was slightly distracting

0:27 this version has the computer and the checklist disappearing. I envisioned the people displacing the checklist, and the computer staying. …/me checks the script… “As we hear ‘the user experience’, we pan to the left so that the check list and computer are no longer visible (they disappear to the right), and we see 4 people (each differently colored).” hum, either I missed that, or it changed. :-)
Kevin White
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
[ED-low] 00:35 When the meeples move out to the arrows they turn from blurred to solid black only when all the meeples have moved out. The association might be better if each arrow turned black when the meeple touches the line.
[ED-med] 00:50 My thought on the motivation bar was that each block would change colour as the indicator arrow moved round. Doesn't really make sense that the whole bar slowly fills in at once.
[ED-low] 00:59 People all fad in at once, I thought the idea was to quickly pop them in one by one - or a few by few.
Eric Eggert
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
It would be great if the gauge would be filled by segment as the needle moves to the right, also the needle would benefit from an outline, especially in the last frame where it melts into the large last segment. This is minor nitpicking tho, happy to publish as is.
Helen Burge
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Howard Kramer
  • I abstain (not vote) and accept the decisions of the Working Group
Daniel Montalvo
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
My little suggestion above may also apply to video 5.

View by choice

ChoiceResponders
I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
  • Sharron Rush
  • Kris Anne Kinney
  • Lewis Phillips
  • Helen Burge
  • Daniel Montalvo
I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
  • Brent Bakken
  • Shawn Henry
  • Kevin White
  • Eric Eggert
I do not support publishing video 5 as is. In addition to the above listed bugs, also the ones listed below and marked with [!!] must get fixed before publication.
I do not support publishing video 5 because of the comments below marked as [X].
I abstain (not vote) and accept the decisions of the Working Group
  • Howard Kramer

More details on responses

  • Sharron Rush: last responded on 12, February 2020 at 17:24 (UTC)
  • Brent Bakken: last responded on 12, February 2020 at 18:11 (UTC)
  • Kris Anne Kinney: last responded on 12, February 2020 at 18:15 (UTC)
  • Lewis Phillips: last responded on 12, February 2020 at 18:34 (UTC)
  • Shawn Henry: last responded on 12, February 2020 at 22:19 (UTC)
  • Kevin White: last responded on 13, February 2020 at 09:59 (UTC)
  • Eric Eggert: last responded on 13, February 2020 at 11:53 (UTC)
  • Helen Burge: last responded on 13, February 2020 at 22:21 (UTC)
  • Howard Kramer: last responded on 14, February 2020 at 05:00 (UTC)
  • Daniel Montalvo: last responded on 14, February 2020 at 11:29 (UTC)

Non-responders

The following persons have not answered the questionnaire:

  1. Judy Brewer
  2. Eric Velleman
  3. Andrew Arch
  4. Shadi Abou-Zahra
  5. Sylvie Duchateau
  6. Kazuhito Kidachi
  7. Dónal Fitzpatrick
  8. David Sloan
  9. Mary Jo Mueller
  10. Vicki Menezes Miller
  11. Reinaldo Ferraz
  12. Vivienne Conway
  13. Bill Kasdorf
  14. Jan McSorley
  15. Cristina Mussinelli
  16. Steve Lee
  17. Kevin Rydberg
  18. Adina Halter
  19. Denis Boudreau
  20. Laura Keen
  21. Sarah Pulis
  22. Bill Tyler
  23. Gregorio Pellegrino
  24. Amanda Mace
  25. Ian Smith
  26. Ruoxi Ran
  27. Jennifer Chadwick
  28. Carlos Duarte
  29. Sean Kelly
  30. Muhammad Saleem
  31. Sarah Lewthwaite
  32. Ash Harris
  33. Kim Hodges
  34. Estella Oncins
  35. Isaac Durazo
  36. Hidde de Vries
  37. Mark Palmer
  38. Omar Bonilla
  39. Jade Matos Carew
  40. Sonsoles López Pernas
  41. Greta Krafsig
  42. Dónal Rice
  43. Gerhard Nussbaum
  44. Jason McKee
  45. Valentina Kirinić
  46. Roberto Perez
  47. Letícia Seixas Pereira
  48. Karl Groves
  49. Jayne Schurick
  50. Donna Bungard
  51. Vijaya Gowri Perumal
  52. Billie Johnston
  53. Emily Lewis
  54. Michele Williams
  55. Mark McCallum

Send an email to all the non-responders.


Compact view of the results / list of email addresses of the responders

WBS home / Questionnaires / WG questionnaires / Answer this questionnaire