W3C

Results of Questionnaire Approval of Evaluation Videos 1-4 and 5

The results of this questionnaire are available to anybody. In addition, answers are sent to the following email addresses: shawn@w3.org, shadi+EOsurvey@w3.org

This questionnaire was open from 2020-02-06 to 2020-02-13.

10 answers have been received.

Jump to results for question:

  1. About this survey
  2. Review level
  3. Review and approval Videos 1-4
  4. [NEW] Review and approval Video 5

1. About this survey

This is an Approval to Publish (Butterfly Review) for:

  • Video 1: Evaluating Web Accessibility: Resources Overview
  • Video 2: Easy Checks for Web Accessibility
  • Video 3: Tools for Evaluating Web Accessibility
  • Video 4: Web Accessibility Conformance Evaluation
  • [NEW] Video 5: Involving Users in Web Accessibility Evaluation

Note: no more changes can be made to these videos, only fixing bugs related to the implementation of this final version (some bugs already noted below).

Download the final version of Videos 1-4 (large file) and compare to final set of comments (docx format) as needed. (Download for Video 5 is provided separately in question 4 below)

Details

Responder
Sharron Rush
Brent Bakken
Kris Anne Kinney
Lewis Phillips
Shawn Lawton Henry All videos:
[ED-low] I find the sound effects with the icons of “Essential for some, useful for all” a bit sharp.

[ED-low] Background music:
I guess I assumed that we would have the same background music for all videos. I guess it's OK to have different music.
* Video 1 – a bit too attention-getting, especially at the beginning.
* Video 2 – a bit too attention-getting, especially at the beginning.
* Video 3 – OK.
* Video 4 – OK.
* Video 5 – like it. I think this is a different style of music.

I think the first are very guitar-y at the beginning and that’s what pulls my attention to the music. Probably just a personal thing.

(I like how the music concludes at the end of the videos.)
Kevin White
Eric Eggert
Helen Burge
Howard Kramer
Daniel Montalvo All these videos are great, I really like them!

[[Not blocking publication]] -- I would prefer to have the sound effects a bit quieter. At their current volume, I find them a bit distracting, especially when the VoiceOver artist is speaking. If this is not allowed (or too complicated to ask for) at this phase, I would try to concentrate on turning down the volume of the bubble sounds and those of the closing section "Essential for some, useful for all".

2. Review level

summary | by responder | by choice

Summary

ChoiceAll responders
Results
I reviewed the videos thoroughly. 8
I skimmed the videos. 1
I need more time, and will review by the date provided below. 1
I didn't get to it, and will not in the near future.

Skip to view by choice.

View by responder

Details

Responder Review levelComments
Sharron Rush
  • I reviewed the videos thoroughly.
Brent Bakken
  • I reviewed the videos thoroughly.
Kris Anne Kinney
  • I reviewed the videos thoroughly.
I found myself spelling every word to make sure nothing was spelled wrong. So I had to watch them twice and stop spelling!
Lewis Phillips
  • I reviewed the videos thoroughly.
Shawn Lawton Henry
  • I reviewed the videos thoroughly.
Kevin White
  • I reviewed the videos thoroughly.
Eric Eggert
  • I reviewed the videos thoroughly.
Helen Burge
  • I skimmed the videos.
Howard Kramer
  • I need more time, and will review by the date provided below.
2/20/20
Daniel Montalvo
  • I reviewed the videos thoroughly.

View by choice

ChoiceResponders
I reviewed the videos thoroughly.
  • Sharron Rush
  • Brent Bakken
  • Kris Anne Kinney
  • Lewis Phillips
  • Shawn Lawton Henry
  • Kevin White
  • Eric Eggert
  • Daniel Montalvo
I skimmed the videos.
  • Helen Burge
I need more time, and will review by the date provided below.
  • Howard Kramer
I didn't get to it, and will not in the near future.

3. Review and approval Videos 1-4

summary | by responder | by choice

The following bugs have already been identified and will be fixed before publication:

  • Video 1, at 1:17 progress animation bumpy (compare to Video 4 at 1:44)
  • Video 3, at 0:48 bubbles are not symmetrical and look slightly misplaced
  • Video 3, at 0:54 pen is pointing in the wrong direction (opposite to brush)
  • Video 3, at 1:40 sound effect don't match visual timing (last sound extra?)
  • Video 4, at 1:06 "mdash" missing between "WCAG-EM" and "Website"

Summary

ChoiceAll responders
Results
I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos. 7
I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix. 2
I do not support publishing videos 1-4 as they are. In addition to the above listed bugs, also the ones listed below and marked with [!!] must get fixed before publication.
I do not support publishing videos 1-4 because of the comments below marked as [X].
I abstain (not vote) and accept the decisions of the Working Group 1

Skip to view by choice.

View by responder

Details

Responder Review and approval Videos 1-4Comments
Sharron Rush
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Nicely done!
Brent Bakken
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
Videos are great. One little nit-pick. the final *visual* sequence in all videos before the title and website (computer and 5 attribute circles) seems to be inconsistent. (I will not block publication for this issue)
- In video 1, the voice (5th) circle is not as far out as the hand (1st) circle making them seem not symmetrical.
- In video 2, better, but in this version the voice (5th) circle jumps up slightly at the end when it slides in place. Symmetrical alignment is still a bit off.
- In video 3, issue is same as video 1. The 1st and 5th circles are not the same distance from the computer.
- Video 4, this is the best rendered version of this sequence. The circles are more symmetrically aligned and spacing seems right. Apply this to the others.
Kris Anne Kinney
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Lewis Phillips
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Shawn Lawton Henry
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
I support publishing the videos as they are. I am compelled to note the following. All are [ED-low] and I assume not worth addressing.

All videos:
[ED-low] I find the sound effects with the icons of “Essential for some, useful for all” a bit sharp.

Video 1:
[ED-low] 1:47 throughout, a green checkmark makes me think good! and a red X makes me think bad. So when I see red and green boxes here, I assume the red are things that need to be addressed and the green are things that are good. So it’s a bit odd that the green things get included in “prioritize the issues you need to address first”. (I guess I missed this in previous reviews.:(

Video 4:
[ED-low] 1:49 – geesh, this still looks like a piece of paper in a computer, instead of a web form. sign. no biggie, at least it’s in a computer.

Video 3:
[ED-low] 1:22-1:29 the tools are paper instead of online. I guess I missed that before. sigh. Oh well, no biggie.
Kevin White
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Eric Eggert
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
I find them great. I have not noticed any of the bugs above, but I support them fixed :-) I really like the added sound effects. Makes them really lively. Let’s get them out there!!
Helen Burge
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Howard Kramer
  • I abstain (not vote) and accept the decisions of the Working Group
Daniel Montalvo
  • I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.

View by choice

ChoiceResponders
I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
  • Sharron Rush
  • Kris Anne Kinney
  • Lewis Phillips
  • Kevin White
  • Eric Eggert
  • Helen Burge
  • Daniel Montalvo
I support publishing videos 1-4 as they are, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
  • Brent Bakken
  • Shawn Lawton Henry
I do not support publishing videos 1-4 as they are. In addition to the above listed bugs, also the ones listed below and marked with [!!] must get fixed before publication.
I do not support publishing videos 1-4 because of the comments below marked as [X].
I abstain (not vote) and accept the decisions of the Working Group
  • Howard Kramer

4. [NEW] Review and approval Video 5

summary | by responder | by choice

Please review Video 5 (mp4 format). The following bugs have already been identified and will be fixed before publishing:

  • Video 5, at 0:43 light bulb should appear above the mortarboard
  • Video 5, at 0:59 people should getting more from the center outwards

Summary

ChoiceAll responders
Results
I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos. 5
I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix. 4
I do not support publishing video 5 as is. In addition to the above listed bugs, also the ones listed below and marked with [!!] must get fixed before publication.
I do not support publishing video 5 because of the comments below marked as [X].
I abstain (not vote) and accept the decisions of the Working Group 1

Skip to view by choice.

View by responder

Details

Responder [NEW] Review and approval Video 5Comments
Sharron Rush
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Brent Bakken
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
This video is much improved. It is now more unified and the visuals match the audio much closer.
One small comment... Same as comment I provided in question 3 of this survey. Final sequence timing of circle flyouts is not even. Pattern this after how it was done in video #4.
Kris Anne Kinney
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Lewis Phillips
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Shawn Lawton Henry
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
I support publishing the videos as they are. I am compelled to note the following. All are [ED-low] and I assume not worth addressing.

0:55 the outer icons get smaller for no reason. no biggie, it just caught my attention and was slightly distracting

0:27 this version has the computer and the checklist disappearing. I envisioned the people displacing the checklist, and the computer staying. …/me checks the script… “As we hear ‘the user experience’, we pan to the left so that the check list and computer are no longer visible (they disappear to the right), and we see 4 people (each differently colored).” hum, either I missed that, or it changed. :-)
Kevin White
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
[ED-low] 00:35 When the meeples move out to the arrows they turn from blurred to solid black only when all the meeples have moved out. The association might be better if each arrow turned black when the meeple touches the line.
[ED-med] 00:50 My thought on the motivation bar was that each block would change colour as the indicator arrow moved round. Doesn't really make sense that the whole bar slowly fills in at once.
[ED-low] 00:59 People all fad in at once, I thought the idea was to quickly pop them in one by one - or a few by few.
Eric Eggert
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
It would be great if the gauge would be filled by segment as the needle moves to the right, also the needle would benefit from an outline, especially in the last frame where it melts into the large last segment. This is minor nitpicking tho, happy to publish as is.
Helen Burge
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
Howard Kramer
  • I abstain (not vote) and accept the decisions of the Working Group
Daniel Montalvo
  • I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
My little suggestion above may also apply to video 5.

View by choice

ChoiceResponders
I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I have no further comments on these videos.
  • Sharron Rush
  • Kris Anne Kinney
  • Lewis Phillips
  • Helen Burge
  • Daniel Montalvo
I support publishing video 5 as is, provided the above listed bugs get fixed before publication. I identified further bugs. They are listed below and marked with [ED], leaving it editor's discretion to fix.
  • Brent Bakken
  • Shawn Lawton Henry
  • Kevin White
  • Eric Eggert
I do not support publishing video 5 as is. In addition to the above listed bugs, also the ones listed below and marked with [!!] must get fixed before publication.
I do not support publishing video 5 because of the comments below marked as [X].
I abstain (not vote) and accept the decisions of the Working Group
  • Howard Kramer

More details on responses

  • Sharron Rush: last responded on 12, February 2020 at 17:24 (UTC)
  • Brent Bakken: last responded on 12, February 2020 at 18:11 (UTC)
  • Kris Anne Kinney: last responded on 12, February 2020 at 18:15 (UTC)
  • Lewis Phillips: last responded on 12, February 2020 at 18:34 (UTC)
  • Shawn Lawton Henry: last responded on 12, February 2020 at 22:19 (UTC)
  • Kevin White: last responded on 13, February 2020 at 09:59 (UTC)
  • Eric Eggert: last responded on 13, February 2020 at 11:53 (UTC)
  • Helen Burge: last responded on 13, February 2020 at 22:21 (UTC)
  • Howard Kramer: last responded on 14, February 2020 at 05:00 (UTC)
  • Daniel Montalvo: last responded on 14, February 2020 at 11:29 (UTC)

Non-responders

The following persons have not answered the questionnaire:

  1. Eric Velleman
  2. Andrew Arch
  3. Shadi Abou-Zahra
  4. Sylvie Duchateau
  5. Kazuhito Kidachi
  6. Jedi Lin
  7. David Sloan
  8. Mary Jo Mueller
  9. Vicki Menezes Miller
  10. Reinaldo Ferraz
  11. Bill Kasdorf
  12. Cristina Mussinelli
  13. Kevin White
  14. Kevin Rydberg
  15. Adina Halter
  16. Denis Boudreau
  17. Laura Keen
  18. Sarah Pulis
  19. Bill Tyler
  20. Gregorio Pellegrino
  21. Ruoxi Ran
  22. Jennifer Chadwick
  23. Sean Kelly
  24. Muhammad Saleem
  25. Sarah Lewthwaite
  26. Mark Palmer
  27. Jade Matos Carew
  28. Sonsoles López Pernas
  29. Greta Krafsig
  30. Jason McKee
  31. Jayne Schurick
  32. Billie Johnston
  33. Michele Williams
  34. Shikha Nikhil Dwivedi
  35. Brian Elton
  36. Julianna Rowsell
  37. Tabitha Mahoney
  38. Fred Edora
  39. Rabab Gomaa
  40. Marcelo Paiva
  41. Eloisa Guerrero
  42. Leonard Beasley
  43. Frankie Wolf
  44. Supriya Makude
  45. Aleksandar Cindrikj
  46. Angela Young

Send an email to all the non-responders.


Compact view of the results / list of email addresses of the responders

WBS home / Questionnaires / WG questionnaires / Answer this questionnaire