Comparing the Options

From WCAG WG

This page presents the 4 options in a chart form for easier comparison.

The Four Options

  1. Design Driven - most UX research, leads to most usable and effective Silver over time
  2. Faster Progress - most effective in making progress, reaches REC the fastest
  3. Flexibility - results in Silver that is responsive to changing technology and is easy to change and update
  4. Low Cost - cost the least in terms of money (closest option to the status quo)

Comparison Table

Comparison of Silver Options
Method Design Driven Faster Progress Most Flexible Low Cost
Phase 1 - Discovery
Stakeholder Map
  • Exhaustive: includes all roles with vested interest
  • Descriptive: shows roles and relationships
  • Iterative: evolves over process
Also reach Stakeholders beyond W3C circles Emphasis on outreach to developers and more diverse sources Outreach to the usual WAI stakeholders plus other names and contacts from the WCAG WG.
Survey
  • Targeted: customized for different roles
  • Credible: valid from a research perspective
Professional. Multiple surveys for different groups Professional. Multiple surveys for different groups Silver subgroup creates a survey that is promoted through the usual W3C channels
Stakeholder Interviews
  • Comprehensive: engages many perspectives
  • Structured: designed to answer key questions
  • Personal: phone and in-person interviews
  • Phone interviews
  • Develop relationship used throughout the process
  • more focused
  • Phone interviews
  • Develop relationship used throughout the process
  • more open-ended, casting a wider net
Phone interviews with key stakeholders by the Silver Sub-group
Contextual Inquiry
  • Comprehensive: addresses multiple roles
  • Structured: designed to answer key questions
  • Unstructured: also open-ended, for unexpected insights
  • Personal: in-person observation
N/A N/A N/A
Self Reporting
  • Comprehensive: addresses multiple roles
  • Structured: designed to answer key questions
  • a few stakeholders asked to keep a diary
  • Open ended
  • Used to gather insights
  • Lighter-weight, less emphasis.
  • a few stakeholders asked to keep a diary
  • Open ended
  • Used to gather insights
N/A
Secondary Research - Organizations
  • Exploratory: looks into broad range of similar efforts, including those external to W3C and unrelated to digital accessibility
  • Summative: comprehensive analysis and articulation
Outreach to other W3C WG and standards organizations with track record of faster progress Outreach to other W3C WG and standards organizations with track record of greater flexibility Informal conversations where relationships exist
WCAG Analysis
  • Investigative: includes full breadth of WCAG components
  • Summative: comprehensive analysis and articulation
N/A Systemic examination of components and process of WCAG today. Discussion on the WCAG WG email list
Analysis of WCAG Adaptations
  • Investigative: includes broad range of WCAG adaptations
  • Summative: comprehensive analysis and articulation
Study what other groups have done for insight Study what other groups have done for insight Make a list of insights from popular WCAG adaptations
Literature Review
  • Investigative: includes broad range of WCAG research
  • Summative: comprehensive analysis and articulation
N/A
  • Investigative: includes broad range of WCAG research
  • Summative: comprehensive analysis and articulation
N/A
Communication
  • Thorough: In-depth report of Discovery phase, including summary
  • List of topics for W3C Workshop Paper Submissions
  • Summary report of Discovery phase
Summary report of Discovery phase Summary list of insights for next phase
Phase 2 - Interpretation
Case Studies
  • Comprehensive: addresses multiple roles and multiple uses
  • Detailed: illustrates roles and usage
N/A High-coverage of varied perspectives N/A
Personas
  • Comprehensive: addresses multiple roles and multiple uses
  • Detailed: illustrates roles and usage
Brief, focused on aspects relevant to Silver High-coverage of varied perspectives Minimal persona feeding user stories
User Stories
  • Comprehensive: addresses multiple roles and multiple uses
  • Detailed: illustrates roles and usage
More extensive than Personas, used to evaluate in Experimentation and Production phases High-coverage of varied perspectives minimal used to validate Silver decision-making
Analysis / inventory / grouping
  • Informed: done by those who participate closely in discovery phase activities
  • Participatory: done in person
Part of 1 day F2F meeting of Sub-group Sub-group meeting activity Multiple 1/2 day teleconferences or small F2F (most of the meeting would be on user stories, brainstorming ideas and discussing prototypes. No inventory or grouping)
Report
  • Defining: provides common themes to be addressed
  • Comprehensive: includes case studies, personas, and user stories
  • Product of F2F meeting of Sub-group
  • Report becomes a paper for W3C Workshop
Product of F2F meeting of Sub-group Product of teleconferences
Phase 3 - Ideation
F2F Workshop
  • Participatory: run using Design Studio methodology
  • Comprehensive: engages many perspectives
  • W3C Workshop (F2F)
  • Participants apply by writing a paper on a topic from Sub-group
  • Travel budget available
  • 2 days - D1 Ideation, D2 Experimentation
N/A Sub-group F2F or multiple 1/2 day teleconferences
Online Workshop
  • Comprehensive: engages many perspectives
N/A Yes N/A
Hybrid F2F online
  • Comprehensive: engages many perspectives
N/A Yes N/A
Surveys / questionnaires
  • Comprehensive: engages many perspectives
N/A Highly structured set of surveys and questionnaires Public survey created by Silver Sub-group
Choosing
  • Informed: done by those who participate closely in Silver process
Strawman, non-binding vote at Workshop and consensus of Sub-Group Optional of working group to confirm sub-group's choice Consensus of Silver sub-group
Phase 4 - Experimentation
Create Prototypes
  • Informed: done by those who participate closely in Silver process
  • D2 of W3C Workshop
  • Small groups build prototypes, discuss and refine
  • Workshop report includes pros and cons of each prototype
The Sub-group will create prototypes covering:
  • Content in and scope of Silver
  • Structure of Silver
  • Maintenance of Silver over time
Individual build models based on teleconference discussion
A/B/C Testing
  • Clarifying: helps identify strengths of multiple viable options
N/A As warranted by differing prototypes N/A
User Journeys
  • Informed: done by those who participate closely in Silver process
Part of Workshop, or completed by Sub-group Completed by the Sub-group Completed by the Sub-group
Focus Groups
  • Clarifying: helps identify strengths of multiple viable options
N/A N/A N/A
Desirability Testing
  • Public online survey - broad participation
Public online survey - broad participation Public online survey - broad participation Public online survey - notification on the W3C email lists and twitter
Refine Prototypes
  • Refining: incorporates insights to improve outcome
if needed desperately Based on user testing Minimal
Choosing
  • Informed: done by those who participate closely in Silver process
Recommendation is part of the Workshop Report Recommendation of Subgroup Consensus of Subgroup
Phase 5 - Production & Evolution
Establish Resources
  • Budget for face-to-face meetings
  • Research expertise for surveys and analysis
  • Scheduling a multi-day Task Force F2F meeting specifically for drafting the FPWD.
Established via prototyping. request participation on W3C email lists
Establish Partnerships
  • Research expertise for surveys and analysis
  • Asking W3C members to contribute an employee's fulltime effort as a W3C fellow dedicated to Silver
  • Donate money for hiring a full-time project manager for Silver and travel budgets for F2F meetings
Established via prototyping. N/A
Identifying Key People
  • Support and expertise for facilitation of process activities
  • Ongoing support for Silver
  • Hiring a full-time editor, similar to what was done for HTML5
Established via prototyping. Identify editors
Forming a Task Force
  • Forming a subgroup to work on Silver that includes subject matter expertise on design methods and user research
  • Forming an official Silver Task Force (if that has not already been done)
  • Task Force Facilitator(s)
  • Re-charter as needed
  • Forming an official Silver Task Force (if that has not already been done)
  • Task Force Facilitator(s)
  • Re-charter as needed
Task force with facilitators and editors
Setting Milestones
  • Dates for reporting
  • Dates for choosing
  • More granular, public milestones
  • decision policy that protects minorities, but discourages extensive debate
  • More granular, public milestones
  • Ongoing incremental milestones
Charter milestones
Crowdsourcing
  • N/A
N/A Heavily and continuously used N/A
F2F Writing Meetings
  • Meetings for Silver subgroup to work on Silver
Yes. Maximize dedicated time and F2F discussion for speed and quality of work Yes. Maximize dedicated time and F2F discussion for management of work weekly teleconferences and bi monthly 1/2 day teleconferences
Spec Creation Distributed to individual writers
  • Silver subgroup members take responsibility for sections
As little as possible As little as possible The normal way work gets done.