How to evaluate Conformance Proposals

How to evaluate Conformance Proposals

In order to objectively evaluate conformance model proposals, we will use the following tests in order to measure the effectiveness of each proposal against the Silver Requirements.

Requirement 3.1 Multiple ways to measure

1. Check that the conformance model supports at least 3 different types of tests through measuring, reporting, and incorporating results into overall conformance.
2. Check that the conformance model serves more needs of people with disabilities and in more contexts through:
   1. Testing with proposed Success Criteria from Low Vision, Coga, and Mobile Task Forces.
   2. Stakeholder interviews with Low Vision, Coga, and Mobile Task Forces, and other stakeholders from the Silver Stakeholder Map as applicable.

Requirement 3.2 Flexible maintenance and extensibility

1. Pick at least 2 emerging technologies, take success criteria for those through the entire cycle.
   1. Testing maintenance through the full process.
      1. Emerging tech.
      2. Emerging interactions for existing tech.
   2. How many to include? Somewhere between one and all, ideally mid-range there, range of difficulty (don’t just choose the easy things, include A, AA, and AAA), non-interference.
   3. Consider editing & removal of SCs.
2. Creation & Platform: Stakeholder interviews with SMEs in the area of that emerging technology.
3. Users: Stakeholder interviews with SMEs in the area of assistive technologies & disabilities.

Requirement 3.4 Technology Neutral

1. Take 4 existing success criteria and 3+ new guidance proposals from Low Vision, Cognitive, and/or Mobile Task Force through the content development process including Guideline and supporting Methods and tests.
2. Stakeholder interviews with AGWG, Low Vision, Cognitive, and Mobile Task Forces.

Requirement 3.5 Readability/Usability

1. Take the 4 existing success criteria and 3+ new guidance proposals (from Test of 3.4 Technology Neutral), and check against our style guide to see whether we can still meet it.
2. Stakeholder interviews with Cognitive Task Force, plain language experts, translation (non-native English speaker) experts.

Requirement 3.6 Regulatory Environment

1. Stakeholder interviews with at least 5, but not more than 10, Regulatory policy-making stakeholders including at least 5 different regulatory systems.
2. Stakeholder interviews with at least 5, but not more than 10, Regulatory policy-using stakeholders including at least 5 different regulatory systems.

Requirement 3.7 Motivation

1. Stakeholder interviews across a range of organizations.
2. Stakeholder interviews across a range of disability advocacy organizations.

Requirement 3.8 Scope

1. Develop a mix of Silver guidelines and Methods that would include at least 2 methods each for: content creators, browsers, authoring tools, and assistive technologies. Show the methods to AGWG members (content creator experts), accessibility experts from 2-3 major browsers, 2-3 assistive technology vendors (including at least 1 non-English language assistive technology), and 2-3 accessibility experts from authoring tool vendors.