W3C

(Draft) ATAG 2.0 Testing Resources

19 November 2012

This page provides an overview of the ATAG 2.0 test suite and the resources that testers can use to help with the testing process.

Applicability Notes:

For PART A: Make the authoring tool user interface accessible:

  1. Scope of "authoring tool user interface": The Part A success criteria apply to all aspects of the authoring tool user interface that are concerned with producing the "included" web content technologies. This includes views of the web content being edited and features that are independent of the content being edited (e.g., menus, button bars, status bars, user preferences, documentation).
  2. Reflected content accessibility problems: The authoring tool is responsible for ensuring that editing-views display the web content being edited in a way that is more accessible to authors with disabilities (e.g., ensuring that text alternatives in the content can be programmatically determined). However, where an authoring tool user interface accessibility problem is caused directly by the content being edited (e.g., if an image in the content lacks a text alternative), then this would not be considered a deficiency in the accessibility of the authoring tool user interface.
  3. Developer control: The Part A success criteria only apply to the authoring tool user interface as it is provided by the developer. They do not apply to any subsequent modifications by parties other than the authoring tool developer (e.g., user modifications of default settings, third-party plug-ins).
  4. User agent features: Web-based authoring tools may rely on user agent features (e.g., keyboard navigation, find functions, display preferences, undo features) to satisfy success criteria. Conformance claims are optional, but any claim that is made must record the user agent(s).
  5. Accessibility of features provided to meet Part A: The Part A success criteria apply to the entire authoring tool user interface, including any features added to meet the success criteria in Part A (e.g., documentation, search functions). The only exemption is for preview features, as long as they meet the relevant success criteria in Guideline A.3.7. Previews are treated differently than editing-views because all authors, including those with disabilities, benefit when preview features accurately reflect the functionality of user agents that are actually in use by end users.
  6. Unrecognizable content: When success criteria require authoring tools to treat web content according to semantic criteria, the success criteria do not apply when these semantics are missing (e.g., text that describes an image is only considered to be a text alternative when this role is encoded within markup).

For PART B: Support the production of accessible content:

  1. Author availability: Any Part B success criteria that refer to authors only apply during authoring sessions.
  2. Developer control: The Part B success criteria only apply to the authoring tool as it is provided by the developer. This does not include subsequent modifications by parties other than the authoring tool developer (e.g., third-party plug-ins, user-defined templates, user modifications of default settings).
  3. Applicability after the end of an authoring session: Authoring tools are responsible for the web content accessibility (WCAG) of web content that they automatically generate after the end of an author's authoring session (see Success Criterion B.1.1.1). For example, if the developer changes the site-wide templates of a content management system, these would be required to meet the accessibility requirements for automatically-generated content. Authoring tools are not responsible for changes to the accessibility of content that the author causes, whether it is author-generated or automatically-generated by another system that the author has specified (e.g., a third-party feed).
  4. Authoring systems: As per the ATAG 2.0 definition of authoring tool, several software tools (identified in any conformance claim) can be used in conjunction to meet the requirements of Part B (e.g., an authoring tool could make use of a third-party software accessibility checking tool).
  5. Accessibility of features provided to meet Part B: The Part A success criteria apply to the entire authoring tool user interface, including any features that must be present to meet the success criteria in Part B (e.g., checking tools, repair tools, tutorials, documentation).
  6. Multiple authoring roles: Some authoring tools include multiple author roles, each with different views and content editing permissions (e.g., a content management system may separate the roles of designers, content authors, and quality assurers). In these cases, the Part B success criteria apply to the authoring tool as a whole, not to the view provided to any particular authoring role. Accessible content support features should be made available to any authoring role where it would be useful.
  7. Unrecognizable content: When success criteria require authoring tools to treat web content according to semantic criteria, the success criteria do not apply when these semantics are missing (e.g., text that describes an image is only considered to be a text alternative when this role is encoded within markup).

Guidelines and Success Criteria

Tools for Testing:

Web Content Accessibility Test Procedure: Procedure that is to be used whenever it is necessary to determine the accessibility of web content (e.g. in the authoring tool's own user interface or in the content produced by the tool).

Platform Accessibility Service Test Procedure: Procedure that is to be used whenever it is necessary to determine whether information has been properly communicated to an Platform Accessibility Service (e.g. MSAA, IAccessible2 and UI Automation for Windows applications, AXAPI for Mac OS X applications, GNOME Accessibility Toolkit API for GNOME applications, Java Access for Java applications. @@For some platforms, semi-automated testing solutions may exist.

User Agent Accessibility Test Procedure (Level A): Procedure that is to be used if it is necessary to determine whether a preview meets UAAG (Note: This tool is not required if previews can be performed in an in-market user agent instead). For UAAG 1.0, the most complete test is the UAAG 1.0 Test Suite for HTML 4.01.

Comprehensive accessible test content (Level A, AA, AAA): Used to test transformation, test checkers for false positives, etc. @@The method for loading this content will depend on the nature of the authoring tool (e.g. opening a test file, pasting in content, authoring the content manually)

Comprehensive non-accessible test content (Level A, AA, AAA): Used to test checkers.@@The method for loading this content will depend on the nature of the authoring tool (e.g. opening a test file, pasting in content, authoring the content manually)

Selection of separate pieces of content: To be used as needed to test various SCs.@@The method for loading this content will depend on the nature of the authoring tool (e.g. opening a test file, pasting in content, authoring the content manually)

List of Accessible Content Support Features: While testing the authoring tool against all of the following relevant success criteria, compile a list of the authoring tool features that are relevant to each test (they do not necessarily have to pass) as well as whether the feature can be turned off, either directly from where it appears in the user interface (e.g., via a "Do not show this again" dialog) or from the authoring tool settings.

Relevant Success Criteria:

 

PART A: Make the authoring tool user interface accessible Tests
PRINCIPLE A.1: Authoring tool user interfaces must follow applicable accessibility guidelines Tests
Guideline A.1.1: (For the authoring tool user interface) Ensure that web-based functionality is accessible. Tests

A.1.1.1 Web-Based Accessible (WCAG):

If the authoring tool contains web-based user interfaces, then those web-based user interfaces meet the WCAG 2.0 success criteria. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: Any web-based portions of an authoring tool user interface meet WCAG 2.0 at A level.[@@JR updated]

  1. If no parts of the authoring tool are web-based (i.e. they are rendered within a user agent), then select SKIP.
  2. If the web-based parts include editing views (as opposed to only documentation, etc.), then load the comprehensive accessible test content (Level A).
  3. Check the web-based parts of the authoring tool with the Web Content Accessibility Test Procedure (Level A).
  4. If WCAG 2.0 Level A is reached, select PASS, otherwise select FAIL.

Test 0002 Assertion: Any web-based portions of an authoring tool user interface meet WCAG 2.0 at AA level. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

  1. If no parts of the authoring tool are web-based (i.e. they are rendered within a user agent), then select SKIP.
  2. If the web-based parts include editing views (as opposed to only documentation, etc.), then load the comprehensive accessible test content (Level AA).
  3. Check the web-based parts of the authoring tool with the Web Content Accessibility Test Procedure (Level AA).
  4. If WCAG 2.0 Level AA is reached, select PASS, otherwise select FAIL.

Test 0003 Assertion: Any web-based portions of an authoring tool user interface meet WCAG 2.0 at AAA level. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

  1. If no parts of the authoring tool are web-based (i.e. they are rendered within a user agent), then select SKIP.
  2. If the web-based parts include editing views (as opposed to only documentation, etc.), then load the comprehensive accessible test content (Level AAA).
  3. Check the web-based parts of the authoring tool with the Web Content Accessibility Test Procedure (Level AAA).
  4. If WCAG 2.0 Level AAA is reached, select PASS, otherwise select FAIL.
Guideline A.1.2: (For the authoring tool user interface) Ensure that non-web-based functionality is accessible. Tests

A.1.2.1 Accessibility Guidelines:

If the authoring tool contains non-web-based user interfaces, then those non-web-based user interfaces follow user interface accessibility guidelines for the platform. (Level A)

Test 0001 Assertion: Any non-web-based portions of the authoring tool user interface follow the accessibility guidelines for the platform. [@@JR updated]

  1. If the authoring tool is entirely web-based (i.e. lacking any functionality that runs outside of a user agent), then select SKIP.
  2. If the non-web-based parts include editing views (as opposed to only a file uploader, etc.), then load the comprehensive accessible test content (any level).
  3. If the accessibility guideline (for the platform) used by the developer is known, this should be used to test the accessibility of the user interface. If the user interface has followed the guidelines, then select PASS, otherwise select FAIL.
  4. If the accessibility guideline (for the platform) used by the developer is not known, choose the most relevant from this list of user interface accessibility guidelines for various platforms and use it to test the accessibility of the user interface. If you find instances where the user interface has not followed the guidelines, then select FAIL, otherwise select PASS.

A.1.2.2 Platform Accessibility Services:

If the authoring tool contains non-web-based user interfaces, then those non-web-based user interfaces expose accessibility information through platform accessibility services. (Level A)

Test 0001 Assertion: Any non-web-based components of the authoring tool user interface successfully communicate name and role with the platform accessibility services (accessibility APIs). [@@JR updated]

  1. Examine the authoring tool user interface to determine whether any parts of it are not web-based (i.e. they run outside of a user agent).
  2. If the authoring tool is entirely web-based, then select SKIP.
  3. For each non-web-based operable user interface component in the authoring tool user interface:
    1. Check the component with the Platform Accessibility Service Test Procedure to determine if it is (a) present, (b) has an accessible name and (c) has an appropriate UI component role.
    2. If any of (a)-(c) are not the case for any user interface components, then select FAIL. @Some judgement may need to be exercised if issues appear to be isolated programming bugs vs. a systematic lack accessibility API support.
  4. Select PASS (all of the non-web-based components must have passed)
PRINCIPLE A.2: Editing-views must be perceivable Tests
Guideline A.2.1: (For the authoring tool user interface) Make alternative content available to authors. Tests

A.2.1.1 Text Alternatives for Rendered Non-Text Content:

If an editing-view renders non-text content, then any programmatically associated text alternatives for the non-text content can be programmatically determined. (Level A)

Test 0001 Assertion: In any web-based editing views, rendered non-text content include any text alternatives to meet WCAG 2.0 1.1.1. [@@JR updated]

  1. If the authoring tool does not include editing views that are capable of rendering non-text content (e.g. images), then select SKIP.
  2. If the authoring tool's editing views that render non-text content are only non-web-based, then select SKIP.
  3. For each web-based editing view that renders non-text content:
    1. Load the comprehensive accessible test content (any level), which contains non-text content with text alternatives, in the editing view.
    2. Using the Web Content Accessibility Test Procedure, check if WCAG2 SC 1.1.1 is passed by the editing view. If not, select FAIL.
  4. Select PASS (all editing views must have passed)

Test 0002 Assertion: In any non-web-based editing views, rendered non-text content with text alternatives can have those text alternatives programmatically determined. [@@JR updated]

  1. If the authoring tool does not include editing views that are capable of rendering non-text content (e.g. images), then select SKIP.
  2. If the authoring tool's editing views that render non-text content are only web-based, then select SKIP.
  3. For each non-web-based editing view that renders non-text content:
    1. Load the comprehensive accessible test content (any level), which contains non-text content with text alternatives, in the editing view.
    2. Check with Platform Accessibility Service Test Procedure to determine if an accessible name/label is present in the accessibility API for each instance of non-test content. If not, select FAIL.
  4. Select PASS (all editing views must have passed)

A.2.1.2 Alternatives for Rendered Time-Based Media:

If an editing-view renders time-based media, then at least one of the following is true: (Level A)

  • (a) Option to Render: The authoring tool provides the option to render alternatives for the time-based media; or
  • (b) User Agent Option: Authors have the option to preview the time-based media in a user agent that is able to render the alternatives.

Test 0001 Assertion: Any editing views that render audio-video include an option to display alternatives or an option to preview the media in user agent capable of rendering the alternatives. [@@JR updated]

  1. If the authoring tool does not include editing views that are capable of rendering audio-video, then select SKIP.
  2. For each editing view that renders audio-video:
    1. Load the comprehensive accessible test content (any level), which contains time-based media (audio-video) with alternatives (e.g. captions, transcripts, audio-description), in the editing view.
    2. Check if the authoring tool allows the content being edited to be be previewed in a user agent (e.g. browser or media player) where the alternatives can be rendered OR
      if the authoring tool can be set to render the alternatives itself. If not, select FAIL.
  3. Select PASS (all editing views must have passed)

Test 0002 Assertion: Any editing views that render video-only media include an option to display alternatives or an option to preview the media in user agent capable of rendering the alternatives. [@@JR updated]

  1. If the authoring tool does not include editing views that are capable of rendering video-only, then select SKIP.
  2. For each editing view that renders video-only media:
    1. Load the comprehensive accessible test content (any level), which contains time-based media (video-only) with alternatives (e.g. transcripts, audio-description), in the editing view.
    2. Check if the authoring tool allows the content being edited to be be previewed in a user agent (e.g. browser or media player) where the alternatives can be rendered OR
      if the authoring tool can be set to render the alternatives itself. If not, select FAIL.
  3. Select PASS (all editing views must have passed)

Test 0003 Assertion: Any editing views that render audio-only media include an option to display alternatives or an option to preview the media in user agent capable of rendering the alternatives. [@@JR updated]

  1. If the authoring tool does not include editing views that are capable of rendering audio-only, then select SKIP.
  2. For each editing view that renders audio-only:
    1. Load the comprehensive accessible test content (any level), which contains time-based media (audio-only) with alternatives (e.g.transcripts, alternative for time-based media), in the editing view.
    2. Check if the authoring tool allows the content being edited to be be previewed in a user agent (e.g. browser or media player) where the alternatives can be rendered OR
      if the authoring tool can be set to render the alternatives itself. If not, select FAIL.
  3. Select PASS (all editing views must have passed)
Guideline A.2.2: (For the authoring tool user interface) Editing-view presentation can be programmatically determined. Tests

A.2.2.1 Editing-View Status Indicators:

If an editing-view adds status indicators to the content being edited, then the information being conveyed by the status indicators can be programmatically determined. (Level A)

  • Note: Status indicators may indicate errors (e.g., spelling errors), tracked changes, hidden elements, or other information.

Test 0001 Assertion: For web-based tools: Status information about the content (e.g. spellchecking) can be programatically determined. [@@JR updated]

  1. If the editing view is non-web-based, then select SKIP.
  2. Check all of the editing-views for status indicators (often used to indicate errors (e.g., spelling errors), tracked changes, hidden elements, or other information.), possibly from a product feature list or trial and error.
  3. If the authoring tool does not provide status indicators in any of its editing-views, select SKIP.
  4. For each type of status indicator:
    1. Open or author content that will trigger the status indicator (e.g. with spelling errors, add a hidden element, etc.), then examine the indicator with the Web Content Accessibility Test Procedure. If an indicator does not pass, then select FAIL
  5. Select PASS (all indicators must have passed)

Test 0002 Assertion: For non-web-based tools: Status information about the content (e.g. spellchecking) can be programatically determined. [@@JR updated]

  1. If the editing view is web-based, then select SKIP.
  2. Check all of the editing-views for status indicators (often used to indicate errors (e.g., spelling errors), tracked changes, hidden elements, or other information.), possibly from a product feature list or trial and error.
  3. If the authoring tool does not provide status indicators in any of its editing-views, select SKIP.
  4. For each type of status indicator::
    1. Open or author content that will trigger the status indicator (e.g. with spelling errors, add a hidden element, etc.), then examine the indicator with the Platform Accessibility Service Test Procedure to determine if the indicator (e.g. the validation error) has been communicated to the accessibility API. If an indicator does not pass, then select FAIL
  5. Select PASS (all indicators must have passed)

A.2.2.2 Access to Rendered Text Properties:

If an editing-view renders any text formatting properties that authors can also edit using the editing-view, then the properties can be programmatically determined. (Level AA)

Test 0001 Assertion: For web-based tools: Text formatting is passed through in the rendering. [@@JR updated]

  1. If the editing view is non-web-based, then select SKIP.
  2. Check all of the editing-views for text format rendering (i.e., when text being edited is rendered using the same text formatting properties that it will have when renedered by the user agent of end-users).
  3. If the authoring tool does not text property rendering in any of its editing-views, select SKIP.
  4. For each editing view that renders text formatting properties:
    1. Open or author text content that includes text formatting (i.e., the text size, color, background, font, weight, etc. have been set).
    2. Use a web content markup examination tool to examine how the text is actually presented in the editing view. If the text is presented in a way that blocks text formatting from being conveyed to the the browser (e.g. as images of text), then then select FAIL.
  5. Select PASS (all editing views must have passed)

@@Non-web-based tools

PRINCIPLE A.3: Editing-views must be operable Tests
Guideline A.3.1: (For the authoring tool user interface) Provide keyboard access to authoring features. Tests

A.3.1.1 Keyboard Access (Minimum):

All functionality of the authoring tool is operable through a keyboard interface without requiring specific timings for individual keystrokes, except where the underlying function requires input that depends on the path of the user's movement and not just the endpoints. (Level A)

  • Note 1: Keyboard interfaces are programmatic services provided by many platforms that allow operation in a device independent manner. This success criterion does not imply the presence of a hardware keyboard.
  • Note 2: The path exception relates to the underlying function, not the input technique. For example, if using handwriting to enter text, the input technique (handwriting) requires path-dependent input, but the underlying function (text input) does not. The path exception encompasses other input variables that are continuously sampled from pointing devices, including pressure, speed, and angle.
  • Note 3: This success criterion does not forbid and should not discourage other input methods (e.g., mouse, touch) in addition to keyboard operation.

Test 0001 Assertion: All functionality of the authoring tool is operable through a keyboard interface without requiring specific timings for individual keystrokes, except where the underlying function requires input that depends on the path of the user's movement and not just the endpoints.

  1. If the authoring tool does not support any form of keyboard interface, then select FAIL. (@@Note: If this is due to limitations of the platform, "Partial Comformance due to Platform Limitation" is still possible.)
  2. Document presence of programmatic service allowing device-independent keystroke input for platform via which functionality of authoring tool will be accessed - if no such programmatic service exists for this platform, then SC fails (or is N/A?) for that authoring tool on that platform. Go to Step 10.
  3. Open authoring tool on the selected platform and document (list) all functions of authoring tool (this could be from authoring tool documentation or author experience with the tool)
  4. Of these functions, document functions where path-dependent input is required (document rationale for this aspect also) and exclude those functions from the list described in Step 2, to create a modified list of functions
  5. For each function in the modified list from Step 3:
  6. Check that the function works correctly according to specification/expectation by just using the programmatic service described in Step 1 and nothing else
  7. Check that there is no time dependency required for any keystroke input for the programmatic service used in Step 5 in order to successfully complete the function from Step 5 (that is, if a time limit is exceeded, the function does not complete correctly).
  8. If checks for both Steps 5 and 6 are successful for that function, then the SC for that function (on that platform) is TRUE; otherwise the SC for that function (on that platform) is FALSE
  9. If for all functions checked from Steps 4 through 7 , the SC for that function is TRUE, then the SC is passed for that authoring tool (on that platform)
  10. If for at least one function checked from Steps 4 through 7, the SC for that function is FALSE, then the SC fails for that authoring tool (on that platform)
  11. Close authoring tool.

 

A.3.1.2 No Keyboard Traps:

If keyboard focus can be moved to a component using a keyboard interface, then focus can be moved away from that component using only a keyboard interface, and, if it requires more than unmodified arrow or tab keys or other standard exit methods, authors are advised of the method for moving focus away. (Level A)

Test 0001 Assertion:

Test 0001 Author: Tim Boland@@

  1. Step 0. Document specific platform via which authoring tool will be accessed. If a keyboard interface does not exist for this platform, this SC is N/A for this authoring tool; go to Step 7. Otherwise, go to Step 1.
  2. Step 1. Document if keyboard focus is supported by authoring tool as a part of the keyboard interface. If keyboard focus is not supported, this SC is N/A for this authoring tool; go to Step 7. Otherwise, go to Step 2.
  3. Step 2. Document all controls for a specific function supported by authoring tool. For each of these controls, document if there are explicit instructions given to you on how to move keyboard focus to and from that control. If there are no such controls, this SC is N/A for this authoring tool; go to Step 7. Otherwise, go to Step 3.
  4. Step 3. (loop) For every function control (from Step 2) in the authoring tool, test the ability to move keyboard focus (from Step 1) to this function control by using the keyboard interface from Step 0. If keyboard focus can be moved to this function control as specified in the previous sentence (by following any instructions documented in Step 2 for this control), then place the control in Group A. Otherwise place the function control in Group B. If upon exiting the loop, there are no function controls in Group A (Group A is empty), then SC is N/A for this authoring tool on this platform; go to Step 7. Otherwise go to Step 2.
  5. Step 4. (loop) For every function control in Group A, attempt to move keyboard focus from this function control by only using the keyboard interface from Step 0 (and by following any instructions documented for Step 2 for this control). If for any control, focus cannot be moved away from the control in the fashion from the previous sentence (focus is trapped), then stop; SC fails for this authoring tool on this platform; go to Step 7. If the previous condition does not apply for any function control in the loop for Group A (focus is not trapped), document the specific keystrokes/exit methods required for said movement for each function control in Group A. Go to Step 5.
  6. Step 5. Document a list of "standard" or "common" exit methods for this authoring tool (or authoring tools in general).
  7. Step 6. (loop) For every function control in Group A, check to ensure that any exit methods documented for that function control from Step 2 are covered in the list from Step 5. For any exit methods "outside" this list, check to determine if you are notified of the exit method needed prior to attempting to move keyboard focus from that function control, and if notified exit method works in moving keyboard focus from that control. If the preceding sentences in Step 6 are all true for all function controls in Group A, then this SC passes for this authoring tool on this platform. Otherwise, this SC fails for this authoring tool on this platform. Go to Step 7.
  8. Step 7. End test.

A.3.1.3 Efficient Keyboard Access:

The authoring tool user interface includes mechanisms to make keyboard access more efficient than sequential keyboard access. (Level AA)

Test 0001 Assertion:

Test 0001 Author: Tim Boland@@

  1. Step 0. Determine if the platform on which the authoring tool is running supports a keyboard interface. If it does, then proceed to Step 1. If not, then skip to Step 8.
  2. Step 1. Document all mechanisms of the user interface for the authoring tool under test (from authoring tool documentation or from experience). If there are no such mechanisms, then skip to Step 8. Otherwise proceed to Step 2.
  3. Step 2. Document all keyboard access capabilities (via mechanisms from Step 1) supported by the keyboard interface (from Step 0) of the authoring tool(from authoring tool documentation or from experience). If there are fewer than two keyboard access capabilities supported, or if sequential keyboard access is not included, then skip to Step 7. Otherwise proceed to Step 3.
  4. Step 3. Determine/document the efficiency criteria (including rationale?) for evaluating keyboard access mechanisms that you will use for this particular authoring tool, platform, etc. Go to Step 4.
  5. Step 4. Document the "before state" of the authoring tool user interface on this platform. Use a sequential keyboard access mechanism (from Steps 1 and 2) that navigates the focus one-by-one through all of the items in an ordered set (e.g., menu items, form fields) until the desired item is reached and activated. Record the "after state" of the authoring tool user interface at this point. Determine the "efficiency" of this keyboard access mechanism using your criteria from Step 3. Then go back so the "before state" of the authoring tool user interface (using any mechanism available from Step 1 to do this). Go to Step 5.
  6. Step 5. From the "before state" specified earlier, use a -different from sequentlal-? keyboard access mechanism (from Step 1) (such as keyboard shortcuts and the use of bypass links) on the same objects as used in Step 4. Record the "after state" of the authoring tool user interface at this point, and verify that this "after state" is the same as the "after state" from Step 4. Determine the "efficiency" of this access using the same criteria as used in Step 4. Go to Step 6.
  7. Step 6. Compare/evaluate the "efficiencies" determined from Step 4 and from Step 5. If as a result of this comparison/evaluation, Step 5 is more "efficient" than Step 4, then this authoring tool "passes" this SC on this platform. If Step 5 is more "efficient" than Step 4, or the "efficiencies" are the same for Steps 4 and 5, then this authoring tool fails this SC for this platform. Go to Step 7.
  8. Step 7. If the only keyboard access method supported (from Step 2) is sequential keyboard access, then this authoring tool "fails" this SC for this platform. Go to Step 8.
  9. Step 8. If the authoring tool has not been evaluated as "pass" or "fail" on this platform in previous steps up to this point, then the authoring tool is "N/A" for this SC on this platform.

A.3.1.4 Keyboard Access (Enhanced):

All functionality of the authoring tool is operable through a keyboard interface without requiring specific timings for individual keystrokes. (Level AAA)

 

Test 0001 Assertion: @@Tim

  1. If the authoring tool does not support any form of keyboard interface, then select FAIL. @@(Note: If this is due to limitations of the platform, "Partial Comformance due to Platform Limitation" is still possible.)
  2. Document all functions supported by the authoring tool (from authoring tool documentation or author experience)
  3. For each function documented from Step 2 (loop), check that the function works “correctly” (from authoring tool documentation/expected behavior – may involve interaction with content – document rationale for “correctness” determination for each such function) via the keyboard interface from Step 1.  Document any timing issues for keystrokes required to achieve “correctness”.   If one or more such functions do not work “correctly”, then FAIL.  Otherwise proceed. 
  4. Check whether any functions “completed correctly” from Step 3 require specific timings for any individual keystrokes in order to complete correctly (from timing issues documented in Step 3).  If any do, then FAIL.  Otherwise PASS.

@@ISSUE: Re: timing issues in Step 3, what is a reasonable amount of time to wait for any keystroke to complete correctly in the testing process?   IF the tester waits too short a time, then a keystroke may not have a “reasonable” chance to complete under any circumstance, so may be unfairly penalized.  If the tester waits too long  for a keystroke to complete, then that may be an issue as well (upper limit for keystroke timing – how do you know when you’ve reached it?  Also, what about a function that requires an excessive number of keystrokes to complete it?  

A.3.1.5 Customize Keyboard Access:

If the authoring tool includes keyboard commands, then those keyboard commands can be customized. (Level AAA)

 

Test 0001 Assertion: Keyboard commands can be customized. @@Tim

Test 0001 Steps:

  1. If the authoring tool does not include keyboard commands, then select SKIP.
  2. For the authoring tool, document all commands invoked via this keyboard interface (from user experience or authoring tool documentation).
  3. For each keyboard command:
    1. Search for a way to change the keyboard command such that another keyboard command can accomplish the same action (e.g., some tools have utilities that present all available actions and then allow the author to set which keyboard command activates each). If this is not possible for a command, then select FAIL.
  4. Select PASS (all keyboard commands must have passed)

A.3.1.6 Present Keyboard Commands:

If the authoring tool includes keyboard commands,

then the authoring tool provides a way for authors to determine the keyboard commands associated with authoring tool user interface components. (Level AAA)

Test 0001 Assertion: @@Tim

Test 0001 Steps:

Guideline A.3.2: (For the authoring tool user interface) Provide authors with enough time. Tests

A.3.2.1 Auto-Save (Minimum):

If the authoring tool includes authoring session time limits, then the authoring tool can be set to automatically save web content edits made using the authoring tool before the session time limits are reached. (Level A)

Test 0001 Assertion: All time limits implement auto-save. [@@JR updated]

  1. Examine the user interface of the authoring tools for time limits on authoring sessions(e.g. automatic logout).
  2. If the authoring tool does not have any time limits, then select SKIP.
  3. For each time limit on an authoring session:
    1. Check to determine if the authoring tool can be configured (or is already configured) to automatically save any edits to web content before that time limit is reached. If not, then select FAIL.
    2. Test the functionality by authoring content and then allowing the time limit to occur. If the web content changes cannot be recovered, then select FAIL.
  4. Select PASS (all time limits must have passed)

 

A.3.2.2 Timing Adjustable:

If a time limit is set by the authoring tool, then at least one of the following is true: (Level A)

  • (a) Turn Off: Authors are allowed to turn off the time limit before encountering it; or
  • (b) Adjust: Authors are allowed to adjust the time limit before encountering it over a wide range that is at least ten times the length of the default setting; or
  • (c) Extend: Authors are warned before time expires and given at least 20 seconds to extend the time limit with a simple action (e.g., "press the space bar"), and authors are allowed to extend the time limit at least ten times; or
  • (d) Real-time Exception: The time limit is a required part of a real-time event (e.g., a collaborative authoring system), and no alternative to the time limit is possible; or
  • (e) Essential Exception: The time limit is essential and extending it would invalidate the activity; or
  • (f) 20 Hour Exception: The time limit is longer than 20 hours.

Test 0001 Time limits et by authoring tools can be turned off, adjusted, extended, are real-time exceptions, are essential, or exceed 20 hours. [@@JR updated]

  1. Examine the user interface of the authoring tools for time limits (e.g. automatic logout).
  2. If the authoring tool does not have any time limits (e.g. an automatic logout), then select SKIP.
  3. For each time limit set by the authoring tool:
    1. If the authoring tool time limit is a real-time exception, meaning that the time limit is a required part of a real-time event (e.g., a collaborative authoring system), and no alternative to the time limit is possible, then go on to the next time limit.
    2. If the time limit is essential and extending it would invalidate the activity, then go on to the next time limit.
    3. If the time limit is longer than 20 hours, then go on to the next time limit.
    4. If authors can turn off the time limit before encountering, then go on to the next time limit.
    5. If authors are warned before each time limit expires and are given at least 20 seconds to extend the time limit with a simple action (e.g., "press the space bar"), and authors are allowed to extend the time limit at least ten times, then go on to the next time limit.
    6. If authors are allowed to adjust the time limit before encountering it, check the configuration parameters to insure that the time adjustment options are over a wide range that is at least ten times the length of the default setting. If this is true, then go on to the next time limit.
    7. If the authoring tool has time limits, and none of the above statements are true, then select FAIL.
  4. Select PASS (all time limits must have passed)

A.3.2.3 Static Input Components:

If authoring tool user interface components that accept input can move, then authors can pause the movement. (Level A)

Test 0001 Assertion: If components of the authoring tool user interface can move, the author can pause the movement. [@@JR updated]

  1. If no parts of the authoring tool user interface can move (e.g. animation, video or script), then select SKIP.
  2. For each part of the authoring tool user interface that can move:
    1. If there is no way to pause or stop motion (e.g.. stop buttom, pause button), then select FAIL.
  3. Select PASS (all moving parts of the user interface must have passed)..

A.3.2.4 Content Edits Saved (Extended):

The authoring tool can be set to automatically save web content edits made using the authoring tool. (Level AAA)

Test 0001 Assertion: The authoring tool automatically saves edits or has a configuration option to automatically save edits. [@@JR updated]

  1. Check the preference settings and documentation. If there is an option to automatically save edits, activate that feature.
  2. Use a sample test file to load some content into the authoring tool. Make a noticable, but minor change to the content. If there is a visible indication that the file has been automatically saved, select PASS.
  3. Otherwise, wait 5-10 minutes, close the file without manually saving the changes.
  4. Reopen the file. If the change you made is displayed correctly, select PASS. If the change was not saved, select FAIL.
Guideline A.3.3: (For the authoring tool user interface) Help authors avoid flashing that could cause seizures. Tests

A.3.3.1 Static View Option:

If the authoring tool contains editing-views that render visual time-based content, then those editing-views can be paused and can be set to not play automatically. (Level A)

Test 0001 Assertion: If the authoring tool contains editing-views that render visual time-based content, then those editing-views can be paused and can be set to not play automatically [@@JR updated]

  1. If the authoring tool cannot be used to edit time-based content such as video, animation, animated gifs etc., then select SKIP
  2. If the authoring tool does not include editing views that render visual time-based content such as video, animation, animated gifs etc., then select SKIP
  3. If the renderings are non-editable, such as previews, this SC is SKIP.
  4. Load sample video (audio, animation, animated gifs etc.)
  5. If the authoring tool can be set to never play time-based content automatically AND once playing the content can be paused, then PASS.
  6. If the editing view is web-based and the browser can be used to prevent auto-play and to pause the playing content then PASS.
Guideline A.3.4: (For the authoring tool user interface) Enhance navigation and editing via content structure. Tests

A.3.4.1 Navigate By Structure:

If editing-views expose the markup elements in the web content being edited, then the markup elements (e.g., source code, content renderings) are selectable and navigation mechanisms are provided to move the selection focus between elements. (Level AA)

Test 0001 Assertion:

  1. If the tool is designed such that markup elements are never disclosed to the author, this SC is SKIP
  2. Where markup elements are disclosed to the user (e.g. document outline view, source view, etc.), if it is not possible to select a disclosed element without selecting any of the content that surrounds it, then FAIL.
  3. If the only way to move selection from one disclosed element to the other is by clearing the selection and manually selecting the start and end point of the new element in the source, then FAIL.
  4. Otherwise PASS.

A.3.4.2 Navigate by Programmatic Relationships:

If editing-views allow editing of programmatic relationships within web content, then mechanisms are provided that support navigation between the related content. (Level AAA)

  • Note: Depending on the web content technology and the nature of the authoring tool, relationships may include, but are not limited to, element nesting, headings, labeling, programmatic definitions, and ID relationships.

Test 0001 Assertion:

  1. If the tool is designed such that programmatic relationships (ID reference, data structure definition, function definition, etc.) are never disclosed to the author, this SC is SKIP
  2. If a mechanism exists that allows the user to navigate between pieces of web content (elements, functions, etc.) where there is a programmatic relationship (ID reference, data structure definition, function definition, etc.) then PASS
Guideline A.3.5: (For the authoring tool user interface) Provide text search of the content. Tests

A.3.5.1 Text Search:

If the authoring tool provides an editing-view of text-based content, then the editing-view enables text search, such that all of the following are true: (Level AA)

  • (a) All Editable Text: Any text content that is editable by the editing-view is searchable (including alternative content); and
  • (b) Match: Matching results can be presented to authors and given focus; and
  • (c) No Match: Authors are informed when no results are found; and
  • (d) Two-way: The search can be made forwards or backwards.

Test 0001 Assertion: All editing-views for enable text search where any text content that is editable by the editing-view is searchable, results can be made visible to authors and given focus, authors are informed when no results are found and search can be made forwards or backwards. [@@JR updated]

  1. If the authoring tool does not allow the editing of text content (e.g. because it is a graphics editor), then select SKIP.
  2. For each editing view that enables the editing of text content:
    1. Load the comprehensive accessible test content (any level), which contains non-text content with text alternatives, in the editing view.
    2. Choose a word from within the text and then determine whether a search function exists for the editing view that can find the word. In web-based tools, the search function may be part of the user agent. If this is not possivle, then select FAIL.
    3. When a match is found, determine, whether the editing view is moved such that the found result is presented to the author. If this is not done, then select FAIL
    4. Determine whether search is possible forwards and backwards. If it is not, then select FAIL
    5. Choose a search term that is not in the content (e.g. a nonsense word) and search for it. If no indication is made of the failutre of the search, then select FAIL
    6. If the editing view enables editing of text alternatives for non-text content, choose a search term from within the text alternative. If the term cannot be found, then select FAIL.
  3. Select PASS (all of the editing views must have passed)
Guideline A.3.6: (For the authoring tool user interface) Manage preference settings. Tests

A.3.6.1 Independence of Display:

If the authoring tool includes display settings for editing-views, then the authoring tool allows authors to adjust these settings without modifying the web content being edited. (Level A)

Test 0001 Assertion:

Test Author: Tim Boland & Jan Richards

Test 0001 Steps:

  1. Determine (from the user interface or documentation) whether the authoring tool includes settings that affect how the content being edited is perceived by the author. If these settings exist, then document them. If not, then select SKIP.
  2. Create/open web content with the authoring tool.
  3. Determine a "method for testing how the web content will be experienced by end-users" (this may be as simple as opening the content in a user agent; or it may involve ending the authoring session).
  4. For each setting from Step 1, change the setting to a different value. Try to choose values that are as different as possible from the starting values, since this will make detecting differences easier. After changing each setting, save the content and then use the "method for testing how the web content will be experienced by end-users" (from Step 3). If the end user experience has changed for any of the settings, then select FAIL.
  5. If all settings can be changed without affecting the produced web content, then select PASS.

A.3.6.2 Save Settings:

If the authoring tool includes display and/or control settings, then these settings can be saved between authoring sessions. (Level AA)

 

Test 0001 Assertion: Preferences for display or control settings can be saved between authoring sessions.

  1. Determine (from the user interface or documentation) whether the authoring tool includes settings that affect how the author tool's user interface or the content being edited is perceived by the author (not the end-user). If these settings do not exist, then select SKIP.
  2. For each set of preferences or control settings:
    1. Does the preference or preference group include a control to allow the settings to be saved? If so, go to the next set of preference or control settings.
    2. Make a change to a setting, then logout or end the authoring session. Then return back to the content being edited.
    3. If the setting change has persisted, go to the next set of preference or control settings. If not, then select FAIL.
  3. Select PASS (all of the preference or control settings must have passed)

A.3.6.3 Apply Platform Settings:

The authoring tool respects changes in platform display and control settings, unless authors select more specific display and control settings using the authoring tool. (Level AA)

Test 0001 Assertion: If the user makes a change to the platform display or control settings, then those changes appear in the authoring tool. If the user makes a change to the platform display or control settings and that change does NOT appear in the authoring tool, then the authoring tool has more specific display and control settings inside the authoring tool.

  1. If the platform for the authoring tool does not allow changes to the platform display or control settings, then select SKIP. [This should be rare that a platform does not allow any customization.]
  2. Change the platform (e.g. the Windows, Mac OS, ot mobile device) accessibility settings(e.g to high contrast mode or another settings change) from the platform accessibility options. Record the change made.
  3. Launch the authoring tool and observe whether the change made in step 2 is present in the display or controls of the authoring tool. If yes, select PASS.
  4. If the change made to the display or control settings in step 2 is not visible, then open the preference or settings menu. If the authoring tool allows more advanced customization that allowed by the platform, select PASS.
  5. If the authoring tool does not allow more customization of that setting or control that the platform, select FAIL.

A.3.6.4 Multiple Sets:

If the authoring tool includes display and/or control settings, then the authoring tool provides the option of saving and reloading multiple configurations of settings. (Level AAA)

Test 0001 Assertion: The authoring tool has the ability to save, name, and reload multiple configurations of settings. @@JEANNE

Test 0001 Author: Jeanne Spellman

  1. Determine (from the user interface or documentation) whether the authoring tool includes settings that affect how the user interface or the content being edited is perceived by the author. If these settings exist, then document them (you may reuse the documentation from A.3.6.2 tests). If not, then select SKIP.
  2. Does the authoring tool FAIL ATAG A.3.6.2? If so, select FAIL.
  3. For each set of preferences or control settings:
    1. Does the preference or preference group include a control to allow the settings to be saved and give that group of settings a name or some other method of distinguishing between multiple groups of settings? @@???
    2. Make some changes to the display or control settings (preferable a change easy to distinguish), record the changes you have made, and set a name for those settings or some other method of identifying and distinguishing that group of settings.
    3. Return back to the settings control mechanism and load the original set of preferences. See if the settings you changed revert to the default correctly.
    4. Select the set of preferences you created. Do the setting change correctly? If yes, then select PASS. If the settings remain at the default or the change that you made in step 3.2 is no longer in effect, then select FAIL.
Guideline A.3.7: (For the authoring tool user interface) Ensure that previews are at least as accessible as in-market user agents. Tests

A.3.7.1 Preview (Minimum):

If a preview is provided, then at least one of the following is true: (Level A)

  • (a) In-Market User Agent: The preview renders content using a user agent that is in-market; or
  • (b) UAAG (Level A): The preview conforms to the User Agent Accessibility Guidelines 1.0 Level A [UAAG].

Test 0001 Assertion: Previews use either in-market user agents or conform to Level A of the User Agent Accessibility Guidelines 1.0.

Test Author: Greg Pisocky

  1. Determine from the user interface, online help, or documentation that the application provides a preview mode. If no preview mode exists, then select SKIP.
  2. For each editing view with preview mode(s):
    1. Create or open web content into the editing view.
    2. Invoke the content preview mode.
    3. Note the options for viewing content in preview mode.
    4. If one of the options for viewing content in preview mode employs an in-market user agent (that can be procured by members of the public (free or otherwise). Usually, an in-market user agent will be a separate software from the authoring tool, however, sometimes a software may combine user agent and authoring tool functionality), then go to the next editing view with preview mode. (Note: if this is the case, the user agent need not meet UAAG)
    5. If the available preview mode is not in market, but it meets User Agent Accessibility Test Procedure (Level A) then go to the next editing view with preview mode
    6. If the available preview mode does not meet the User Agent Accessibility Test Procedure (Level A), then select FAIL.
  3. Then select PASS (all of the eding views with preview(s) must have passed)

A.3.7.2 Preview (Enhanced):

If a preview is provided, then authors can specify which user agent performs the preview. (Level AAA)

Test 0001 Assertion: Authors can choose from a set of in-market user agents for previews.

Test Author: Greg Pisocky

  1. Determine from the user interface, online help, or documentation that the application provides a preview mode. If no preview mode exists, then select SKIP.
  2. For each editing view with preview mode(s):
    1. Create or open web content into the editing view.
    2. If there is no option for viewing content in preview mode that employs an in-market user agent (that can be procured by members of the public (free or otherwise). Usually, an in-market user agent will be a separate software from the authoring tool, however, sometimes a software may combine user agent and authoring tool functionality), then select FAIL.
    3. If the preview option is limited to a single in-market user agent, then select FAIL.
  3. Then select PASS (all of the eding views with preview(s) must have passed)
PRINCIPLE A.4: Editing-views must be understandable Tests
Guideline A.4.1: (For the authoring tool user interface) Help authors avoid and correct mistakes. Tests

A.4.1.1 Content Changes Reversible (Minimum):

All authoring actions are either reversible or the authoring tool requires author confirmation to proceed. (Level A)

 

Test 0001 Assertion: All authoring actions are either reversible or the authoring tool requires author confirmation to proceed.[@@JR updated]

Open or author sample content (e.g. comprehensive accessible test content).

  1. Decide on a number of authoring actions (e.g. typing text, inserting an object, deleting text, deleting objects, etc.)
  2. For each authoring action:
    1. Perform the authoring action.
    2. If a confirmation was required to proceed, check whether the confirmation stated that the authoring action would be irreversible. If so, then go to the next authoring action.
    3. Attempt to reverse the authoring action (e.g. via mechanisms such as "Undo" or "Cancel"). If this is not possible, then select FAIL.
  3. If all of the authoring actions passed, then select PASS.

A.4.1.2 Settings Change Confirmation:

If the authoring tool provides mechanisms for changing authoring tool user interface settings, then those mechanisms can reverse the setting changes, or the authoring tool requires author confirmation to proceed. (Level A)

Test 0001 Assertion:User interface setting changes can be reversed, or require author confirmation to proceed.

Test 0001: Author: Tim Boland

Test 0001 Steps:

  1. If there are NO mechanisms to change any preference settings within that authoring tool user interface, then select SKIP.
  2. Open/install authoring tool. Note "values" of all preference settings within that authoring tool user interface.
  3. For each mechanism to change the preference settings, use those mechanisms to change the relevant preference settings within that authoring tool user interface, so that the "value" of those preference settings is different from that from step 2.
  4. Check if the authoring tool user interface provides explicit notification that no further action is possible from this authoring tool unless permission is specifically granted by you using an appropriate "vehicle" provided by this authoring tool user interface (i.e., authoring tool is "frozen" awaiting input from you). Answer "yes" to the "request to proceed" notification, then verify that the change is successful. If this check is true for all such preference setting mechanisms, then select PASS.
  5. Attempt to "reverse" all changes from step 3 by using the same mechanisms as were used in step 3 to make the changes as appropriate. Check that as a result of the attempted reversals from step 3, the "value" of that associated preference setting is the same as the "value" of the same preference setting from step 2. If this check is true for all such preference setting mechanisms, then select PASS.
  6. If both checks from Step 4 and Step 5 are false, then select FAIL.

A.4.1.3 Content Changes Reversible (Enhanced):

Authors can sequentially reverse a series of reversible authoring actions. (Level AAA)

Test 0001 Assertion: A sequence of authoring actions can be reversed sequentially.[@@JR updated]

  1. Open or author sample content (e.g. comprehensive accessible test content).
  2. Decide on a number of authoring actions (e.g. typing text, inserting an object, deleting text, deleting objects, etc.)
  3. Perform all of the authoring actions in sequence (do not save, close the session, etc.)
  4. Attempt to reverse the authoring actions (e.g. via mechanisms such as "Undo" or "Cancel") one by one. If this is possible, then select PASS. Otherwise, select FAIL.
Guideline A.4.2: (For the authoring tool user interface) Document the user interface including all accessibility features. Tests

A.4.2.1 Describe Accessibility Features:

For each authoring tool feature that is used to meet Part A of ATAG 2.0, at least one of the following is true: (Level A)

  • (a) Described in the Documentation: Use of the feature is explained in the authoring tool's documentation; or
  • (b) Described in the Interface: Use of the feature is explained in the authoring tool user interface; or
  • (c) Platform Service: The feature is a service provided by an underlying platform; or
  • (d) Not Used by Authors: The feature is not used directly by authors (e.g., passing information to a platform accessibility service).

Test 0001 Assertion:

  1. Examine the user interface of the authoring tool, noting each user interface component that is necessary in order to meet part A of ATAG 2.0 (e.g. search functions). Note: Many of the success criteria in Part A are more qualitative and will not require particular user interface functionality (e.g. the requirement to follow WCAG 2.0). (Components are checked because they are the constituents of features)
  2. For each of these user interface components:
    1. If the user interface component is part of functionality provided by the platform (e.g. the menu bar of the browser in the case of a web-based tool), then skip to the next component.
    2. If use of the user interface component is a convention of the platform (e.g. how to operate scrollbars, standard Save and Open dialog boxes), then skip to the next component.
    3. If use of the user interface component is clear from its context (e.g. a page zoom feature with percentage values in a drop-down list) , then skip to the next component.
    4. If the user interface component is documented in the interface (e.g. with text next to the item, context-sensitive help), then skip to the next component.
    5. Look up the user interface component (or its associated functionality) in the documentation. If documentation exists, then go to the next component.
    6. If there is no way to discover how to use the user interface component besides trial-and-error then select FAIL.

A.4.2.2 Document All Features:

For each authoring tool feature, at least one of the following is true: (Level AA)

  • (a) Described in the Documentation: Use of the feature is explained in the authoring tool's documentation; or
  • (b) Described in the Interface: Use of the feature is explained in the authoring tool user interface; or
  • (c) Platform Service: The feature is a service provided by an underlying platform; or
  • (d) Not Used by Authors: The feature is not used directly by authors (e.g., passing information to a platform accessibility service).

Test 0001 Assertion:

  1. Examine the user interface of the authoring tool, noting each user interface component that accepts input is available to the author. (Components are checked because they are the constituents of features)
  2. For each of these user interface components:
    1. If the user interface component is part of functionality provided by the platform (e.g. the menu bar of the browser in the case of a web-based tool), then skip to the next component.
    2. If use of the user interface component is a convention of the platform (e.g. how to operate scrollbars, standard Save and Open dialog boxes), then skip to the next component.
    3. If use of the user interface component is clear from its context (e.g. a page zoom feature with percentage values in a drop-down list) , then skip to the next component.
    4. If the user interface component is documented in the interface (e.g. with text next to the item, context-sensitive help), then skip to the next component.
    5. Look up the user interface component (or its associated functionality) in the documentation. If documentation exists, then skip to the next component.
    6. If there is no way to discover how to use the user interface component besides trial-and-error then select FAIL. @@this would definitely benefit from a details section.
PART B: Support the production of accessible content Tests
PRINCIPLE B.1: Fully automatic processes must produce accessible content Tests
Guideline B.1.1: Ensure automatically specified content is accessible. Tests

B.1.1.1 Content Auto-Generation After Authoring Sessions (WCAG):

If the authoring tool provides the functionality for automatically generating web content after the end of an authoring session, authors can specify that the content be accessible web content (WCAG). (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion:

  1. This SC only applies to authoring tools that add anything to the end-user experience beyond what the author has experienced during the authoring session. Otherwise, select SKIP
  2. The SC's note also makes it clear that the SC refers to developer-provided processes, not processes created by the author or other third-parties.
  3. If the auto-generation system primarily works by creating a wrapper around the author's entries, try to test the auto-generation system with as little author-entered content as possible.
  4. If author input is required, ensure that only accessible content is added and that all prompts are followed correctly.
  5. If the auto-generation system acts differently depending on the author's entries, try to test the auto-generation system with the "comprehensive accessible test content"
  6. If additional author input is required, ensure that only accessible content is added and that all prompts are followed correctly.
  7. Once the system produces output, follow the Web Content Accessibility Test Procedure (TARGET_LEVEL) to determine if it meets the WCAG 2.0 success criteria TARGET_LEVEL.

B.1.1.2 Content Auto-Generation During Authoring Sessions (WCAG):

If the authoring tool provides the functionality for automatically generating web content during an authoring session, then at least one of the following is true: (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)
  • (a) Accessible: The content is accessible web content (WCAG) without author input; or
  • (b) Prompting: During the automatic generation process, authors are prompted for any required accessibility information (WCAG); or
  • (c) Automatic Checking: After the automatic generation process, accessibility checking is automatically performed; or
  • (d) Checking Suggested: After the automatic generation process, the authoring tool prompts authors to perform accessibility checking.

Test 0001 Assertion: Content generated automatically during authoring sessions is either accessible or the user is prompeted or checking is enabled automatically or checking is suggested..

  1. This SC applies only to authoring tools that automatically add content during the authoring session. Such processes can range from complex (e.g., a process that builds a whole page from just a few user entries - Note 1 applies here) to basic (e.g. adding a <strong> formatting tag when the user has selected to have text made "bold"). If the authoring tool does not automatically generate content, select SKIP.
  2. Proceed by triggering as many automated authoring processes as possible. Trigger them one at a time with as little author-entered content as possible (e.g. triggering the automated processes on nearly empty pages).
  3. If all of the automated authoring processes result in one of the follow outcomes then select PASS. (a) The produced content (not necessarily the document as a whole) passes the "Web Content Accessibility Test Procedure (TARGET_LEVEL)"; or (b) During the automatic process, authors are prompted for any required accessibility information (WCAG) and if this is properly supplied then the produced content passes the "Web Content Accessibility Test Procedure (TARGET_LEVEL)"; or (c) After the automatic generation process, accessibility checking is automatically performed (check-as-you-type systems that check for accessibility continuously will meet this); or (d) Checking Suggested: After the automatic generation process, the authoring tool prompts authors to perform accessibility checking (such prompts need not be obtrusive).
  4. if any of the processes do not result in any of the outcomes in (3) then, select FAIL.
Guideline B.1.2: Ensure accessibility information is preserved. Tests

B.1.2.1 Restructuring and Recoding Transformations (WCAG):

If the authoring tool provides restructuring transformations or re-coding transformations, and if equivalent mechanisms exist in the web content technology of the output, then at least one of the following is true: (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

  • (a) Preserve: Accessibility information (WCAG) is preserved in the output; or
  • (b) Warning: Authors have the default option to be warned that accessibility information (WCAG) may be lost (e.g., when saving a vector graphic into a raster image format); or
  • (c) Automatic Checking: After the transformation, accessibility checking is automatically performed; or
  • (d) Checking Suggested: After the transformation, the authoring tool prompts authors to perform accessibility checking.

Test 0001 Assertion:

  1. This SC applies only to authoring tools that perform restructuring or recoding transformations. In restructuring transformations, the content technology (e.g. HTML) stays the same, but the structural features of the technology used to markup the content are changed (e.g., linearizing tables, splitting a document into pages. In recoding transformations, the content technology used to encode the content is changed (e.g., HTML to XHTML, a word processing format to HTML). If the authoring tool does not perform such transformations, then select SKIP.
  2. Examine the user interface and documentation for potential processes (e.g. under "Save As", "Export", etc.). While determining candidates: - Note that these must be automatic processes. A general find-and-replace mechanism does not qualify. - Note that the definition of content transformations excludes clipboard actions (such as copy and paste), which are treated separately. - Note that for recoding transformations, only processes resulting in technologies "included" for conformance are applicable. Saving from an "included" technology to an "unincluded" technology is not covered. - Note 1 excludes text alternatives for non-text content, an important subset of the "Listing of Accessibility Information Types". - Note that an equivalent mechanism for preserving the accessibility information must exist (in order to preserve captions, both technologies must support captions). Consult the "Listing of Accessibility Information Types" for the input and output technologies.
  3. If all of the restructuring or recoding transformation processes result in one of the follow outcomes (when operating on the "Comprehensive accessible test content (Level AAA)") then select PASS. (a) The transformed content passes the "Web Content Accessibility Test Procedure (Level AAA)"; or (b) Before the transformation process proceeds, authors are warned that accessibility information may be lost; or (c) After the transformation process, accessibility checking is automatically performed (check-as-you-type systems that check for accessibility continuously will meet this); or (d) Checking Suggested: After the transformation process, the authoring tool prompts authors to perform accessibility checking (such prompts need not be obtrusive).
  4. If any of the transformation processes do not result in any of the outcomes in (3) then, select FAIL.

B.1.2.2 Copy-Paste Inside Authoring Tool (WCAG):

If the authoring tool supports copy and paste of structured content, then any accessibility information (WCAG) in the copied content is preserved when the authoring tool is both the source and destination of the copy-paste and the source and destination use the same web content technology. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: Accessibility information in the copied content is preserved when the same authoring tool editing view is both the source and destination of the copy-paste. [@@JR updated]

  1. If the authoring tool does not support copy-paste, then select SKIP.
  2. Open comprehensive accessible test content (TARGET_LEVEL).
  3. Copy as much of the content as possible and paste it back into the same editing view.
  4. Once the system produces output, compare it to the comprehensive accessible test content (TARGET_LEVEL). If it is identical or if the differences only affect whitespace, then select PASS.
  5. Otherwise, follow the Web Content Accessibility Test Procedure to determine if it meets the WCAG 2.0 success criteria TARGET_LEVEL. If it does, then select PASS. Otherwise, select FAIL.

B.1.2.3 Optimizations Preserve Accessibility:

If the authoring tool provides optimizing web content transformations, then any accessibility information (WCAG) in the input is preserved in the output. (Level A).

Test 0001 Assertion: [@@JR updated]

  1. If the authoring tool does include any optimizations (e.g. "pretty print"), then select SKIP.
  2. For each type of optimization:.
    1. Open comprehensive accessible test content
    2. Once the system produces output, compare it to the comprehensive accessible test content. If it is identical or if the differences only affect whitespace, then go to the next type of optimization.
    3. Otherwise, follow the Web Content Accessibility Test Procedure to determine if it meets the WCAG 2.0 success criteria TARGET_LEVEL. If it does not, select FAIL.
  3. If all types of optimizations pass the test, then select PASS.

B.1.2.4 Text Alternatives for Non-Text Content are Preserved:

If the authoring tool provides web content transformations that preserve non-text content in the output, then any text alternatives for that non-text content are also preserved, if equivalent mechanisms exist in the web content technology of the output. (Level A).

  • Note: This success criterion only applies when the output technology is "included" for conformance.

Test 0001 Assertion:@@Jan

Test 0001 Steps:

PRINCIPLE B.2: Authors must be supported in producing accessible content Tests
Guideline B.2.1: Ensure accessible content production is possible. Tests

B.2.1.1 Accessible Content Possible (WCAG):

If the authoring tool places restrictions on the web content that authors can specify, then those restrictions do not prevent WCAG 2.0 success criteria from being met. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion:@@Jeanne

Test 0001 Steps:

@@Jeanne: See B.2.4.1

Guideline B.2.2: Guide authors to produce accessible content. Tests

B.2.2.1 Accessible Option Prominence (WCAG):

If authors are provided with a choice of authoring actions for achieving the same authoring outcome (e.g., styling text), then options that will result in accessible web content (WCAG) are at least as prominent as options that will not. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: @@Greg

Test 0001 Steps:

B.2.2.2 Setting Accessibility Properties (WCAG):

If the authoring tool provides mechanisms to set web content properties (e.g., attribute values), then mechanisms are also provided to set web content properties related to accessibility information (WCAG). (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: @@Greg

Test 0001 Steps:

Guideline B.2.3: Assist authors with managing alternative content for non-text content. Tests

B.2.3.1 Alternative Content is Editable (WCAG):

If the authoring tool provides functionality for adding non-text content, then authors are able to modify programmatically associated text alternatives for non-text content. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion:@@Jeanne

Test 0001 Steps:

B.2.3.2 Repair of Text Alternatives During Authoring Sessions:

If the authoring tool attempts to automatically or semi-automatically repair text alternatives for non-text content ("repair strings") during an authoring session, then the following conditions are both true: (Level A)

  • (a) No Generic or Irrelevant Strings: Generic strings (e.g. "image") and irrelevant strings (e.g., the file name, file format) are not used as repair strings; and
  • (b) Author Control: Authors have the opportunity to accept, modify, or reject the repair strings prior to insertion in the content..

Test 0001 Assertion: @@Jeanne

Test 0001 Steps:

B.2.3.3 Repair of Text Alternatives After Authoring Sessions:

If the authoring tool attempts to automatically repair text alternatives for non-text content after an authoring session has ended, then the following are both true: (Level A)

  • (a) No Generic or Irrelevant Strings: Generic strings (e.g. "image") and irrelevant strings (e.g., the file name, file format) are not used as repair strings; and
  • (b) Author Control: In the subsequent authoring session (if any), auto-generated text alternatives are indicated and authors have the opportunity to accept, modify, or reject the text alternatives.

Test 0001 Assertion:@@Jeanne

Test 0001 Steps:

B.2.3.4 Save for Reuse:

 

If the authoring tool provides the functionality for adding non-text content,

when authors enter programmatically associated text alternatives for non-text content, then both of the following are true: (Level AAA)
  • (a) Save and Suggest: The text alternatives are automatically saved and suggested by the authoring tool, if the same non-text content is reused; and
  • (b) Edit Option: The author has the option to edit or delete the saved text alternatives.

Test 0001 Assertion:@@Jeanne

Test 0001 Steps:

Guideline B.2.4: Assist authors with accessible templates. Tests

B.2.4.1 Accessible Template Options (WCAG):

If the authoring tool provides templates, then there are accessible template (WCAG) options for a range of template uses. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: There are accessible template (WCAG) options for a range of template uses [@@JR updated]

  1. If the authoring tool does not provide templates (Content patterns that are filled in by authors or the authoring tool to produce content for end users ), then select SKIP.
  2. If only blank document templates (resulting in empty documents if not filled in) are provided, then select PASS.
  3. For each template:
    1. Create some content using the template follwing the following two rules:
      1. Correctly follows any instructions provided (e.g., correctly responding to prompts, correctly replacing highlighted placeholders); and
      2. Do no more authoring than requested by the instructions
    2. Once the system produces output, follow the Web Content Accessibility Test Procedure to determine if it meets the WCAG 2.0 success criteria TARGET_LEVEL.
    3. Once two templates are found that meet WCAG 2.0 (or one, if there is only one template), select PASS.
    4. Go to the next template.
  4. Select FAIL. (a range of templated must not have been found)

B.2.4.2 Identify Template Accessibility (Minimum):

If the authoring tool includes a template selection mechanism and provides any non-accessible template (WCAG) options, then the templates are provided such that the template selection mechanism can display distinctions between the accessible and non-accessible options. (Level AA)

  • Note: The distinction can involve providing information for the accessible templates, the non-accessible templates or both.

Test 0001 Assertion: Template selection mechanisms can display distinctions between the accessible and non-accessible options. [@@JR updated]

  1. If the authoring tool does not provide templates (Content patterns that are filled in by authors or the authoring tool to produce content for end users ), then select SKIP.
  2. If the authoring tool only provides templattes that meet WCAG (according to your Web Content Accessibility Test Procedure (Leverl A)), then select SKIP.
  3. If the authoring tool does not provide a mechanism for selecting templates that is not just a standard file selection mechanism, then select SKIP.
  4. For each template selection mechanism:
    1. Identify one template that is accessible and one template that is not.
    2. Obeserve how the two templates are displayed in the template selection mechanism. If there is not distinction between how they are displayed that could help the author to understand that one is accessible and the other not, then select FAIL.
  5. Select PASS (all of the template selection mechanisms must indicated the distinction)

B.2.4.3 Author-Created Templates:

If the authoring tool includes a template selection mechanism and allows authors to create new non-accessible templates (WCAG), then authors can enable the template selection mechanism to display distinctions between accessible and non-accessible templates that they create. (Level AA)

  • Note: The distinction can involve providing information for the accessible templates (WCAG), the non-accessible templates or both.

Test 0001 Assertion: @@Jan

Test 0001 Steps:

B.2.4.4 Identify Template Accessibility (Enhanced):

If the authoring tool provides any non-accessible templates (WCAG) options and does not include a template selection mechanism, then the non-accessible templates include accessibility warnings within the templates. (Level AAA)

Test 0001 Assertion: @@Jan

Test 0001 Steps:

Guideline B.2.5: Assist authors with accessible pre-authored content. Tests

B.2.5.1 Pre-Authored Content Selection Mechanism:

If authors are provided with a selection mechanism for pre-authored content other than templates (e.g., clip art gallery, widget repository, design themes), then both of the following are true: (Level AA)

Test 0001 Assertion: Any repositories of pre-authored content records the accessibility status of each piece of content.

  1. Search the authoring tool for pieces of pre-authored content intended for use by authors, but that are not templates (this was checked for B.2.4.1). For example, a clip art gallery, widget repository, design themes, etc. If none are found, then select SKIP.
  2. If the authoring tool does not provide a mechanism for selecting pre-authored content that is not just a standard file selection mechanism, then select SKIP.
  3. For each pre-authored content selection mechanism:
    1. ?
    2. ?

B.2.5.2 Pre-Authored Content Accessibility Status:

If the authoring tool provides a repository of pre-authored content, then each of the content objects has a recorded accessibility status. (Level AAA)

Test 0001 Assertion: Any repositories of pre-authored content records the accessibility status of each piece of content.

  1. Search the authoring tool for pieces of pre-authored content intended for use by authors, but that are not templates (this was checked for B.2.4.1). For example, a clip art gallery, widget repository, design themes, etc. If none are found, then select SKIP.
  2. Determine whether the pre-authored
  3. Determine whether the
PRINCIPLE B.3: Authors must be supported in improving the accessibility of existing content Tests
Guideline B.3.1: Assist authors in checking for accessibility problems. Tests

B.3.1.1 Checking Assistance (WCAG):

If the authoring tool provides authors with the ability to add or modify web content in such a way that a WCAG 2.0 success criterion can be violated, then accessibility checking for that success criterion is provided (e.g., an HTML authoring tool that inserts images should check for alternative text; a video authoring tool with the ability to edit text tracks should check for captions). (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: Checking assistance (WCAG Level A) is present in less-restrictive authoring tools. [@@JR updated]

  1. Determine whether the authoring tool allows authors to open/paste-in pre-existing content (i.e., Comprehensive non-accessible test content (Level A)). If this is not possible, then select SKIP.
  2. Search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
  3. Run the checker (if the checker is manual, this will entail following ALL checking instructions). If the checker provides detail about individual errors then you can open/paste-in all of the Comprehensive non-accessible test content (Level A) at once. If the checker provides only aggregate results, open/paste-in the Comprehensive non-accessible test content (Level A) one piece at a time.
  4. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0002 Assertion: Checking assistance (WCAG Level AA) is present in less-restrictive authoring tools. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

  1. Determine whether the authoring tool allows authors to open/paste-in pre-existing content (i.e., Comprehensive non-accessible test content (Level AA)). If this is not possible, then select SKIP.
  2. Search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
  3. Run the checker (if the checker is manual, this will entail following ALL checking instructions). If the checker provides detail about individual errors then you can open/paste-in all of the Comprehensive non-accessible test content (Level AA) at once. If the checker provides only aggregate results, open/paste-in the Comprehensive non-accessible test content (Level AA) one piece at a time.
  4. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0003 Assertion: Checking assistance (WCAG Level AAA) is present in less-restrictive authoring tools. (Note: Only shown if the user has specified AAA as the target level)[@@JR updated]

  1. Determine whether the authoring tool allows authors to open/paste-in pre-existing content (i.e., Comprehensive non-accessible test content (Level AAA)). If this is not possible, then select SKIP.
  2. Search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
  3. Run the checker (if the checker is manual, this will entail following ALL checking instructions). If the checker provides detail about individual errors then you can open/paste-in all of the Comprehensive non-accessible test content (Level AAA) at once. If the checker provides only aggregate results, open/paste-in the Comprehensive non-accessible test content (Level AAA) one piece at a time.
  4. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0004 Assertion: Checking assistance (WCAG Level A) is present in more-restrictive authoring tools. [@@JR updated]

  1. If the authoring tool allows allow authors to open/paste-in pre-existing content, select SKIP.
  2. Using Comprehensive non-accessible test content (Level A) as a guide, attempt to create accessibility problems using the authoring tool. If this is not possible due to authoring restrictions (such as highly limited editing scope or compulsory fields), then select SKIP.
  3. If accessibility problems have been added to the content, search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
  4. Run the checker (if the checker is manual, this will entail following ALL checking instructions.
  5. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0005 Assertion: Checking assistance (WCAG Level AA) is present in more-restrictive authoring tools. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

  1. If the authoring tool allows allow authors to open/paste-in pre-existing content, select SKIP.
  2. Using Comprehensive non-accessible test content (Level AA) as a guide, attempt to create accessibility problems using the authoring tool. If this is not possible due to authoring restrictions (such as highly limited editing scope or compulsory fields), then select SKIP.
  3. If accessibility problems have been added to the content, search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
  4. Run the checker (if the checker is manual, this will entail following ALL checking instructions.
  5. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0006 Assertion: Checking assistance (WCAG Level AAA) is present in more-restrictive authoring tools. (Note: Only shown if the user has specified AAA as the target level)[@@JR updated]

  1. If the authoring tool allows allow authors to open/paste-in pre-existing content, select SKIP.
  2. Using Comprehensive non-accessible test content (Level AAA) as a guide, attempt to create accessibility problems using the authoring tool. If this is not possible due to authoring restrictions (such as highly limited editing scope or compulsory fields), then select SKIP.
  3. If accessibility problems have been added to the content, search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
  4. Run the checker (if the checker is manual, this will entail following ALL checking instructions.
  5. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

B.3.1.2 Help Authors Decide:

If the authoring tool provides checks that require authors to decide whether a potential web content accessibility problem (WCAG) is correctly identified (i.e., manual checking and semi-automated checking), then instructions are provided from the check that describe how to decide. (Level A)

 

Test 0001 Assertion: Checking assistance (WCAG Level A) includes help to decide whether potential issues are actual issues, if user judgement is required. [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the checker automatically identifies all of the issues, the select SKIP.
  3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether support of some kind (e.g. instructions) is provided in each case to help the user make the required decision. If such support is always provided, then select PASS, otherwise select FAIL.

Test 0002 Assertion: Checking assistance (WCAG Level AA) includes help to decide whether potential issues are actual issues, if user judgement is required. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level AA-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the checker automatically identifies all of the issues, the select SKIP.
  3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether support of some kind (e.g. instructions) is provided in each case to help the user make the required decision. If such support is always provided, then select PASS, otherwise select FAIL.

Test 0003 Assertion: Checking assistance (WCAG Level AAA) includes help to decide whether potential issues are actual issues, if user judgement is required. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level AAA-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the checker automatically identifies all of the issues, the select SKIP.
  3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether support of some kind (e.g. instructions) is provided in each case to help the user make the required decision. If such support is always provided, then select PASS, otherwise select FAIL.

B.3.1.3 Help Authors Locate:

If the authoring tool provides checks that require authors to decide whether a potential web content accessibility problem (WCAG) is correctly identified (i.e., manual checking and semi-automated checking), then the relevant content is identified to the authors. (Level A)

  • Note: Depending on the nature of the editing-view and the scope of the potential web content accessibility problem (WCAG), identification might involve highlighting elements or renderings of elements, displaying line numbers, or providing instructions.

Test 0001 Assertion: Checking assistance (WCAG Level A) includes help to locate potential issues if user judgement is required. [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the checker automatically identifies all of the issues, then select SKIP.
  3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether a mechanism of some kind (e.g. hyperlink to the location, identification by line number, instructions on how to locate, etc.) is provided in each case to help the user determine where the potential issue is located within the content. If such a mechanism is always provided, then select PASS, otherwise select FAIL.

Test 0002 Assertion: Checking assistance (WCAG Level AA) includes help to locate potential issues if user judgement is required. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level AA-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the checker automatically identifies all of the issues, then select SKIP.
  3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether a mechanism of some kind (e.g. hyperlink to the location, identification by line number, instructions on how to locate, etc.) is provided in each case to help the user determine where the potential issue is located within the content. If such a mechanism is always provided, then select PASS, otherwise select FAIL.

Test 0003 Assertion: Checking assistance (WCAG Level AAA) includes help to locate potential issues if user judgement is required. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level AAA-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the checker automatically identifies all of the issues, then select SKIP.
  3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether a mechanism of some kind (e.g. hyperlink to the location, identification by line number, instructions on how to locate, etc.) is provided in each case to help the user determine where the potential issue is located within the content. If such a mechanism is always provided, then select PASS, otherwise select FAIL.

B.3.1.4 Status Report:

If the authoring tool provides checks, then authors can receive an accessibility status report based on the results of the accessibility checks. (Level AA)

  • Note: The format of the accessibility status report is not specified and they might include a listing of problems detected or a WCAG 2.0 conformance level, etc.

Test 0001 Assertion: Accessibility status reporting is present. [@@JR updated]

  1. Examine the checking functionality identified for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the checking functionality does not result in any information being returned to the author about accessibility issues, then select FAIL.
  3. If the information returned is gathered together in some way (e.g., a conformance statement, a list of accessibility problems, etc.), then select PASS.

B.3.1.5 Programmatic Association of Results:

If the authoring tool provides checks, then the authoring tool can programmatically associate accessibility checking results with the web content that was checked. (Level AA)

Test 0001 Assertion: Checking results can be programmatically associated to the content. [@@JR updated]

  1. Examine the checking functionality identified for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. Examine the checking functionality (including settings and documentation) to see if it includes any functionality that allows the results of the checking to be programmatically associated with the content (e.g. as a file containing the checking results that includes a hyperlink back to the checked content).
  3. If the checking results can be programmatically associated with the content, then select PASS. Otherwise, select FAIL.
Guideline B.3.2: Assist authors in repairing accessibility problems. Tests

B.3.2.1 Repair Assistance (WCAG):

If checking (see Success Criterion B.3.1.1) can detect that a WCAG 2.0 success criterion is not met, then repair suggestion(s) are provided: (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: Checking assistance (WCAG Level A) includes help to repair all detected issues. [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the authoring tool automatically repairs all identified issues, then select SKIP.
  3. For each identified issue, that is not automatically fixed:
    1. Check whether support of some kind (e.g. dialog with repair options, instructions on how to repair, etc.) is provided. If it is, go on to the next issue.
    2. If no support is provided, then select FAIL.
  4. Select PASS (all of the issues must have repair support)

Test 0002 Assertion: Checking assistance (WCAG Level AA) includes help to repair all detected issues. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the authoring tool automatically repairs all identified issues, then select SKIP.
  3. For each identified issue, that is not automatically fixed:
    1. Check whether support of some kind (e.g. dialog with repair options, instructions on how to repair, etc.) is provided. If it is, go on to the next issue.
    2. If no support is provided, then select FAIL.
  4. Select PASS (all of the issues must have repair support)

Test 0003 Assertion: Checking assistance (WCAG Level AAA) includes help to repair all detected issues. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

  1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
  2. If the authoring tool automatically repairs all identified issues, then select SKIP.
  3. For each identified issue, that is not automatically fixed:
    1. Check whether support of some kind (e.g. dialog with repair options, instructions on how to repair, etc.) is provided. If it is, go on to the next issue.
    2. If no support is provided, then select FAIL.
  4. Select PASS (all of the issues must have repair support)
PRINCIPLE B.4: Authoring tools must promote and integrate their accessibility features Tests
Guideline B.4.1: Ensure the availability of features that support the production of accessible content. Tests

B.4.1.1 Features Active by Default:

All accessible content support features are turned on by default. (Level A)

 

Test 0001 Assertion: All accessible content support features are turned on by default. [@@JR updated]

  1. Create or retrieve the List of Accessible Content Support Features (the "List')
  2. For each feature on the "List":
    1. If the feature is "always on", go on to the next feature.
    2. If the feature can be turned off, check whether it is on by default. If it is, go on to the next feature.
    3. If the future is off by default, then then select FAIL.
  3. Select PASS (all of the accessible content support features must have passed)

B.4.1.2 Option to Reactivate Features:

If authors can turn off an accessible content support feature, then they can turn the feature back on. (Level A)

Test 0001 Assertion: All accessible content support features that can be turned off, can also be turned back on. [@@JR updated]

  1. Retrieve or create the List of Accessible Content Support Features (the "List").
  2. For each feature on the "List":
    1. Determine whether the feature can be turned off. If not, go on to the next feature.
    2. Turn off the feature and then check whether it can be turned back on. If it can be turned back on, go on to the next feature.
    3. If the feature cannot be turned back on, then select FAIL.
  3. Select PASS (all of the accessible content support features must have passed)

B.4.1.3 Feature Deactivation Warning:

If authors turn off an accessible content support feature, then the authoring tool informs them that this may increase the risk of content accessibility problems (WCAG). (Level AA)

Test 0001 Assertion: All accessible content support features that can be turned off include a warning of the potential consequences. [@@JR updated]

  1. Retrieve or create the List of Accessible Content Support Features (the "List").
  2. For each feature on the "List":
    1. Determine whether the feature can be turned off. If not, go on to the next feature.
    2. If it can be turned off, turn it off and check for any type of warning (text, icon, pop-up, etc.), before and/or after the feature is turned off, explaining that turning off the feature may increase the risk of accessibility problems being introduced. If a warning is present, go on to the next feature.
    3. If no warning is presented, then select FAIL.
  3. Select PASS (all of the accessible content support features must have passed)

B.4.1.4 Feature Prominence:

All accessible content support features are at least as prominent as features related to either invalid markup, syntax errors, spelling errors or grammar errors. (Level AA)

Test 0001 Assertion: Content support features are as prominent as features related to either invalid markup, syntax errors, spelling errors or grammar errors. [@@JR updated]

  1. Retrieve or create the List of Accessible Content Support Features (the "List").
  2. For each feature on the List:
    1. Identify whether the feature is comparable to another feature of the authoring tool related to either invalid markup, syntax errors, spelling errors, or grammar errors (e.g., an accessibility checker is comparable with a spell checker). If there is no comparable feature, go on to the next feature.
    2. If there is a comprable feature, for both the accessible feature and its comparator-feature, determine how many "opening actions" are required to access each. "Opening actions" are actions made by authors on components within the user interface that result in new components becoming displayed or enabled. (e.g., keyboard shortcut to a top-level menu item to display a sub-menu, keyboard selection on a button to display a dialog box, mouse click on a checkbox to enable previously disabled sub-items, etc. Actions that do not cause new components to become actionable (e.g., moving focus, scrolling a list), are not counted as "opening actions".)
    3. If the accessible content support feature requires the same or less "opening actions", go on to the next feature.
    4. If the comparator feature requires less "opening actions", then select FAIL.
  3. Select PASS (all of the accessible content support features must have passed)
Guideline B.4.2: Ensure that documentation promotes the production of accessible content. Tests

B.4.2.1 Model Practice (WCAG):

A range of examples in the documentation (e.g., markup, screen shots of WYSIWYG editing-views) demonstrate accessible authoring practices (WCAG). (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: At least two examples of Level A accessible authoring practices appear in the documentation. (Note: Only shown if the user has specified A as the target level) [@@JR updated]

  1. Locate the authoring tool's documentation.
  2. Locate examples of authoring practice being used in the documentation (e.g. examples of markup, screenshots, etc.).
  3. Referring to the Web Content Accessibility Test Procedure (Level A), determine whether the demonstrated authoring practice would meet WCAG 2.0 Level A (e.g. if an image insertion dialog box is shown with an inappropriately empty alt field).
  4. If two practices can be found that would meet WCAG 2.0 Level A, select PASS. Otherwise, select FAIL.

Test 0002 Assertion: At least two examples of Level AA accessible authoring practices appear in the documentation. (Note: Only shown if the user has specified AA as the target level) [@@JR updated]

  1. Locate the authoring tool's documentation.
  2. Locate examples of authoring practice being used in the documentation (e.g. examples of markup, screenshots, etc.).
  3. Referring to the Web Content Accessibility Test Procedure (Level AA), determine whether the demonstrated authoring practice would meet WCAG 2.0 Level AA (e.g. if an image insertion dialog box is shown with an inappropriately empty alt field).
  4. If two practices can be found that would meet WCAG 2.0 Level AA, select PASS. Otherwise, select FAIL.

Test 0003 Assertion: At least two examples of Level AAA accessible authoring practices appear in the documentation. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

  1. Locate the authoring tool's documentation.
  2. Locate examples of authoring practice being used in the documentation (e.g. examples of markup, screenshots, etc.).
  3. Referring to the Web Content Accessibility Test Procedure (Level AAA), determine whether the demonstrated authoring practice would meet WCAG 2.0 Level AAA (e.g. if an image insertion dialog box is shown with an inappropriately empty alt field).
  4. If two practices can be found that would meet WCAG 2.0 Level AAA, select PASS. Otherwise, select FAIL.

B.4.2.2 Feature Instructions:

Instructions for using any accessible content support features appear in the documentation. (Level A)

Test 0001 Assertion: Instructions for using any accessible content support features appear in the documentation. [@@JR updated]

  1. Search the authoring tool user interface (and linked support material) for documentation (e.g. a help system)
  2. If no documentation can be found, then select FAIL.
  3. Retrieve or create the List of Accessible Content Support Features (the "List").
  4. For each feature on the "List":
    1. If the feature does have instructions in the documentation, go on to the next feature.
    2. If the feature does have instructions in the documentation, then select FAIL.
  5. Select PASS (all of the accessible content support features must have passed)

B.4.2.3 Tutorial:

The authoring tool provides a tutorial for an accessible authoring process that is specific to that authoring tool. (Level AAA)

Test 0001 Assertion: The authoring tool provides a tutorial for an accessible authoring process that is specific to that authoring tool. [@@JR updated]

  1. Search the authoring tool user interface (and linked support material) for a step-by-step tutorial explaining how to use the tool to produce accessible web content.
  2. If no accessibility-related tutorials can be found, then select FAIL.
  3. If one or more accessibility-related tutorials are found, review the tutorials checking whether any of the tutorials are specific to the authoring tool or whether they only treat the subject generally (such that the tutorials could equally serve as a tutorial for a different authoring tool).
  4. If any of the tutorials is specific to the authoring tool , then select PASS. Otherwise, select FAIL.

B.4.2.4 Instruction Index:

The authoring tool documentation contains an index to the instructions for using any accessible content support features. (Level AAA)

Test 0001 Assertion: The authoring tool documentation contains an index to the instructions for using any accessible content support features. [@@JR updated]

  1. Search the authoring tool user interface (and linked support material) for an instruction index (e.g. "Search Help", list of help topics, etc.).
  2. If no index can be found, then select FAIL.
  3. Retrieve or create the List of Accessible Content Support Features (the "List").
  4. For each feature on the "List":
    1. If the feature does not have instructions in the documentation, go on to the next feature.
    2. If the feature does have instructions in the documentation, and is reachable from the index, go on to the next feature.
    3. If the feature does have instructions in the documentation, but is not reachable from the index, then select FAIL.
  5. Select PASS (all of the accessible content support features must have passed)