<shadi> presnt+

Assessment Methodology Development

https://github.com/w3c/aria-at/wiki/Assessment-Methodology

<shimizuyohta> https://github.com/w3c/aria-at/wiki/Assessment-Methodology

Perhaps report incorrect support as an entity separate from full/partial/not supported

Perhaps characterize tests by their impact, e.g. essential, non-essential, or min required or ideal

Could be used to say partial support is adequate for some aspect of usage

MF: tie essential to "must" and non-essential could be "should" and "may"

Each assertion could be categorized as must, should, or may.

If all musts are met, the A/T provides minimum support.

<michael_fairchild> https://docs.google.com/document/d/1MjRfDq9_bhjqinyCJh62MJde1ykp3ai0TcpEPGn6xeI/edit?usp=sharing

jf: Do we want the assertions to be A/T agnostic?

mf: hesitant to mention specific a/t b/c we don't want to be perceived as telling a/t what to do.
... we could make the assertions a/t agnostic by categorizing them as must/should/may

mk: some assertions need to be conditionally worded, e.g., if the a/t has a command for describing position in a table, xyz must be true when that command is issued by the user.

discuss how to handle configuration dependencies.

Is it supported if a switch has to be turned on by the user.

mk: proposal: make some assertions conditional based on a setting.
... example: If the a/t has config option for auto announcing property A, it must do xyz if it is on, and must not do xyz if it is off.

mf: make assertions independent of example context to help devs understand what is expected regardless of context.

Discussion of how keyboard commands effect number of assertions.

jg: What do you do with incorrect help messages provided by a/t.

VO says ctrl-opt-space to open the menu and it does not work.

This is scribe.perl Revision: 1.154  of Date: 2018/09/25 16:35:56  
Check for newer version at http://dev.w3.org/cvsweb/~checkout~/2002/scribe/

Guessing input format: Irssi_ISO8601_Log_Text_Format (score 1.00)

Present: matt-king michael_fairchild shadi jon-gunderson yota
No ScribeNick specified.  Guessing ScribeNick: mck
Inferring Scribes: mck

WARNING: No date found!  Assuming today.  (Hint: Specify
the W3C IRC log URL, and the date will be determined from that.)
Or specify the date like this:
<dbooth> Date: 12 Sep 2002

People with action items: 

WARNING: IRC log location not specified!  (You can ignore this 
warning if you do not want the generated minutes to contain 
a link to the original IRC log.)