Conformance
by Christine Hoffman
Introduction
- QA role
- What is conformance testing?
- Ensuring that the product is compliant with specifications
- W3C specifications for HTML, CSS, XML, XHTML, DOM
- Challenges
- Infinite testing scope
- Key is to test effectively
Effective Testing
- Create a test design
- Overall strategic test plan
- Project description
- Goals/schedules/resources/coverage/testcases/bug criteria/contingencies
- Individual component test plans
- Strategy/approach
- Areas to be tested, not tested
- Specifications
- Types of testing
- Syntax - invalid condition testing on each parameter and delimiter
- Automation
- Acceptance
- Functional
- Simple functionality - valid/invalid data
- Complex functionality - valid/invalid data
- Equivalence classes - technique for testcase reduction
- Boundaries - test all sides of equivalence classes
- Stress
- Regression
- Ad hoc
- Contingencies
- Create testcases
- Characterisistics of a good testcase
- Test has a reasonable probability of catching an error
- Test is not redundant
- Test is more effective than others
- Bug tracking
Conformance Metric Needs
- Independent organization to define common test conditions for conformance testing
- Testing methodology
- Degree of conformance
- Equivalence classes/boundary checkpoints
- Test suites
- Automation tools