Test WebConf

From Web of Things Interest Group

Suspended

Testing topics will be covered in the Plugfest call... please use the plugfest call in time and webex, not the one below.

WebEx

IRC

The IRC is used for the minutes, speaker queue, and sharing links etc.

Actions

  • Logistics
    • To discuss: github sites for test suites, etc.
  • Charter review
  • Normative assertions
    • Script done
    • Deliverables still need to be marked up
  • Test descriptions
    • Template?
  • Scripting API testing plan
    • In Scripting API TF
  • Thing Description testing plan
    • In Thing Description TF
  • Security testing plan
    • In Security TF
  • Online Test Things

Agenda 25 July 2018

  • Review of Minutes
  • Plugfest Result Documents
  • Test Planning Document
  • Normative Assertions and Extraction
  • Other

Agenda 4 June 2018

Agenda 30 May 2018

Agenda 23 May 2018

  • Review of Minutes
  • Progress against plan
  • Tools
  • Interop Testing
    • F-Interop Project (David)
  • Other
    • Oracle simulator; do walkthrough in next Testing meeting?
    • Will reach out to F-Interop and try to arrange for a demo of an existing system
    • New time for call; doodle, but Editor timeslot as fallback, starting next week

Agenda 16 May 2018

  • Review of Minutes
  • Progress against plan
  • Extraction of normative statements
    • Format?
  • Tools
  • Online test systems
    • Role of simulation
  • Other

Agenda 9 May 2018

  • Review of Minutes
  • Progress against plan
    • Specification assertion language (done, location to be standardized)
    • Normative assertions (wip)
    • Next: Extraction of normative statements
  • Online test things
  • Plugfest planning
  • Other

Agenda 2 May 2018

  • Progress against plan
    • Specification assertion language
    • Normative assertions
  • Categories of "testing"
    • Specification validation
      • Consistent, unambiguous, and implementable normative assertions
      • Security review
    • Implementation testing
      • Scripting API
      • TD validation
        • Implementations expose correct TDs
      • Network interfaces described by TDs
        • Include tests of security (authentication/authorization) implementations
    • Interop testing
      • Two separate implementations working together
      • Application servients
    • Security testing
      • Adversarial testing, eg. penetration testing, etc. using web service tools
  • Role of reference implementations
    • Online things - continuous "plugfest" testing
    • Offline repeatable test installations
    • Client vs server testing
    • Validation tools
  • Plugfest planning
    • Going into plugfest:
      • Normative assertions
      • Test descriptions
    • Do at plugfest/F2F:
      • Test suite organization
      • Test implementations (based on test descriptions vs features)
    • Going out of plugfest:
      • Test suite skeleton
      • Representative subset of tests implemented

Pending Agenda Items (with Deadlines)

  • Testing plan template (outline)

Future Agenda Items

  • To be added

Resources

  • To be added

Meeting Minutes

2018