PlugFest WebConf

The WoT Plugfest/Testing task force is responsible for organizing the Web of Things (WoT) Plugfests and also for organizing general testing procedures, data collection, and implementation report tooling for WoT deliverables.

WebConf Information

• Quick start guide for W3C teleconferences
• Table of all the WoT calls on our Web page
• W3C WG Calendar
• Main WoT WebConf
• Scripting APIs | Security | Discovery | Marketing | Use Cases | PlugFest/Testing | TD | Architecture | Profile

Repositories

Testing and plugfest materials are located at https://github.com/w3c/wot-testing

Call Logistics

• Time: Wednesdays at 9am US Eastern / 3pm Europe / 11pm Japan
  • NOTE: We may start at 15 past if the main call goes long.
• Zoom: please refer to W3C Calendar
• Note this is now a separate call from the Main call!

IRC

• IRC #wot-pf channel
• Custom clients: irc.w3.org, port 6667

The IRC is used for the minutes, speaker queue, and sharing links etc.

Actions

• Organize wot-test repo (McCool)
  • Copy over existing material from wot repo
• Generate feature lists to abstract assertions, cover "informative" features, like use of MQTT, etc.
  • Copy over and improve implementation report generation scripts from wot-thing-description
• Improve and generalize implementation report generation scripts (McCool)
• Capture implementation descriptions in formal CSV tables
  • Include and generate report on interoperability testing
• Plan Helsinki plugfest
  • Include formal data capture plans, including for conformance and interoperability
• Finalize technical requirements
• Set up remote access links, eg WebEx, Google hangouts, etc.
• Capture more examples that can be shared
  • Link to wotify.org and other examples from wot-testing
  • Add links to formal implementation CSV files
  • Capture information on both producers and consumers, e.g. mashups in Node-RED
    • Even just screenshots
• Improve test tools
  • E.g. scripts to "exercise" a device, use UI to confirm actions, etc.
  • See https://github.com/tum-esi/testbench - connect to impl/plugfest report
  • Standardize setup for implementations so they can be reproduced easily
  • Use semantics to guide testing; special vocab for testing?
• Create procedure/template for Plugfest implementation preparation
  • Passwords, network setup, how to document implementations (incl authentication), behavior, etc.
  • Add link to documentation from CSV table, archive documentation in wot-testing

Action Items

• Organize 2022.07 testfest
  • https://github.com/w3c/wot-testing/issues/297 - tasks
• Update manual.csv template (Fady)
  • https://github.com/w3c/wot-testing/issues/292
• Regenerating Results (mccool)
  • update script to capture results from previous years/plugfests
    • Will keep old results separate, add prefix to results files with dates, etc.
  • install playground
  • run batch script
  • copy results to TD repo (keep files separate for older results)
  • regen IRs
  • see process.md for instructions (ege to update)
• https://github.com/w3c/wot-testing/issues/265

Agendas

Agenda 20.11.2024

• Chair: Sebastian
• Scribe: Ege

• Information for non-W3C members
  • W3C Patent Policy 2020 for both the WoT-WG and the WoT-IG
  • Patent Policy FAQ - Q6

• IRC for minutes and queue rules
  • please login in https://webirc.w3.org/#/connect?channels=wot-pf
  • if you have a question or comment please put yourself in the queue by entering "q+" in the command line

• Logistics:
  • please register and use the plugfest mailing list: group-wot-plugfest@w3.org
    • please contact Kaz to be part in the mailing list
  • minutes from Nov 13
  • latest agenda plan and list of participants: https://www.w3.org/WoT/IG/wiki/Wiki_for_WoT_Week_2024_planning#Agenda_%28Draft%29
  • Technical organization happens at https://github.com/w3c/wot-testing/tree/main/events/2024.11.Munich
  • please register for the WoT conference here
• Status of the PlugFest VPN network
  • VPN test will happen tomorrow
  • Switches and long ethernet cables are arranged: https://github.com/w3c/wot-testing/pull/604
  • PR on the VPN instructions: https://github.com/w3c/wot-testing/pull/589
• TD Testing has been fixed. Let the TDs rain!
  • Any new TD submission can be accepted async if the TDs are valid. Do not overwrite other people's TDs.
  • Group per implementation not necessarily per organization.
  • Link to it from md file: See example at OpenFlexure Microscope
• Presentation of the PlugFest/Demos for WoT Conference on Wednesday
  • there should be 1 slide provided for stage presentation
  • there is the opportunity to show a poster (max. A1 size in vertical view) at the demo place
  • there will be a templates provided (please see Wednesday agenda)
• New PRs
  • Conveyor Belt and Small Robot arm: https://github.com/w3c/wot-testing/pull/603
  • More Siemens Devices: https://github.com/w3c/wot-testing/pull/602
• Discussion on Scenarios
  • Extending https://github.com/w3c/wot-testing/blob/main/events/2024.11.Munich/Readme.md#wip---user-scenarios

Agenda 13.11.2024

• Chair: Ege
• Scribe: Jan

• Information for non-W3C members
  • W3C Patent Policy 2020 for both the WoT-WG and the WoT-IG
  • Patent Policy FAQ - Q6

• IRC for minutes and queue rules
  • please login in https://webirc.w3.org/#/connect?channels=wot-pf
  • if you have a question or comment please put yourself in the queue by entering "q+" in the command line

• Logistics:
  • please register and use the plugfest mailing list: group-wot-plugfest@w3.org
    • please contact Kaz to be part in the mailing list
  • minutes from Oct 30
  • latest agenda plan and list of participants: https://www.w3.org/WoT/IG/wiki/Wiki_for_WoT_Week_2024_planning#Agenda_%28Draft%29
  • Technical organization happens at https://github.com/w3c/wot-testing/tree/main/events/2024.11.Munich
  • please register for the WoT conference here
• Status of the PlugFest VPN network
  • VPN test will happen tomorrow
  • Switches and long ethernet cables are arranged: https://github.com/w3c/wot-testing/pull/604
  • PR on the VPN instructions: https://github.com/w3c/wot-testing/pull/589
• TD Testing has been fixed. Let the TDs rain!
  • Any new TD submission can be accepted async if the TDs are valid. Do not overwrite other people's TDs.
  • Group per implementation not necessarily per organization.
  • Link to it from md file: See example at OpenFlexure Microscope
• Presentation of the PlugFest/Demos for WoT Conference on Wednesday
  • there should be 1 slide provided for stage presentation
  • there is the opportunity to show a poster (max. A1 size in vertical view) at the demo place
  • there will be a templates provided
    • please use the slide template for the pitch
    • please use the poster template for the demo presentation at your table/booth (tbc)
• New PRs
  • Conveyor Belt and Small Robot arm: https://github.com/w3c/wot-testing/pull/603
  • More Siemens Devices: https://github.com/w3c/wot-testing/pull/602
• Discussion on Scenarios
  • Extending https://github.com/w3c/wot-testing/blob/main/events/2024.11.Munich/Readme.md#wip---user-scenarios

Agenda 06.11.2024

• Chair: Sebastian
• Scribe: Fady

• Information for non-W3C members
  • W3C Patent Policy 2020 for both the WoT-WG and the WoT-IG
  • Patent Policy FAQ - Q6

• IRC for minutes and queue rules
  • please login in https://webirc.w3.org/#/connect?channels=wot-pf
  • if you have a question or comment please put yourself in the queue by entering "q+" in the command line

• Agenda:
  • please register and use the plugfest mailing list: group-wot-plugfest@w3.org
    • please contact Kaz to be part in the mailing list
  • minutes from Oct 30
  • latest agenda plan and list of participants: https://www.w3.org/WoT/IG/wiki/Wiki_for_WoT_Week_2024_planning#Agenda_%28Draft%29
  • Technical organization happens at https://github.com/w3c/wot-testing/tree/main/events/2024.11.Munich
  • please register for the WoT conference here
  • Status of the PlugFest VPN network (Ege/Toumura/Min)
    • Toumara-san started to test the VPN network this week
  • Presentation of the PlugFest/Demos for WoT Conference on Wednesday
    • there should be 1 slide provided for stage presentation
    • there is the opportunity to show a poster (max. A1 size in vertical view) at the demo place
    • there will be a templates provided
      • please use the slide template for the pitch
      • please use the poster template for the demo presentation at your table/booth (tbc)
  • number of tables are needed for Wednesday

Agenda 30.10.2024

• Chair: Sebastian
• Scribe: McCool

• Information for non-W3C members
  • W3C Patent Policy 2020 for both the WoT-WG and the WoT-IG
  • Patent Policy FAQ - Q6

• IRC for minutes and queue rules
  • please login in https://webirc.w3.org/#/connect?channels=wot-pf
  • if you have a question or comment please put yourself in the queue by entering "q+" in the command line

• Agenda:
  • minutes from Oct 23
  • latest agenda plan and list of participants: https://www.w3.org/WoT/IG/wiki/Wiki_for_WoT_Week_2024_planning#Agenda_%28Draft%29
  • Technical organization happens at https://github.com/w3c/wot-testing/tree/main/events/2024.11.Munich
  • please register for the WoT conference here
  • Status of the PlugFest VPN network (Ege/Toumura/Min)
    • Toumara-san started to test the VPN network this week
  • Presentation of the PlugFest/Demos for WoT Conference on Wednesday
    • there should be 1 slide provided for stage presentation
    • there is the opportunity to show a poster (max. A1 size in vertical view) at the demo place
    • there will be a template provided soon
  • number of tables are needed for Wednesday

Agenda 23.10.2024

• Chair: Sebastian
• Scribe: Mahda

• Information for non-W3C members
  • W3C Patent Policy 2020 for both the WoT-WG and the WoT-IG
  • Patent Policy FAQ - Q6

• IRC for minutes and queue rules
  • please login in https://webirc.w3.org/#/connect?channels=wot-pf
  • if you have a question or comment please put yourself in the queue by entering "q+" in the command line

• Agenda:
  • minutes from Oct 16
  • latest agenda plan and list of participants: https://www.w3.org/WoT/IG/wiki/Wiki_for_WoT_Week_2024_planning#Agenda_%28Draft%29
  • Technical organization happens at https://github.com/w3c/wot-testing/tree/main/events/2024.11.Munich
  • Status of the PlugFest VPN network (Ege/Toumura/Min)
    • Toumara-san started to test the VPN network this week
  • Presentation of the PlugFest/Demos for WoT Conference on Wednesday
    • there should be 1 slide provided for stage presentation
    • there is the opportunity to show a poster (max. A1 size in vertical view) at the demo place

Agenda 16.10.2024

• Chair: Sebastian
• Scribe: Michael Koster

• Agenda:
  • minutes from September 18
  • latest agenda plan and list of participants: https://www.w3.org/WoT/IG/wiki/Wiki_for_WoT_Week_2024_planning#Agenda_%28Draft%29
  • Technical organization happens at https://github.com/w3c/wot-testing/tree/main/events/2024.11.Munich
  • Pull Requests:
    • VPN Configuration
    • Folder Reorganization

Agenda 18.09.2024

• Chair: Ege
• Date: Sept 18
• Scribe: Luca

• Agenda:
  • minutes from August 7
  • latest agenda plan and list of participants: https://www.w3.org/WoT/IG/wiki/Wiki_for_WoT_Week_2024_planning#Agenda_%28Draft%29
  • Technical organization happens at https://github.com/w3c/wot-testing/tree/main/events/2024.11.Munich
  • Pull Requests:
    • VPN Configuration
    • Folder Reorganization

Agenda 31.05.2023

Chair: McCool

Scribe: Kaz

• Minutes:
  • https://www.w3.org/2023/05/24-wot-pf-minutes.html
• Review Draft IRs
  • https://github.com/w3c/wot-discovery/pull/496 (already merged)
  • https://github.com/w3c/wot-architecture/pull/920
  • https://github.com/w3c/wot-thing-description/pull/1835
• AOB

Agenda 24.05.2023

Chair: McCool

Scribe: Ege

• Minutes:
  • https://www.w3.org/2023/05/17-wot-pf-minutes.html
• Review Draft IRs
  • https://github.com/w3c/wot-discovery/pull/494
  • https://github.com/w3c/wot-architecture/pull/916
  • https://github.com/w3c/wot-thing-description/pull/1830
• AOB

Agenda 17.05.2023

Chair: McCool

Scribe: Kaz

• Minutes:
  • https://www.w3.org/2023/05/03-wot-pf-minutes.html
  • https://www.w3.org/2023/04/27-wot-pf-minutes.html (Testfest Day 3)
  • https://www.w3.org/2023/04/26-wot-pf-minutes.html (Testfest Day 2)
  • https://www.w3.org/2023/04/25-wot-pf-minutes.html (Testfest Day 1)
• Review Issues
  • https://github.com/w3c/wot-testing/
  • Ege will review issues and propose resolutions
• No pending PRs
• Planning
  • Modifications to deliverables to retire at-risk items - McCool
  • Any other cleanup needed?
• AOB

Agenda 03.05.2023

Note: During Golden week, special case.

Chair: McCool

Scribe: Kaz

• Minutes:
  • Defer until next testing call
• Review new Test inputs
  • https://github.com/w3c/wot-testing/
• Planning
  • IR Report updates
  • Expected new results
  • Review priorities and deadlines
  • Define next steps
• AOB

Agenda 27.04.2023

Testfest - Day 3 - Using Architecture call logistics.

Chair: McCool

Scribe: Ege

• Minutes:
  • Defer until next testing call
• Review new Test inputs
  • https://github.com/w3c/wot-testing/
• Planning
  • IR Report updates
  • Expected new results
  • Review priorities and deadlines
  • Define next steps
• AOB

Agenda 26.04.2023

Testfest - Day 2 - Using Main (testing) call logistics.

Chair: McCool

Scribe: Ben

• Minutes:
  • Defer until next testing call
• Review new Test inputs
  • https://github.com/w3c/wot-testing/
• Planning
  • IR Report updates
  • Expected new results
  • Review priorities
• AOB

Agenda 25.04.2023

Testfest - Day 1 - Using Use Case call logistics.

Chair: McCool

Scribe: Ege

• Minutes:
  • Defer until next testing call
• Review new Test inputs
  • https://github.com/w3c/wot-testing/
• Planning
  • IR Report updates
  • Expected new results
  • Review priorities
• AOB

Agenda 19.04.2023

Chair: McCool

Scribe: Kaz

• Minutes
• Quick Updates
• Dev Meeting Post-mortem
• Testfest planning
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.Online
• Check PRs and Issues
• IR Updates
  • Architecture (3 at-risk items remaining)
  • TD (15 at-risk items remaining)
• AOB

Agenda 12.04.2023

Chair: McCool

Scribe: Ege

• Minutes
• Quick Updates
• Dev Meeting Planning
  • Slides
  • Advert
• Testfest planning
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.Online
• Check PRs and Issues
• AOB

Agenda 05.04.2023

Chair: McCool

Scribe: Cristiano

• Minutes
• Quick Updates
• Dev Meeting Planning
• Testfest planning
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.Online
• Check PRs and Issues
• AOB

Agenda 29.03.2023

Chair: McCool

Scribe: Ege

• Minutes
• Quick Updates
• Testfest Planning
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.Online
• Check PRs and Issues
• WoT At-Risk Assertion Resolution Meeting
  • Specifically to address at-risk items, not for general new devs
  • Work on https://github.com/w3c/wot-testing/tree/main/events/2023.03.DevMtg
  • TD: https://docs.google.com/presentation/d/1OZeLR0-qAw01R1UloTG25xQjc5LFuwvRP9o50QVo660/edit?usp=sharing
  • Arch: https://docs.google.com/presentation/d/16Ow5rPjnojdl693pqkOhoc5bNCBIMOYZvJQC9wHZGsk/edit?usp=sharing
• AOB

Agenda 22.03.2023

Chair: Ege

Scribe: Cristiano

• Minutes
• Quick Updates
• Check PRs and Issues
• WoT At-Risk Assertion Resolution Meeting
  • Specifically to address at-risk items, not for general new devs
  • Work on https://github.com/w3c/wot-testing/tree/main/events/2023.03.DevMtg
  • TD: https://docs.google.com/presentation/d/1OZeLR0-qAw01R1UloTG25xQjc5LFuwvRP9o50QVo660/edit?usp=sharing
  • Arch: https://docs.google.com/presentation/d/16Ow5rPjnojdl693pqkOhoc5bNCBIMOYZvJQC9wHZGsk/edit?usp=sharing
• Testfest
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.Online
• AOB

Agenda 15.03.2023

Chair: McCool

Scribe: Ege/Kaz

• Minutes
  • Feb 22, 2023 Minutes
• Quick Updates
• Check PRs and Issues
• Developer Meeting
  • Specifically to address at-risk items, not for general new devs
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.DevMtg
• Testfest
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.Online
• AOB

Agenda 22.02.2023

Chair: McCool

Scribe: Luca

• Minutes
  • Feb 8, 2023 Minutes
• Quick Updates
  • Playground
  • RTSP - Streaming, experimental for next charter
    • Also: RTMP, DASH, HLS, STC, WebRTC...
• Check PRs and Issues
• Developer Meeting
  • Specifically to address at-risk items, not for general new devs
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.DevMtg
• Testfest
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.Online
• Future Work
  • Plugfest report
• AOB

Agenda 08.02.2023

Chair: McCool

Scribe: Cristiano

• Minutes
  • Feb 1, 2023 Minutes
• Developer Meeting
  • https://github.com/w3c/wot-testing/tree/main/events/2023.03.DevMtg
  • Target dates:
    • EN: week of March 20
    • JP: week of March 27
• Testfest
  • To clear up corner cases in Arch, TD, and Discovery
  • To complete draft of Profile implementation report
• AOB

Agenda 01.02.2023

Chair: McCool

Scribe: Ege

• Minutes
  • Jan 25, 2023 Minutes
• Quick Updates
  • Playground bug-fixes
  • See also https://github.com/thingweb/thingweb-playground/pull/443
• PRs
• Plan At-Risk Walkthroughs
  • Prework
    • MD files/presentations explaining at-risk items
    • https://github.com/w3c/wot-testing/tree/main/events/2023.03.DevMtg
  • Developer meeting
    • Target date: week of March 20
  • Also JP version
    • Target date: week of March 27
  • Need clear policy for what it means to "pass" each at-risk assertion
• Profile testing
• AOB

Agenda 25.01.2023

Chair: McCool

Scribe: Ege

• Minutes
  • Dec 21, 2022 Minutes
• Testimonials
  • Draft email explaining template, giving an example, for forwarding to AC rep
• Implementation Reports
  • Tooling Issues
  • Gaps
  • Resolution plan
  • Another Testfest?
• AOB

Agenda 21.12.2022

Chair: McCool

Scribe: Ege

• Minutes
  • Dec 15, 2022 Minutes
  • Dec 14, 2022 Minutes
  • Dec 13, 2022 Minutes
  • Dec 12, 2022 Minutes
• Implementation Reports
  • Gaps
  • Improvements
• AOB

Agenda 15.12.2022

Testfest - Day 4

Chair: McCool

Scribe: Kaz

• Minutes
  • Dec 14, 2022 Minutes (defer)
  • Dec 13, 2022 Minutes (defer)
  • Dec 12, 2022 Minutes (defer)
• Quick Updates
  • Anything?
• Review PRs
  • Including already merged ones
• Implementation Report Updates
• Next Steps
• AOB

Agenda 14.12.2022

Testfest - Day 3

Chair: McCool

Scribe: Lagally

• Minutes
  • Dec 13, 2022 Minutes (defer)
  • Dec 12, 2022 Minutes (defer)
• Quick Updates
  • Already merged PRs - will review below
• Active Devices
• Implementation Report Updates
• Review PRs
• Next Steps
• AOB

Agenda 13.12.2022

Testfest - Day 2

Chair: McCool

Scribe: Ege

• Minutes
  • Dec 12, 2022 Minutes (defer)
• Quick Updates
  • Already merged PRs - will review below
• Active Devices
• Implementation Report Updates
• Review PRs
• Next Steps
• AOB

Agenda 12.12.2022

Testfest - Day 1

Chair: McCool

Scribe: Fady

• Minutes
  • Dec 7, 2022 Minutes
  • Nov 30, 2022 Minutes
• Quick Updates
  • Publication Schedule
• Logistics
  • Review instructions: https://github.com/w3c/wot-testing/tree/main/events/2022.12.Online/README.md
  • CSV files
  • Tools
• Review PRs
• AOB

Agenda 07.12.2022

Chair: McCool

Scribe: Fady

• Review Minutes
  • Nov 30, 2022 Minutes (defer)
• Test fest preparation
  • Review instructions
  • CSV change log script
  • CSV format updates
• AOB

Agenda 30.11.2022

Chair: McCool

Scribe: Sebastian

• Review Minutes
  • Nov 16, 2022 Minutes
• test fest preparation
  • logistics
  • testing data organization (CSV files, etc)
  • scenarios

Agenda 16.11.2022

Chair: Lagally

Scribe: Sebastian

• Review Minutes
  • Nov 09, 2022 Minutes

• Overall testing structure
• Continue the testing conversation wrt. profile
• manual vs. automated testing
• test fest preparation - scenarios

Agenda 09.11.2022

Chair: Lagally

Scribe: tbd.

• Review Minutes
  • Nov 02, 2022 Minutes
• Implementation Reports
  • Check at risk items
• Testfest/Plugfest planning
  • Schedule: Dec 12-16, times tbd.
  • Goals
  • Scenarios
• AOB

Agenda 02.11.2022

Chair: McCool

Scribe: Kaz

• Review Minutes
  • Oct 12, 2022 Minutes
• Implementation Reports
• Testfest/Plugfest planning
  • Schedule: Dec 12-16, times
  • Goals
  • Scenarios
• AOB

Agenda 12.10.2022

Chair: McCool

Scribe: Ege

• Review Testfest minutes
  • Testfest Day 1
  • Testfest Day 2
  • Testfest Day 3
  • Testfest Day 4
  • Testfest Day 5
• Review Implementation Reports
  • TD - Latest Draft Implementation Report
  • Discovery - Latest Draft Implementation Report
  • Architecture - Latest Draft Implementation Report
  • Profile - Latest Draft Implementation Report
• PRs
• Issues
• AOB

Agenda 07.10.2022

Testfest

Chair: McCool

Scribe: Sebastian

• PRs
• Possible useful tool: https://github.com/simonw/csv-diff
• Implementation Report Reviews
  • Architecture 1.1 (rendered)
  • Thing Description 1.1 (rendered)
  • Discovery (rendered)
  • Profile (rendered)
• Wrapup and next steps

Agenda 06.10.2022

Testfest

Chair: McCool

Scribe: Cristiano

• Tooling issues (Ege)
  • Two new assertions : tm-versioning-2 and tm-tmOptional-resolver
  • There is a PR in the TD spec that needs merging asap at https://github.com/w3c/wot-thing-description/pull/1715 since it helps with the tooling.
  • merged the automatic PR at https://github.com/w3c/wot-thing-description/pull/1699 since that was causing one part of the discrepancy with manual.csv
  • When we are generating the manual.csv, we need to put quotes around “everything”. For example, when we generate the word null for the value of Status, if we do not encapsulate it in quotes, it is understood as the JS specific null and nothing is printed to the manual.csv status value. Do quotes break your tools?
• PRs
• Implementation Reports
  • Review latest versions
  • Architecture 1.1
  • Thing Description 1.1
  • Discovery
  • Profile

Agenda 05.10.2022

Testfest

Chair: McCool

Scribe: Ege

• PRs
• Implementation Reports
  • Review latest versions
  • Architecture 1.1 (rendered)
  • Thing Description 1.1 (rendered)
  • Discovery (not updated - no new results)
  • Profile (not updated - no new results)

Agenda 04.10.2022

Testfest

Chair: McCool

Scribe: Lagally

• PRs
• Implementation Reports
  • Review latest versions
  • Architecture 1.1
  • Thing Description 1.1
  • Discovery
  • Profile
• Profile
  • Overview of implementations
  • Interoperability testing

Agenda 03.10.2022

Testfest

Chair: McCool

Scribe: Cristiano

• PRs
• Organization
  • https://github.com/w3c/wot-testing/tree/main/events/2022.09.Online
  • README
  • Results
  • Templates
  • Implementation Descriptions
  • Schedule
• AOB

Agenda 28.09.2022

Chair: McCool

Scribe: Cristiano

• Review Minutes
  • https://www.w3.org/2022/08/31-wot-pf-minutes.html
• October Testfest planning
  • https://github.com/w3c/wot-testing/tree/main/events/2022.09.Online
• AOB

Agenda 31.08.2022

Chair: McCool

Scribe: Kaz

• Review Minutes
  • https://www.w3.org/2022/08/10-wot-pf-minutes.html
• Architecture IR
• Post-TPAC Testfest
  • Week of Sept 26
  • Focus on Profile *testing*
  • Possible "consumer" testings for all TDs (e.g. node-wot and Node-RED trying to read all TDs).
  • Architecture should not need *additional* testing (in theory)
• AOB

Agenda 24.08.2022

Canceled.

Agenda 10.08.2022

Chair: McCool

Scribe: Ege

• Review Minutes
  • https://www.w3.org/2022/08/03-wot-pf-minutes.html
• Planning
  • Prep for CR Transition
    • Additional testing prior to CR/PR -> data/input_2022
    • Updated instructions (README, last testfest)/email (McCool)
    • Periodic merging and IR updates: daily
    • How to deal with changes to manual.csv e.g. when TD spec changes? Warnings from tooling for missing/obsolete/auto-manual/new changes?
    • batchValidation.sh had many missing -m options
    • still need many implementation descriptions (McCool drafts... then implementers can do fixes via PR suggestions)
  • Pre-TPAC Meeting
    • Sept 7 - resolutions for CR transition
    • Sept 5 should be deadline for CR transition IR and test results
  • Post-TPAC Testfest
    • Options: Sept 26-30; Oct 3-7; Oct 10-14; Oct 17-21 -> doodle
• Review recent testing results
  • TD - rendered - 39 at-risk; 15 with one implementation
  • Discovery - rendered - 56 at-risk; 10 with one implementation
  • Architecture - rendered
  • Profile - rendered
• AOB

Agenda 03.08.2022

Chair: McCool

Scribe: Fady

• Review Minutes (Testfest)
  • https://www.w3.org/2022/07/25-wot-pf-minutes.html
  • https://www.w3.org/2022/07/26-wot-pf-minutes.html
  • https://www.w3.org/2022/07/27-wot-pf-minutes.html
  • https://www.w3.org/2022/07/28-wot-pf-minutes.html
  • https://www.w3.org/2022/07/29-wot-pf-minutes.html
• Status Review
  • TD
  • Discovery
• AOB

Agenda 29.07.2022

Testfest - Day 5

Chair: McCool

Scribe: Cristiano

• Review Minutes
  • deferred
• PRs
• Implementation Reports
• Next Steps
  • Implementation Descriptions
  • Testimonials
  • Update todo.csv
  • Manual assertions
  • Assertion Review
    • Architecture
    • Security and Privacy
• AOB

Agenda 28.07.2022

Testfest - Day 4

Chair: McCool

Scribe: Ege

• Review Minutes
  • deferred
• PRs
• Implementation Reports
• Assertion Review
  • Architecture
  • Security and Privacy
• AOB

Agenda 27.07.2022

Testfest - Day 3

Chair: McCool

Scribe: Sebastian

• Review Minutes
  • deferred
• PRs
• Implementation Reports
• Assertion Review
  • Architecture
  • Security and Privacy
• AOB

Agenda 26.07.2022

Testfest - Day 2

Chair: McCool

Scribe: Sebastian

• Review Minutes
  • deferred
• PRs
  • PRs with new data already merged
• Implementation Reports
  • TD IR updated yesterday
  • Now running validation script on new inputs
• Assertion Review
  • Architecture
  • Security and Privacy
• AOB

Agenda 25.07.2022

Testfest - Day 1

Chair: McCool

Scribe: Kaz

• Review minutes
  • Will defer all until next week
• Logistics
• PRs
• Planning
  • Security and Privacy
  • Architecture
• AOB

Agenda 20.07.2022

Chair: McCool

Scribe: Ege

• Review minutes
  • https://www.w3.org/2022/07/13-wot-pf-minutes.html
• PRs
• Logistics
• Implementation Reports

Agenda 13.07.2022

Chair: McCool

Scribe: Philipp

• Review minutes
  • https://www.w3.org/2022/07/06-wot-pf-minutes.html
• PRs
• Logistics
  • July 25 - Testfest
  • August 29 - Plugfest
• Implementation Reports
  • Still missing implementation descriptions and testimonials

Agenda 06.07.2022

Chair: McCool

Scribe: Cristiano

• Review minutes
  • https://www.w3.org/2022/06/29-wot-pf-minutes.html
• PRs
• Logistics
  • July 25 - Testfest
  • August 29 - Plugfest
• Implementation Reports
  • Still missing implementation descriptions and testimonials

Agenda 29.06.2022

Chair: McCool

Scribe: Fady

• Review minutes
  • https://www.w3.org/2022/06/22-wot-pf-minutes.html
• PRs
• Plugfest logistics
  • Move to Week of July 25
• Implementation Reports
  • Manual test fixes in Discovery
  • TM testing issues still?
• To Dos
  • Still missing implementation descriptions and testimonials

Agenda 22.06.2022

Chair: McCool

Scribe:

• Review PF minutes
  • https://www.w3.org/2022/06/15-wot-pf-minutes.html
  • https://www.w3.org/2022/06/10-wot-pf-minutes.html
  • https://www.w3.org/2022/06/09-wot-pf-minutes.html
  • https://www.w3.org/2022/06/08-wot-pf-minutes.html
  • https://www.w3.org/2022/06/07-wot-pf-minutes.html
  • https://www.w3.org/2022/06/06-wot-pf-minutes.html
• PRs
  • https://github.com/w3c/wot-testing/pulls
• Plugfest logistics
  • Week of July 18
  • Need to avoid DTDL mtg during Use Case slot...
• Implementation Reports
  • Updates to boilerplate text (in Discovery, at least)
  • span/div issues fixed
  • trailing spaces problem fixed
  • issues with at-risk markup fixed
  • at-risk if less than 2 implementations whether or not optional
  • assertion fixes (e.g. due to missing markup, multiple RFC keywords, etc)
• To Dos
  • Discovery todo.csv updated
    • Still problem with manual.csv
  • Still missing implementation descriptions, testimonials, manual assertions
• "Policy" Assertions
  • Assumption: Treat these as manual assertions.

Agenda 15.06.2022

Chair: McCool

Scribe: Fady

• Review Implementation Reports
• To Dos

Agenda 10.06.2022

Testfest Day 5

Chair: McCool

Scribe: Fady

• PRs
  • Last-minute updates
• Implementation Report Drafts
  • TD
  • Discovery
• At-Risk Items
  • Markup
  • Tables
  • Responsibilities
• AOB

Agenda 09.06.2022

Testfest Day 4

Chair: McCool

Scribe: Ege/Kaz

• Updates
  • Implementation Report Drafts
  • Gaps
• TD PR on testing
  • PR 1525
• Testing PRs
• Issues
• AOB

Agenda 08.06.2022

Testfest Day 3

Chair: McCool

Scribe: Fady

• Updates
  • Implementation Report Drafts
  • Gaps
• TD PR on testing
  • PR 1525
• PRs
• Issues
• AOB

Agenda 07.06.2022

Testfest Day 2

Chair: McCool

Scribe: Ege

• Updates
  • Implementation Report Drafts
  • Gaps
• PRs
• Issues
• AOB

Agenda 06.06.2022

Testfest Day 1

Chair: McCool

Scribe: Jan

• Organization
  • TD is ready, see README
  • Discovery still needs updates to template.csv; will be done by tomorrow
• Instructions
  • Links to example PRs and issues (for work on addressing gaps)
• PRs
  • Intel examples in TD
• Issues
  • Intel example for gap-issue
• AOB

Agenda 01.06.2022

Chair: McCool

Scribe: Jan

• Review PF minutes
  • https://www.w3.org/2022/05/25-wot-pf-minutes.html
• TestFest org
  • Calendar entries, WebExes, etc
  • Goals:
    • CR-Ready implementation report for TD
    • CR-Ready implementation report for Discovery
  • To Do (see README for event)
    • Testing inputs
    • Manual assertions
    • Implementation Descriptions
  • Documentation
• PRs
• Issues
• Summer Testfest?
• AOB

Agenda 25.05.2022

Chair: McCool

Scribe: Ege

• Review PF minutes
  • https://www.w3.org/2022/05/18-wot-pf-minutes.html
• Action Items
  • TestFest org
    • Chair: Fady -> Fady/McCool co-chair, both TF and Testfests/Plugfests
    • Time: https://doodle.com/meeting/participate/id/bmZp0L3d
    • Proposal:
      • 8am Eastern/12pm UTC Monday and Tuesday
      • 7am Eastern/11am UTC Wednesday
      • 10am Eastern/2pm UTC Thursday, and Friday
    • Separate testfests and plugfests?
      • Testing is very time-critical and should be priority
• PRs
• Issues

Agenda 18.05.2022

Chair: McCool

Scribe: Fady

• Review PF minutes
  • https://www.w3.org/2022/05/11-wot-pf-minutes.html
• Action Items
  • TestFest org
    • Time: https://doodle.com/meeting/participate/id/bmZp0L3d
• PRs
• Issues

Agenda 11.05.2022

Chair: McCool

Scribe: Fady

• Review PF minutes
  • https://www.w3.org/2022/05/04-wot-pf-minutes.html
• Action Items
• PRs
• Issues

Agenda 04.05.2022

Chair: McCool

Scribe: Fady

• Review PF minutes
  • https://www.w3.org/2022/04/27-wot-pf-minutes.html
• PRs
• Issues

Agenda 27.04.2022

Chair: McCool

Scribe: Philipp

• Review PF minutes
  • https://www.w3.org/2022/04/20-wot-pf-minutes.html
• 3xx Error Codes - Profile
• Implementation Report updates
• PRs
• Testfest planning
  • Proposed Testfest 4-8 June
  • https://github.com/w3c/wot-testing/issues/297
• Issues
• TPAC
  • Demos?
    • How to handle remote connections?
    • Videos?
    • Presentations?
    • What do we already have?
  • In joint with a Plugfest?
  • Vancouver is now a go - hybrid event

Agenda 20.04.2022

Chair: McCool

Scribe: Ege

• Review PF minutes
  • https://www.w3.org/2022/04/13-wot-pf-minutes.html
• Implementation Report updates
  • Results for TD still need to be updated, then IR to update
  • Discovery are some new results - but IR not updated yet
• PRs
  • https://github.com/w3c/wot-testing/pull/293 - merged, discovery test results
• Issues

Agenda 13.04.2022

Chair: McCool

Scribe: Philipp

• Review PF minutes
  • https://www.w3.org/2022/04/06-wot-pf-minutes.html
• Implementation Report updates
• PRs
  • Guidelines for manual.csv
  • Ditto TDs
• Issues
  • Organization
• Home Assistant

Agenda 06.04.2022

Chair: Fady

Scribe: TBD

• Review PF minutes
  • https://www.w3.org/2022/03/30-wot-pf-minutes.html
• Manual CSV demo

Agenda 30.03.2022

Chair: Fady

Scribe: Kaz

• Review PF minutes
  • https://www.w3.org/2022/03/23-wot-pf-minutes.html
• Manual CSV demo next week
• Streamlining generation of assertions and diffs
• Review Issues

Agenda 23.03.2022

Chair: Fady

Scribe: Cristiano

• Review PF minutes
  • https://www.w3.org/2022/03/09-wot-pf-minutes.html
  • Also last Friday's plugfest minutes: https://www.w3.org/2022/03/18-wot-pf-minutes.html
• Testfest followup
• ESPHome/Retail demo

Agenda 09.03.2022

Chair: Fady

Scribe: TBD

• Review PF minutes
  • https://www.w3.org/2022/03/02-wot-pf-minutes.html
• Status of VLAN and VPN
• PRs:

Agenda 02.03.2022

Chair: Fady

Scribe: Ege

• Review PF minutes
  • https://www.w3.org/2022/02/23-wot-pf-minutes.html
• Offline meeting
• PRs:
  • WIP: Oracle tools
  • #211
  • #210
• Updates on the assertion tester

Agenda 23.02.2022

Chair: Fady

Scribe: McCool

• Review PF minutes
  • https://www.w3.org/2022/02/16-wot-pf-minutes.html

Agenda 16.02.2022

Chair: Fady

Scribe: Ege

• Review PF minutes
  • https://www.w3.org/2022/02/09-wot-pf-minutes.html
• Small update regarding assertion tester tool

Agenda 09.02.2022

Chair: Fady

Scribe: Cristiano

• Review PF minutes
  • https://www.w3.org/2022/02/02-wot-pf-minutes.html
• Discuss needs for next Testfest

Agenda 02.02.2022

Chair: Fady

Scribe: McCool

• Review PF minutes
  • https://www.w3.org/2022/01/26-wot-pf-minutes.html
• Look at schedule issue
• Considerations for Testfest/Plugfest in March

Agenda 26.01.2022

Chair: Fady

Scribe: Kaz

• Review PF minutes
  • https://www.w3.org/2022/01/19-wot-pf-minutes.html
• Review PRs
• Considerations for Testfest in March

Agenda 19.01.2022

Chair: Fady

Scribe: Cristiano

• Review PF minutes
  • https://www.w3.org/2021/12/15-wot-pf-minutes.html
• Plugfest schedule
• Merging PRs

Past Content

• /2021
• /2020
• /2019
• /2018
• /2017