PlugFest WebConf

From Web of Things Interest Group
Jump to: navigation, search

WebConf Information

See also the consolidated WoT Web meetings table on the main wiki page of the WoT IG/WG.

Obsolete calls

Wednesdays at 9am US Eastern / 3pm Europe / 10pm Japan

Note: Due to Daylight Savings in US, the call will start one hour earlier in Europe between October 8 March and 29 March. Calls are all scheduled in US Eastern Time, European daylight savings starts on a different date, and some places do not have Daylight Savings at all, so the following changes will need to be observed:

  • In Europe, calls will start one hour earlier after March 8 and then go back one hour later (=usual time) after March 29.
  • In China, Japan and Russia, where Daylight Savings is not observed, calls will start one hour earlier after March 8.

See email here for further information.

WebEx

This call does not have its own WebEx, instead the main call is continued.

Note:

  • Calls are all scheduled in US Eastern Time

IRC

The IRC is used for the minutes, speaker queue, and sharing links etc.

Actions

  • Organize wot-test repo (McCool)
    • Copy over existing material from wot repo
  • Generate feature lists to abstract assertions, cover "informative" features, like use of MQTT, etc.
    • Copy over and improve implementation report generation scripts from wot-thing-description
  • Improve and generalize implementation report generation scripts (McCool)
  • Capture implementation descriptions in formal CSV tables
    • Include and generate report on interoperability testing
  • Plan Helsinki plugfest
    • Include formal data capture plans, including for conformance and interoperability
  • Finalize technical requirements
  • Set up remote access links, eg WebEx, Google hangouts, etc.
  • Capture more examples that can be shared
    • Link to wotify.org and other examples from wot-testing
    • Add links to formal implementation CSV files
    • Capture information on both producers and consumers, e.g. mashups in Node-RED
      • Even just screenshots
  • Improve test tools
    • E.g. scripts to "exercise" a device, use UI to confirm actions, etc.
    • See https://github.com/tum-esi/testbench - connect to impl/plugfest report
    • Standardize setup for implementations so they can be reproduced easily
    • Use semantics to guide testing; special vocab for testing?
  • Create procedure/template for Plugfest implementation preparation
    • Passwords, network setup, how to document implementations (incl authentication), behavior, etc.
    • Add link to documentation from CSV table, archive documentation in wot-testing

Past Events

  • 8 May 2019: Copy old test cases to testing/test/2019-05
  • 22 May 2019: All TDs and tests updated to new CR version
  • 22 May 2019: Generate initial IR Draft
  • 23-30 May 2019: Address gaps, add manual assertions
  • 6-7 June 2019 - F2F IR Release Candidate
    • Finalize manual results
    • Discuss results at workshop
    • Decide to take out at-risk or try to add a test/impl
  • 19 June 2019 - PR Transition Resolution
  • 20 June 2019 - PR Transition Request

Agenda 08.05.2020

Chair: McCool

Scribe: Ege

Agenda 07.29.2020

Chair: McCool

Scribe: Ege

  • Minutes
  • Decide dates for plugfest
  • Repo reorg
  • Issues
  • Softether VLAN
    • Plan A - Collaborate with IETF 109 - Nov 14-20 (Bangkok, currently not planned as an online event)
    • Plan B - DIY
    • Need to clarify whether this is mandatory or not - it is not
    • Will have a global directory
    • Do want people to register if possible, but will still mine github (maybe with separate directory site), or do hand registration, or as part of registration
  • Next steps:
    • Tooling
      • Softether VLAN
      • Report generator
      • TD 1.1 validation
      • WADE
    • Scenarios
      • Retail/EdgeX
      • Smart City/Geolocation
      • Agriculture?
    • Prototypes
      • Discovery service
      • Edge computing
  • AOB

Agenda 07.22.2020

Chair: McCool

Scribe: Kaz

  • Plugfest planning
    • Decide dates and times - defer until F2F decided
  • Ongoing testing
  • Repo review
    • Manual CSV file - maintenance
    • Tools - playground, etc
  • Scenarios
  • AOB

Agenda 07.15.2020

Chair: McCool

Scribe: Daniel

Agenda 07.08.2020

Cancelled.

Agenda 07.01.2020

Cancelled for post-F2F recovery.

Agenda 06.24.2020

Cancelled during F2F.

Agenda 06.19.2020

  • Review PRs and issues
    • Validation scripts
    • Report generation (WIP)
    • WADE (Dynamic testing) results
  • Wrap-up
    • Outcomes (capture as issues)
    • Presentation
  • AOB

Agenda 06.18.2020

  • Review PRs and issues
    • Nodegen population
    • Validation scripting
  • LinkSmart directory population
  • Introduce WADE
  • Next steps
    • Collecting plugfest outcomes
  • AOB

Agenda 06.17.2020

  • Review PRs
    • Bridge VPN init.d update
  • LinkSmart directory update
    • Autopopulation from github
  • Next steps
    • Nodegen population from directory
    • Validation of TDs
    • Report generation
  • TUM Closed PR - coffee machines
    • Multiple simulation instances
  • Will use slack for chatting
  • AOB

Agenda 06.16.2020

  • Review PRs
  • Capture VPN device hostnames
  • WIP Validation discussion
  • Review data and TD capture process
  • VPN setup for bridge
  • Next steps
  • AOB

Agenda 06.15.2020

Replaced with plugfest sync call.

Agenda 06.10.2020

Agenda 06.03.2020

  • Guests
    • T2TRG Ari Keranen and Carsten Bormann
  • Review Minutes
  • Workshop Logistics
  • Plugfest planning
    • Data collection
    • Scenarios
  • AOB

Agenda 05.27.2020

  • Review Minutes
  • Github site for plugfest
  • To Do
    • Wiki update
    • Scenarios
    • Proposals and Prototypes
      • LinkSmart directory service (Fraunhofer)
      • AI Services (Intel)
    • Credential distribution - mailing lists, need to capture links
    • SoftEther VPN configuration and testing, bridge setup instructions
    • Prework
  • AOB

Agenda 05.20.2020

  • Review Minutes
  • Finalize VPN setup plan
  • TO DO: Test reporting framework and data collection plan (Michael McCool)

Agenda 05.13.2020

  • Review Minutes
  • SoftEther VPN
    • W3C System Team - ready by May 25?
    • Bridge setup instructions (Michael Koster)
  • Online Plugfest/F2F Schedule discussion
    • Both plugfest and F2F
    • New Doodle... what options should we include?
  • Other TPAC/Vancouver F2F Logistics
    • Venue options
  • Updates to use cases/domains, scenarios, feature proposals, and implementations
  • Mechanism for video links e.g. for device monitoring (hangout, zoom, webex, etc?)
    • Need something running 24/7, most services have time limits...
  • AOB

Agenda 05.06.2020

  • June Plugfest
    • Wiki page
    • Finalize meeting time and logistics
    • Use cases/implementations
  • AOB

Agenda 04.22.2020

  • Review Minutes
  • June Plugfest
    • Wiki page
    • Finalize Meeting Time based on Doodle results
    • SoftEther Standup - Michael Koster
  • October Plugfest
  • Repo reorg
  • AOB

Agenda 04.15.2020

  • Review Minutes
  • Plugfest Logistics
    • June Plugfest
      • Additional use cases and implementations, eg Semantic Proxy, Directories, etc.
    • October Plugfest Objectives:
      • Testing?
      • Developer outreach?
      • Demo development? -> TPAC
    • October Plugfest Use Cases:
      • AI Integration
      • Edge Computing Integration; EdgeX, MEC...
      • Cloud Integration
      • PoCs: Singapore, Conexxus
      • Products: Designo...
    • October Plugfest Logistics (options):
      • Virtual plugfest only - week before, same as format at June virtual
      • Combo virtual/physical - weekend before TPAC
      • Physical-only may not work well; some people will probably still be under travel restrictions
      • Location:
        • Universities: UBC, Simon Fraser (McCool has some contacts, small sponsor capability)
        • TPAC location (chairs to ask... respond to TPAC questionnaire)
        • Other?
  • AOB

Agenda 04.01.2020

Agenda 03.25.2020

Agenda 02.26.2020

Agenda 02.05.2020

  • Review Minutes
  • Repository organization
  • Testing framework, tools, and instructions
    • Both consumer and exposed Things
  • AOB

Agenda 01.29.2020

Agenda 11.09.2019

  • Online Plugfest results
    • fixed hangout information
    • Roundtable: Which devices, which test cases to prioritize, additional test cases?
    • Simple communication test
    • Test Scenarios
      • Smart House
      • Industrial integration
  • F2F and Plugfest Logistics

Agenda 10.09.2019

  • Online Plugfest
    • Roundtable: Which devices, which test cases to prioritize, additional test cases?
    • Simple communication test
    • Test Scenarios
      • Smart House
      • Industrial integration
      • Others?
  • F2F and Plugfest Logistics
    • Fukuoka demo/break-out setup

Agenda 4.09.2019

Closing doodle, decided on time slot Tuesday, Sept 10th, 9am-11am CDT, 4pm-6pm JST (possibly 1 hour more, if needed)

  • PRs

Agenda 28.08.2019

  • PRs

Agenda 14.08.2019

  • PRs

Agenda 24.07.2019

Agenda 17.07.2019

Agenda 10.07.2019

  • Demo goals
    • Interoperability across multiple companies
  • Consolidate Scenarios

Agenda 29.05.2019

Agenda 22.05.2019

Agenda 08.05.2019

Agenda 01.05.2019

Cancelled due to holiday.

Agenda 24.04.2019

Agenda 06.03.2019

  • TD Implementation report update
  • Security
  • Next steps
    • Ege will review AssertionTester schemas and fill gaps
    • McCool to update wot manual.csv and mail it around; update atrisk; also identify assertions that don't have tests yet
    • Aim for updated Implementation Report by Friday, final version for TAG by Monday
    • McCool working on documenting Intel systems for pentest planning (to be discussed in Security call on Monday)
  • AOB

Agenda 13.02.2019

  • Open Geospatial
  • Uniqueness testing
    • What keys need to be unique and how can we test?
  • How to tracking issues with testing
  • Updates to IR
    • Assertions removed, general cleanup

Agenda 23.01.2019

  • TestFest Logistics
    • Scheduling
    • Demo organization (eg for OpenDay)
  • Assertions and Implementation Report Updates
    • Default values removed from IR table
    • Shadowed assertions added
    • Duplicate assertions (and IDs!) from tables
    • Behavioral assertion PR
  • Tooling
    • Update to Playground
  • Node-Wot update
    • 90% done, still issues with readall, security coverage
  • Data Collection
    • Need to document CLI tool usage
    • Move mergeresults.js to playground repo
    • Need to update templates.csv - fix shadows, add behavioral
    • Examples directory
  • Security Testing
    • Testing plan WIP
    • Penetration testing planned during F2F - failsafe devices, please!
  • Other

Agenda 16.01.2019

  • Definitions
  • Logistics
  • Workflow
  • Validation Tools
    • Playground (JSON Schema validation)
    • Network Tool
  • Data Collection
    • TD Implementation Report Tooling
    • TDs w/ CSV and directory structure
    • Implementation Descriptions
  • Deliverables
    • Implementation Report
    • Interoperability Testing
    • Security Testing
  • Process for Assertion Modification
    • Use normal PR/Issue Trackers

Agenda 10.12.2018 - Test Fest Day 1

  • Confirm logisitics
  • Confirm TD version
  • Go over tools and processes
  • Survey available implementations and issues
    • Write Implementation Descriptions
  • Allocate tasks
    • Generation of new tests

Agenda 05.12.2018

Agenda 28.11.2018

  • Review Implementation Report tooling improvements
    • Still need implementation.html files for some implementations
  • PlugFest reports
  • TestFest planning
    • Schedule:
      • Week of Dec 10
      • During Mon (2h; 9pm-11pm JST) and Wed (3h; 9pm-12pm JST) call times
      • Fri (4pm-6pm JST) TD call to finalize results
    • Data collection
      • Collect all TDs
      • Generate assertion results.csv manually or from TDs
      • Collect interop.csv data
      • Might still be useful to have preparation.md/results.md
    • VPN
      • OpenVPN server and VLAN, at least for self-clients
    • Wiki page
      • Kaz to set up template, add links from other places
      • McCool will fill in logistics data
      • Will re-use existing WebEx
  • Testing Subcommittee

Agenda 21.11.2018

  • Review Implementation Report tooling improvements
  • Review action items for collecting data
    • Implementation descriptions
    • Assertion test data results
    • Proposed new assertions (codify preparation.md results)
  • PlugFest reports
    • Panasonic, Fujitsu and Hitachi; others?
  • Testfest planning
  • Architecture draft testing and validation
  • Scripting API testing and validation

Agenda 14.11.2018

  • Update on TD Test plan and Implementation Report draft
    • Implementation Report template
    • Assertion extraction
    • Merging implementation results via CSV files
    • TO DO: Use headers in CSV files, create and merge PR with TD
    • TO DO: template for implementation description(s)
    • TO DO: Group assertions by category and section
    • TO DO: Add file to capture "extra" assertions
  • PlugFest reports
    • got messages from Panasonic, Fujitsu and Hitachi about their reports
    • could be initial starting point for our implementation report
    • need for description on directory (discovery/registration/lookup)
  • Tooling
    • Test framework: Dave Raggett
    • Should split the work from possible advanced effort for an automatic mechanism (e.g., Web Platform Test Framework)
    • How to collect, organize and present results?
  • Testing Meeting in Dec Planning
  • Other

Agenda 07.11.2018

  • TPAC recap and planning
  • Timeline
    • Rough draft of "Implementation Report Plan" (CR entry doc):
      • Can we get a template?
      • Like plugfest report... but need to relate to assertions
      • Target: End of Nov (McCool takes action to do for next meeting)
    • When a candidate release needs to be ready: end of Dec
    • When things need to be frozen: end of Jan
    • When tests need to be completed: before CR submission
    • When CR is to be submitted, along with all tests: end of Feb
    • Practical dropdead-deadline: end of March
  • Logistics
    • When do we meet? Do we do a doodle?
    • Separate repo for test suite?
    • Do we need tests for the architecture document?
    • Online "plugfest" with a focus on testing? When?
    • How do we handle pen testing?
  • Test requirements for PR transition

Agenda 19.09.2018

  • Quick updates
  • Online PlugFest
    • Pull requests
    • Review any new documents
    • Scheduling discussion
    • Testing and validation update
  • Other

Agenda 05.09.2018

  • Quick updates
  • Online PlugFest
  • Scenarios
  • Target Features
  • Testing

Agenda 29.08.2018

Agenda 22.08.2018

Agenda 15.08.2018

Merged with main call.

Agenda 08.08.2018

  • Quick updates
  • Review results of the Bundang Plugfest
  • Online plugfest goals and logistics
  • Lyon plugfest goals and logistics
  • Test plan updates
    • Fuzz testing
    • DTLS testing

Agenda 01.08.2018

  • Testing (quick updates)
  • Review results of the Bundang Plugfest
  • Gaps and areas for improvement
  • Discuss goals for next plugfest
  • Discuss goals and logistics for "online plugfest"
  • Discuss meeting logistics: separate testing mtg, or not?

Agenda 30.05.2018

  • Review results of the Prague Plugfest
  • Identify gaps and areas for development
  • Identify areas for new development
  • Decide planning materials

Agenda 25.10.2017

  • Review Servients information from members
  • Clarify which servients can be connected from the others
  • testbed configuration (by Koster-san)
  • network configuration on the plugfest in Fujitsu and TPAC
  • AOB

Agenda 18.10.2017

  • Matsukura-san's update on the plan
  • PlugFest participants' updates
  • AOB

Pending Agenda Items (with Deadlines)

  • To be added

Future Agenda Items

  • To be added

Resources

  • To be added

Meeting Minutes

2017

  • To be added
Retrieved from "https://www.w3.org/WoT/IG/wiki/index.php?title=PlugFest_WebConf&oldid=9841"