– DRAFT –
WoT Testfest - Day 5

Minutes

meeting starts

<kaz> Day 4 (June 10)

first, minutes are reviewed

<McCool> https://github.com/w3c/wot-testing/issues/141

minutes need to add the issue 141

McCool: ....minutes work, besides adding the issue

no objections are presented for publishing the minutes

PR 142

McCool: ....next thing to do today, is cleaning the PRs

<kaz> PR 142 - fix: paths to current event in Siemens TM files

McCool: the PR #142 fixes the paths to the current event
… seems ok, but all checks have failed

McCool: ...let's take a look

the problem seems related to a missing property in a td, i.e., 'securityDefinitions', which fails the validation

the validation is optional, and therefore, it is not blocking all the checks

PR 143

<kaz> PR 143 - Add webthings generated tds

McCool: ....then we have PR #143

Cristiano: ...I created this two TDs, they are very simple

McCool: ...this PR could be merged

PR 143 is merged

regarding this PR the script that generates the assertions is not working 100% as it should, Michael Mccool is going to fix it to work as planed

the main issue is with the output of the script

which appends at the end of the filename a suffix

<McCool> https://github.com/thingweb/thingweb-playground/blob/v1.1-testfest1/packages/assertions/manual.csv

<Ege> thingweb-plyaground PR 205 - new manual assertions for v1.1

McCool: ...another thing about the csv generated
… is that they lack of a description column

ege's script also adds description to the generated CSV files

this script is added in PR 205 above

<kaz> McCool shows the manual.csv file

McCool: ...what is the easiest way to update things? let's create a new file and open the csv

mcool now copy the manual.csv file to manual-diff.csv, and adds it to the repository

the new file is in the events folder 2021.06.Online

McCool: people can use this file, with 10 assertions.

mccool is manually adding the description column

michael is fixing some elements from the csv files, tds, and others

<kaz> active.csv

<kaz> imple.csv

michael now reviews the text in the impl.md, he suggest to make several changes in the text itself. For instance "servers" for "producers"

<kaz> impl.md

Discovery Testing

McCool: ..now let's look at the discovery

Farshid: ...we would like to discuss some assertions related issues

Farshid: ...there are two alternatives: either summarise the comments logs are too long
… another way of doing it is putting the whole log entry (that is very long)
… if we choose the short option, the long entries are still available in the pipeline

Farshid: ...there are feature and sub-features

each is related to the assertions

McCool: right now only two levels are used, we should consider the sub-test as part and do not expose the results (due to complexity)

Farshid: we could have one row per assertion, so we do not have sub-features

McCool: we will have then a set of assertions for a feature, and each test will be a sub-element in that assertion

McCool: ...we will need to create ids for each assertion and check that they are correct in the report

<kaz> report.csv within Farshid's repository

McCool: we should continue this conversation on Monday's meeting

to clean up some things and advance with the implementation report

PR 144

<kaz> PR 144 - Add TUM implementations list

ege updated his PR #144, now it can be merged

mccool merges the PR

PR 142 (revisited)

<kaz> PR 142 - fix: paths to current event in Siemens TM files

daniel peintner also fixed the PR 142, michael merges also this PR

<McCool> https://github.com/w3c/wot-thing-description/pull/1155

meeting ends due to time

<kaz> [adjourned]