[W3C Web Crypto WG] ACTION-29 : a possible test framework

This reply was supposed to be reply-all; re-sending to the list.


---------- Forwarded message ----------
From: Ryan Sleevi <sleevi@google.com>
Date: Fri, Aug 3, 2012 at 11:54 AM
Subject: Re: [W3C Web Crypto WG] ACTION-29 : a possible test framework
To: Harry Halpin <hhalpin@w3.org>


On Fri, Aug 3, 2012 at 11:49 AM, Harry Halpin <hhalpin@w3.org> wrote:
> On 08/03/2012 08:44 PM, Christopher Kula wrote:
>
> Yeah, this looks good. Especially the approach to asynchronous testing. Is
> there vendor buy-in to this testing framework?
>
> I'll take a swing at integrating this with the Node.js API mockup.
>
>
> Also, here's more information on testharness.js (used by WebApps and HTML
> WG):
>  http://w3c-test.org/resources/testharness.js
>
> That file includes embedded documentation that should be very clear to
> anybody who's accustomed to using JavaScript to automate test cases. The
> sources are at http://dvcs.w3.org/hg/resources/
>
> The work on WebDriver will supplement testharness.js for our purposes, not
> to replace it. Specifics questions about testharness.js can be answered in
> real-time on the #testing channel on irc.w3.org:6665. If they prefer e-mail,
> the right list to take those kinds of questions to is
> public-test-infra@w3.org.
>
> So it seems that we should settle on testharness.js for test-cases if at all
> possible.
>
>  hope this helps,
>       harry

At a high level, I think this is probably fine for testing. One *Unit
test framework is as good as another *Unit test framework.

That said, the only reservation I have is with regards that crypto,
unlike many other APIs, has a host of security concerns, which is to
say that there may be a host of user interface concerns. It's quite
possible that for some value of unit tests, someone may need to
manually be clicking/accepting dialogs.

However, AIUI, such tests are acceptable (eg: manual-but-automated),
and was somewhat shown in the HTML tests (which required "Does this
look right" style human interaction).

>
>
>
> - Chris
>
> On Fri, Aug 3, 2012 at 1:05 AM, GALINDO Virginie
> <Virginie.GALINDO@gemalto.com> wrote:
>>
>> Dear all, and people thinking about tests,
>>
>>
>>
>> Just had a quick chat with Robin Berjon, who strongly recommends any group
>> uses testharness [1].
>>
>> If we want to make happy a TAG member, you know what we have to do. Just
>> saying…
>>
>>
>>
>> Virginie
>>
>> Gemalto
>>
>>
>>
>> [1]
>> http://darobin.github.com/test-harness-tutorial/docs/using-testharness.html
>>
>>
>
>
>
>
> --
> Christopher Kula
> cjkula@gmail.com
>
>
>

Received on Friday, 3 August 2012 18:56:03 UTC