IRC log of html-media on 2015-01-06

Timestamps are in UTC.

16:03:30 [RRSAgent]
RRSAgent has joined #html-media
16:03:30 [RRSAgent]
logging to http://www.w3.org/2015/01/06-html-media-irc
16:03:32 [trackbot]
RRSAgent, make logs public
16:03:32 [Zakim]
Zakim has joined #html-media
16:03:34 [trackbot]
Zakim, this will be 63342
16:03:34 [Zakim]
ok, trackbot; I see HTML_WG()11:00AM scheduled to start 3 minutes ago
16:03:35 [trackbot]
Meeting: HTML Media Task Force Teleconference
16:03:35 [trackbot]
Date: 06 January 2015
16:03:40 [joesteele]
scribe: joesteele
16:03:42 [joesteele]
chair: paulc
16:03:44 [joesteele]
agenda: http://lists.w3.org/Archives/Public/public-html-media/2015Jan/0007.html
16:04:05 [joesteele]
Zakim, who is here?
16:04:05 [Zakim]
HTML_WG()11:00AM has not yet started, joesteele
16:04:07 [Zakim]
On IRC I see RRSAgent, jdsmith, BobLund, pal, cyril, davide, markw, joesteele, adrianba, trackbot
16:05:51 [acolwell]
acolwell has joined #html-media
16:05:56 [paulc]
paulc has joined #html-media
16:06:07 [paulc]
zakim, who is on the call?
16:06:07 [Zakim]
HTML_WG()11:00AM has not yet started, paulc
16:06:09 [Zakim]
On IRC I see paulc, acolwell, Zakim, RRSAgent, jdsmith, BobLund, pal, cyril, davide, markw, joesteele, adrianba, trackbot
16:06:20 [paulc]
trackbot, start meeting
16:06:22 [trackbot]
RRSAgent, make logs public
16:06:24 [trackbot]
Zakim, this will be 63342
16:06:24 [Zakim]
ok, trackbot; I see HTML_WG()11:00AM scheduled to start 6 minutes ago
16:06:25 [trackbot]
Meeting: HTML Media Task Force Teleconference
16:06:25 [trackbot]
Date: 06 January 2015
16:06:25 [joesteele]
rrsagent, generate minutes
16:06:25 [RRSAgent]
I have made the request to generate http://www.w3.org/2015/01/06-html-media-minutes.html joesteele
16:06:36 [paulc]
zakim, who is on the call?
16:06:36 [Zakim]
HTML_WG()11:00AM has not yet started, paulc
16:06:37 [Zakim]
On IRC I see paulc, acolwell, Zakim, RRSAgent, jdsmith, BobLund, pal, cyril, davide, markw, joesteele, adrianba, trackbot
16:06:50 [adrianba]
Zakim, this is html
16:06:50 [Zakim]
ok, adrianba; that matches HTML_WG()11:00AM
16:07:10 [BobLund]
I joined but am in a noisy place
16:07:26 [adrianba]
zakim, who is on the phone?
16:07:26 [Zakim]
On the phone I see [Microsoft], +1.408.536.aabb, markw, Vincent, davide, jdsmith, BobLund, Aaron_Colwell
16:08:02 [paulc]
zakim, [Microsoft] is me
16:08:02 [Zakim]
+paulc; got it
16:08:03 [joesteele]
Zakim, aabb is me
16:08:04 [Zakim]
+[Microsoft]
16:08:04 [Zakim]
+joesteele; got it
16:08:14 [adrianba]
zakim, [Microsoft] is me
16:08:14 [Zakim]
+adrianba; got it
16:08:30 [cyril]
http://lists.w3.org/Archives/Public/public-html-media/2015Jan/0007.html
16:08:32 [joesteele]
agenda: http://lists.w3.org/Archives/Public/public-html-media/2015Jan/0007.html
16:09:01 [joesteele]
topic: role call
16:09:19 [joesteele]
Aaron is here with a cold
16:09:26 [joesteele]
Zakim, who is here?
16:09:26 [Zakim]
On the phone I see paulc, joesteele, markw, Vincent, davide, jdsmith, BobLund, Aaron_Colwell, adrianba
16:09:28 [Zakim]
On IRC I see paulc, acolwell, Zakim, RRSAgent, jdsmith, BobLund, pal, cyril, davide, markw, joesteele, adrianba, trackbot
16:09:59 [Zakim]
+ +1.650.458.aacc
16:10:08 [joesteele]
paulc: meeting will be on MSE topics
16:10:30 [joesteele]
topic: update on editors draft
16:10:39 [joesteele]
paulc: bugs on are agenda for later
16:10:57 [joesteele]
acolwell: since last set of changes have not been able to make more edits yet
16:11:01 [joesteele]
... still working on it
16:11:11 [joesteele]
... clear path for everything except bug filed today
16:11:16 [joesteele]
... fine with doing a heartbeat
16:11:33 [joesteele]
... not sure whether folks want me to resolve all existing bugs -- at least a couple may be non-trivial
16:11:42 [pal]
zakim, aacc is me
16:11:42 [Zakim]
+pal; got it
16:11:43 [joesteele]
paulc: wait till we go through the bugs
16:11:52 [joesteele]
acolwell: we can mark the ones we want to do
16:11:58 [joesteele]
topic: MSE test suite status
16:12:25 [joesteele]
paulc: F2F had ACTION-71 re: Cyril figuring out where we stood
16:12:26 [joesteele]
ACTION-71?
16:12:26 [trackbot]
ACTION-71 -- Paul Cotton to Investigate testing status to move things forward -- due 2014-11-07 -- CLOSED
16:12:26 [trackbot]
http://www.w3.org/html/wg/media/track/actions/71
16:12:42 [joesteele]
paulc: cyril sent a report
16:13:01 [paulc]
http://lists.w3.org/Archives/Public/public-html-media/2014Dec/0012.html
16:13:06 [joesteele]
... can you step through the reports and remark on any changes since then?
16:13:18 [joesteele]
... please use the queue for questions
16:13:34 [joesteele]
... want to figure out how we should make progress
16:13:52 [joesteele]
cyril: the report is in three parts
16:14:14 [joesteele]
.... part 1 is about prducing the reports of the runner -- took a while to setup correctly
16:14:28 [joesteele]
... needed to setup on my machine to work correctly, but now working correctly again
16:14:46 [joesteele]
... I have run the test suite we have in the runner on 3 diff browsers -- Firefox, Chrome, IE
16:15:05 [joesteele]
... reports are in JSON and are in the git repository called "test results"
16:15:19 [joesteele]
... that is the initial report but folks can update as needed
16:15:35 [joesteele]
... for IE had lots of crashes at the time, so reports might not be good
16:15:50 [joesteele]
paulc: link in the report was for which one?
16:16:00 [joesteele]
... #3 is the raw HTML I think?
16:16:11 [joesteele]
cyril: that is the report generated by the online runner
16:16:23 [joesteele]
paulc: is there a way to look at that in human readable form?
16:16:48 [joesteele]
acolwell: its basically the same way we do specs -- raw git URL
16:16:57 [joesteele]
cyril: even that gives you plaintext
16:16:59 [paulc]
Raw data of results: https://github.com/w3c/test-results/commit/265eaeb832a4deb19412dfa863fd422889263ffc
16:17:16 [joesteele]
s/prducing/producing/
16:17:33 [joesteele]
paulc: I can't see it, can you give us a short summary of the trends
16:17:36 [joesteele]
... ?
16:17:45 [joesteele]
cyril: let me find a way to view the results
16:17:52 [BobLund]
http://rawgit.com/w3c/test-results/265eaeb832a4deb19412dfa863fd422889263ffc/media-source/all.html
16:18:21 [joesteele]
boblund: this should give you a human readable version
16:18:41 [joesteele]
paulc: lots of red
16:18:52 [joesteele]
... lots of IE timeouts
16:19:08 [joesteele]
... have you figured out how to get around that problem?
16:19:22 [joesteele]
cyril: I was running on Win8 IE11 lots of problems at that time
16:19:37 [joesteele]
paulc: are the green and yellow things that were not run in IE
16:19:54 [joesteele]
?1: there were not results in those columns
16:20:15 [joesteele]
paulc: seems like a lot of fails in UC10
16:20:37 [joesteele]
cyril: not sure what those are -- they were in the tests at that time
16:20:46 [joesteele]
paulc: anyone know what the status is in safari
16:20:58 [joesteele]
acolwell: they have been filing bugs so I know they are working
16:21:06 [joesteele]
paulc: let's keep going
16:21:12 [joesteele]
cyril: that was part 1
16:21:26 [joesteele]
... for part 2 started looking at the test files -- very long task
16:21:41 [joesteele]
... I looked at one file in particular and filed some bugs on that
16:21:55 [joesteele]
... Aaron commented but have not had time to respond yet
16:22:06 [joesteele]
paulc: so you thought some tests needed changing?
16:22:35 [joesteele]
cyril: this test was making calls to isTimeSupported -- which is static -- was assuming WebM or MR4? to be supported
16:22:55 [joesteele]
... my main suggestion was to split this into a core test and separate tests for each byte stream format
16:22:57 [acolwell]
q+
16:23:08 [joesteele]
s/or MR4?/format/
16:23:27 [joesteele]
acolwell: I put some comments, in general I approve of his approach
16:23:41 [joesteele]
... not sure whether this is establishing a base or documenting all possible use cases
16:23:59 [joesteele]
... pretty sure we will not have interop in some cases
16:24:06 [joesteele]
... for example for some codecs
16:24:11 [adrianba]
q+
16:24:21 [joesteele]
paulc: cyril can you explain the tests you added and why?
16:24:27 [acolwell]
https://github.com/cconcolato/web-platform-tests/commit/0499e3fc0103f99fb64f386e5db070af47e5a62a
16:24:45 [paulc]
ack ac
16:25:04 [joesteele]
cyril: the MP4 file format is a container for many types of codecs
16:25:16 [joesteele]
... I looked at all existing codecs and proposed a test for those codecs
16:25:31 [joesteele]
... I agree with Aaron that most of these codecs will not be implemented interoperably
16:25:40 [joesteele]
... but some codecs and variations of codecs that would be worth testing
16:25:48 [joesteele]
paulc: where did you pull the codecs from?
16:26:04 [joesteele]
cyril: from the MP4 registration authority that maintains a list of standards and codecs
16:26:25 [joesteele]
... any vendors can add a codecs -- mp4.org?
16:26:37 [paulc]
ack adr
16:27:12 [joesteele]
adrianba: I think the goal that we have is to test interop of MSE itself, and of the normative requirements. MSE does not mandate any particular format support.
16:27:22 [joesteele]
... the spec itself does not have specific codec requirements
16:27:53 [joesteele]
... using isTypeSupported as an example -- we want to make sure implementation do this correctly and do not enumerate a large number of codec to see which are supported
16:28:16 [cyril]
q+
16:28:22 [paulc_]
paulc_ has joined #html-media
16:28:38 [joesteele]
... if someone has an implementation tey want to sumbit, which does not support WebM or other codecs, it would be reasonable for them to request a new codec to be added to indicate their support for that API
16:28:52 [paulc_]
MSE registry: http://www.w3.org/2013/12/byte-stream-format-registry/
16:28:56 [joesteele]
... but having a long list of codecs is probably not needed and we should be cautious about the ones we add
16:29:17 [cyril]
s/mp4.org/mp4ra.org/
16:29:23 [joesteele]
paulc: when I asked the question about where the list was from -- wondered if it was from this registry
16:29:31 [acolwell]
q+
16:29:40 [joesteele]
... that would have been the place to start
16:29:53 [joesteele]
cyril: the registry only lists the byte stream formats, not the codecs
16:29:54 [paulc]
ack cyril
16:30:05 [joesteele]
... you have to go to the other registry for the codecs
16:30:24 [joesteele]
... I agree with adrina that we want to test the behavior not the byte stream formats
16:30:42 [joesteele]
... what I thought was needed to test MSE specifically were things like --
16:30:51 [adrianba]
q+
16:31:04 [joesteele]
... what happens when one files has multiple tracks and some tracks use codecs that are not supported
16:31:14 [paulc]
ack acol
16:31:46 [joesteele]
acolwell: I agree with Adrian that we should keep the tests focuses on testing MSE not the byte streams, but I also agree that we cover behavior where there are unsupported codecs
16:31:54 [joesteele]
q+
16:32:00 [paulc]
ack ad
16:32:19 [ddorwin]
ddorwin has joined #html-media
16:32:19 [paulc_]
rrsagent, generate the minutes
16:32:19 [RRSAgent]
I have made the request to generate http://www.w3.org/2015/01/06-html-media-minutes.html paulc_
16:32:35 [joesteele]
adrianba: was not suggesting that we have tests that do not use the codecs, this could be similar to how we did testing in HTML5 -- HTML4, ogg format or WebM
16:32:56 [joesteele]
... did not matter what format the files where in as long as you could play video and the interaction worked correctly.
16:33:08 [joesteele]
... but we had to have media content to test the elements
16:33:21 [Zakim]
+ddorwin
16:33:25 [joesteele]
... in this case we will have to have media that does supported what is being testing
16:33:56 [joesteele]
... thing that is different than going to the MP4 registry and enumerating all those formats and testing whether they are supported
16:34:07 [joesteele]
... don't need to be exhaustive
16:34:31 [joesteele]
... ultimately we are looking to see how many passes for each test, we will have to explain why failures are not important
16:34:33 [paulc]
ack joe
16:34:33 [cyril]
q+
16:35:09 [joesteele]
joesteele: is there an unsupported codec?
16:35:18 [joesteele]
cyril: yesy I did add that to the tests
16:35:18 [paulc]
ack cyr
16:35:46 [joesteele]
... I think I agree, I did trim the tests to keep the codecs tested to a minimum
16:35:53 [joesteele]
... would like those MP4 codecs to a separate test
16:36:10 [joesteele]
paulc: does anyone disagree with that strategy?
16:36:23 [joesteele]
acolwell: so you want to kee the tests in a spearate file?
16:36:53 [joesteele]
cyril: some would be kept in the tests, some might be kep in a separate file (e.g. on my website)
16:37:04 [joesteele]
adrianba: not sure what the split out tests would be for
16:37:17 [joesteele]
... definitely agree that breaking things down and not having all in one place is helpful
16:37:30 [joesteele]
... in the end want it to be easy to anaylse the results
16:37:55 [joesteele]
... e.g. isTypeSupported is implemented interoperably across multiple browwers
16:38:11 [joesteele]
cyril: you can give me an action to do that and I will review
16:38:38 [joesteele]
... I will define first a codec that is supported and one that is not supported for each implementation, I I will test both cases for each
16:38:46 [joesteele]
... what matters is that it is a supported coded
16:39:02 [joesteele]
paulc: let's pop back up a level -- describing the testing you were doing
16:39:10 [joesteele]
cyril: in part 3
16:39:23 [joesteele]
... this work was suggested by Paul at the TPAC
16:39:33 [joesteele]
... looking for coverage of the test suite
16:40:08 [joesteele]
... I looked at the spec and tried to determine how many tests were needed per section of the spec, and tried to see what was there, what was missing and what I had added during my anaylze
16:40:17 [joesteele]
... this is preliminary work
16:40:18 [cyril]
https://docs.google.com/spreadsheets/d/1XKjIuGWjEaSvMkf31HiTaYYkLbyuNg4saP2Sf-iW-cs/edit?usp=sharing
16:40:46 [joesteele]
cyril: there are two spreadsheets
16:41:20 [markw]
markw has joined #html-media
16:41:27 [joesteele]
... this is test coverage -- listing tests that are needed per section, tests available, and link to existing tests for that section
16:41:48 [joesteele]
paulc: given that this is organized by section, are you going to revisit each section?
16:42:15 [joesteele]
cyril: there are sections I have not scanned yet -- e.g. the audio splice algorithm -- don't know how many tests are needed there yet.
16:42:22 [joesteele]
... from that perspective it is not final yet
16:42:31 [joesteele]
... also I have not linked all the tests to a given section
16:42:55 [joesteele]
... the first tab in that google doc is the test coverage, the second is the list of existing files in that test suite and some notes
16:43:04 [joesteele]
s/browwers/browsers/
16:43:11 [joesteele]
cyril: probably need to work on the notes
16:43:40 [joesteele]
paulc: do you need help from other people to generate tests, or finish the "tested in" column first?
16:43:59 [joesteele]
cyril: if folks think this is the right thing to do, need to get agreement on each test
16:44:16 [joesteele]
paulc: has anyone reviewed these tests and have comments
16:44:48 [joesteele]
jdsmith: I think this approach is solid. intent is to identify testable assertions in the spec. we are going to find out whether we have full coverage.
16:45:18 [acolwell]
+1
16:45:23 [acolwell]
q+
16:45:24 [joesteele]
... we have to prioritize where we have gaps. I think Cyril is doing a good job and I am impressed with what he had done. We can split things up and help him if he needs it
16:45:32 [paulc]
ack ac
16:45:38 [joesteele]
cyril: I would be happy to have help but I will continue on this
16:45:56 [acolwell]
https://github.com/w3c/web-platform-tests/pull/1238
16:46:10 [joesteele]
acolwell: I am also happy with what Cyril has done. and have a pull request also that I would appreciate review on
16:46:31 [joesteele]
cyril: my intent was to get this to a stable state and then review that pull request as well
16:46:46 [joesteele]
acolwell: this might reduce the amount of tests that need to be reviewed
16:46:59 [joesteele]
paulc: want to have some time to review existing bugs and discuss heartbeat
16:47:12 [joesteele]
... should we schedule another meeting in a month?
16:47:34 [joesteele]
... want to identify places you could use help from others
16:47:39 [joesteele]
cyril: that makes sense
16:47:46 [joesteele]
topic: MSE bugs
16:48:09 [joesteele]
paulc: there are 5 bugs -- Aaron do you want to discuss those bug you mentioned
16:48:15 [joesteele]
topic: bug 27649
16:48:34 [joesteele]
acolwell: think we have agreements on this
16:48:39 [joesteele]
topic: bug 27599
16:48:59 [joesteele]
acolwell: think we also have agreement on this need to rwch out and get clarification
16:49:05 [joesteele]
topic: bug 27399
16:49:34 [joesteele]
acolwell: need to get clarification on how to approach that
16:49:45 [paulc]
s/27399/27239/
16:49:48 [joesteele]
s/bug 27399/bug 27239/
16:49:58 [joesteele]
topic: bug 27758
16:50:18 [joesteele]
acolwell: Bob and I talked awhile ago on this -- can he refresh?
16:50:33 [paulc]
https://www.w3.org/Bugs/Public/show_bug.cgi?id=27758
16:51:06 [joesteele]
BobLund: think we had agreement that we should have an information reference to the src? specification -- question was in the byte stream spec or the specification?
16:51:38 [joesteele]
... there was a statement tht the bytestream spec should include the track attrbiute reference
16:51:55 [joesteele]
paulc: does your proposal fill that in for each existing item in the regoistry?
16:52:10 [joesteele]
BobLund: yes it just says it should follow the existing media format
16:52:19 [joesteele]
acolwell: I think that is fine
16:52:24 [joesteele]
topic: bug 27242
16:52:24 [adrianba]
+1
16:52:38 [joesteele]
acolwell: have not started this yet -- might be ab edge case folks have not hit yet
16:52:48 [joesteele]
... buffer ranges can do wierd things with key frame content
16:53:06 [joesteele]
... depending on how folks interpet what is buffered in that content -- need the right test cases
16:53:29 [joesteele]
s/key frame/B frame/
16:53:38 [joesteele]
s/ab edge/an edge.
16:53:40 [joesteele]
s/ab edge/an edge/
16:53:45 [joesteele]
topic: MSE heartbet
16:53:47 [paulc]
I propose we include 27599 and 27649 in the heartbeat with 27758 being optional depending on the amt of work to resolve 27758
16:53:55 [joesteele]
s/MSE heartbet/MSE heartbeat/
16:54:21 [joesteele]
paulc: I am proposing you do the bugs you said were ready, and leave to the editors whether the other are included
16:54:26 [joesteele]
acolwell: that sounds fine
16:54:31 [adrianba]
I can help with heartbeat if you like
16:54:40 [joesteele]
s/rwch/reach/
16:54:55 [joesteele]
paulc: put the folks in the CC list and CC me as well
16:55:11 [joesteele]
acolwell: sure -- will coorindate with Adrian as well
16:55:25 [joesteele]
paulc: next week will continue with EME -- revisit this in about a month
16:55:37 [paulc]
s/this/MSE/
16:55:42 [joesteele]
s/revisit this/revisit MSE/
16:55:47 [joesteele]
paulc: think we are done for today
16:56:02 [joesteele]
paulc: thanks Cyril for attending and all your work!
16:56:07 [paulc]
rrsagent, generate the minutes
16:56:07 [RRSAgent]
I have made the request to generate http://www.w3.org/2015/01/06-html-media-minutes.html paulc
16:56:07 [joesteele]
... paulc thanks all!
16:56:07 [Zakim]
-BobLund
16:56:09 [Zakim]
-davide
16:56:09 [Zakim]
-markw
16:56:18 [Zakim]
-adrianba
16:56:20 [Zakim]
-joesteele
16:56:21 [Zakim]
-Aaron_Colwell
16:56:22 [Zakim]
-jdsmith
16:56:23 [Zakim]
-Vincent
16:56:23 [Zakim]
-ddorwin
16:56:28 [joesteele]
rrsagent, generate the minutes
16:56:28 [RRSAgent]
I have made the request to generate http://www.w3.org/2015/01/06-html-media-minutes.html joesteele
16:56:55 [joesteele]
s/regoistry/registry/
16:56:58 [Zakim]
-pal
16:57:14 [joesteele]
s/attrbiute/attribute/
16:57:26 [joesteele]
s/src? /track attribute/
16:57:52 [joesteele]
s/adrina/Adrian/
16:57:56 [joesteele]
rrsagent, generate the minutes
16:57:56 [RRSAgent]
I have made the request to generate http://www.w3.org/2015/01/06-html-media-minutes.html joesteele
16:58:09 [Zakim]
-paulc
16:58:10 [Zakim]
HTML_WG()11:00AM has ended
16:58:10 [Zakim]
Attendees were +1.650.458.aaaa, +1.408.536.aabb, markw, Vincent, davide, jdsmith, BobLund, Aaron_Colwell, paulc, joesteele, adrianba, +1.650.458.aacc, pal, ddorwin
16:58:27 [joesteele]
s/on are/are on/
16:59:48 [joesteele]
s/an unsupported/an explicitly unsupported/
16:59:51 [joesteele]
rrsagent, generate the minutes
16:59:51 [RRSAgent]
I have made the request to generate http://www.w3.org/2015/01/06-html-media-minutes.html joesteele
17:00:25 [joesteele]
s/kee the tests in a spearate/keep the tests in a separate/
17:00:26 [joesteele]
rrsagent, generate the minutes
17:00:26 [RRSAgent]
I have made the request to generate http://www.w3.org/2015/01/06-html-media-minutes.html joesteele
17:02:23 [davide]
davide has left #html-media
17:03:07 [joesteele]
zakim, bye
17:03:07 [Zakim]
Zakim has left #html-media
17:03:17 [joesteele]
rrsagent, bye
17:03:17 [RRSAgent]
I see no action items