16:56:19 <RRSAgent> RRSAgent has joined #interactive-media
16:56:20 <RRSAgent> logging to https://www.w3.org/2022/02/09-interactive-media-irc
16:56:30 <Zakim> Zakim has joined #interactive-media
16:57:19 <cpn> Meeting: Interactive Media CG introduction
16:57:24 <cpn> scribe+ cpn
17:00:41 <kaz> kaz has joined #interactive-media
17:01:39 <CharlesL1> CharlesL1 has joined #interactive-media
17:01:51 <kaz> meeting: Interactive Media
17:02:00 <CharlesL1> present+
17:02:14 <wendyreid> wendyreid has joined #interactive-media
17:02:19 <wolfgang> wolfgang has joined #interactive-media
17:02:26 <zheng_xu> zheng_xu has joined #interactive-media
17:02:31 <zheng_xu> present+
17:02:37 <wendyreid> present+
17:02:37 <wolfgang> present+ wolfgang
17:02:45 <Louay> Louay has joined #interactive-media
17:02:55 <Louay> Present+ Louay_Bassbouss
17:03:01 <Karen> Karen has joined #interactive-media
17:03:16 <Karen> present+
17:03:28 <kaz> present+ Kaz_Ashimura, Chris_Needham, Weny_Reid, Adam_Sobieski, Bill_Kasdorf, Charles_aPierre, Craig_Wright, Francois_Doust, JohnRiviello, Karen_Myers, Leonard_Rosenthol, Louay_Bassbouss, Wolfgang_Schindler, Zheng_Xu, Marisa_Demeglio
17:03:29 <leonardr> leonardr has joined #interactive-media
17:03:29 <AdamSobieski> AdamSobieski has joined #interactive-media
17:03:33 <calvaris> calvaris has joined #interactive-media
17:03:35 <leonardr> present+
17:03:37 <JohnRiv> JohnRiv has joined #interactive-media
17:03:49 <Bill_Kasdorf> Bill_Kasdorf has joined #interactive-media
17:03:52 <Craig> Craig has joined #interactive-media
17:04:40 <marisa> marisa has joined #interactive-media
17:04:42 <cpn> Topic: AMPL
17:05:00 <cpn> Adam: It's under development, it's based on HTML, JS. Related to SMIL
17:05:04 <kaz> (Advanced Multimedia Processing Language)
17:05:19 <cpn> ... It supports sequential content, supports multiple video streams combined into one output stream
17:05:28 <cpn> ... Place logo onto a video
17:05:42 <cpn> ... Choice points include switch/case and goto are in the markup language
17:05:47 <kaz> s/(Advanced Multimedia Processing Language)//
17:05:49 <cpn> ... Example of an intro video with menu
17:05:58 <kaz> i/It's/(Advanced Multimedia Processing Language)/
17:06:03 <cpn> ... Paths converge on an outro video
17:06:16 <cpn> ... Choice points may not use a menu, but instead be JS based
17:06:39 <cpn> ... Education scenarios, different application logic and user context
17:06:55 <cpn> ... Metadata to provide context for users
17:07:18 <cpn> ... Metadata can describe the context and framing of the choices presented
17:07:25 <cpn> Topic: Attaching semantics to video
17:07:54 <cpn> Adam: Spatial bounding boxes, auxiliary video tracks containing output of computer vision algorithms
17:08:06 <cpn> ... Animated silhouettes. Can be referred to by URI
17:08:17 <cpn> Topic: Multipart Data Markup
17:08:27 <cpn> ... Can enhance i18n
17:08:41 <cpn> ... We'll consider those approaches on the menu markup language
17:08:51 <cpn> ... Accessibility, multimodality will be considered
17:08:57 <cpn> Topic: Web Remote Protocol
17:09:23 <cpn> Adam: AMPL servers could render to one or more video streams for HTML5 video or WebRTC
17:09:30 <cpn> ... Stream interactive multimedia content
17:09:40 <cpn> ... More efficient encoding than traditional video
17:09:59 <cpn> ... Instructions for layout boxes, stream back input events for mouse and touchscreen
17:10:15 <cpn> ... More advance than existing remote desktop software
17:10:29 <cpn> ... Can be used for optimising WebRTC
17:10:40 <cpn> ... 3D game engines and CAD
17:11:15 <cpn> ... Can stream, modify, delete layout boxes
17:11:32 <cpn> ... Layout boxes on top of the video could contain hyperlinks
17:12:00 <cpn> ... Layout tracks can use new protocols, style and position, animate on the screen
17:12:09 <cpn> Topic: Publishing
17:12:26 <cpn> Adam: Interactive fiction is a use case
17:12:33 <cpn> Topic: Media
17:12:52 <cpn> Adam: Could focus on hypertext overlays, e.g., lower thirds
17:13:11 <cpn> ... Example of two video streams, replace overlay video with hypertext
17:13:22 <cpn> Topic: Live streaming
17:13:30 <cpn> Adam: Important use case, e.g., live news ticker
17:13:32 <cpn> Topic: AI
17:13:59 <cpn> Adam: Speech recognition, could ensure interop with simple or advanced dialog systems
17:14:17 <cpn> ... Synchronisation between resources enable chatbots
17:14:30 <cpn> ... Synchronsation with dialog systems involve time-based metadata
17:15:20 <cpn> The CG is interested in all forms of interactive media. The group discusses how standardisation can help
17:15:28 <cpn> s/The/... The/
17:15:35 <cpn> ... I'd like to invite your participation
17:15:56 <tidoust> tidoust has joined #interactive-media
17:16:04 <wendyreid> q?
17:16:06 <zheng_xu> q+
17:16:08 <kaz> q+
17:16:09 <AdamSobieski> https://docs.google.com/presentation/d/1NwIJaz-Lin8WNmop_fjkvjaJr7L_P2-iSgrDUSsCO00/edit#slide=id.g1135e4528bf_12_14
17:16:17 <leonardr> q+
17:16:26 <marisa> q+
17:16:27 <wendyreid> ack zheng_xu
17:16:31 <cpn> Topic: Q&A
17:17:08 <cpn> Zheng: It's interesting to hear about AMPL. It's trying to solve a lot of problems. What are the issues with current HTML5 or digital publishing that are solved?
17:17:22 <gpellegrino> gpellegrino has joined #interactive-media
17:17:24 <cpn> Adam: AMPL is a general purpose tool. It uses HTML and CSS
17:17:29 <gpellegrino> present+
17:17:58 <cpn> ... I've been focusing on synchronising clients and servers, animations on top of videos for clients. Hypervideo
17:18:06 <cpn> Zheng: Any existing prototypes?
17:18:10 <wendyreid> ack kaz
17:18:14 <cpn> Adam: Not yet, it's quite new
17:18:37 <wendyreid> q+
17:18:55 <cpn> Kaz: It seems to me that this possible too generic. There were several generic frameworks in W3C such as ?? and ??
17:19:20 <cpn> ... I'd like to see the typical target use cases and a gap analysis with existing frameworks, to identify what's expected and required
17:19:32 <cpn> ... And then see what kind of concrete data model is needed
17:19:40 <cpn> Adam: Interactive video is a first use case
17:20:16 <cpn> Kaz: You've also input to the WoT group, there's potential integration with video content and hardware for playback or recording. Could think of that kind of use case to identify requirements
17:20:19 <cpn> q?
17:20:20 <wendyreid> ack leonardr
17:20:47 <cpn> Leonard: Interesting presentation. Have you thought about how the group might try to choose between potential directions?
17:20:52 <zheng_xu> q+
17:21:06 <cpn> ... Any one could be a significant investment. What are your thoughts on the process?
17:21:37 <cpn> Adam: We'd use prefixes on the mailing list to distinguish topics. I'm hoping to work on the menu markup language
17:21:50 <cpn> Leonard: This assumes AMPL is a foundational technology
17:22:11 <wendyreid> ack marisa
17:22:11 <cpn> Adam: Optimistically yes, needs a markup for menus and multimodality. I'm putting the technology forward as an option
17:22:12 <kaz> s/?? and ??/MMI Architecture and SCXML./
17:22:50 <cpn> Marisa: I'm working on accessbility in multimedia. Could you switch on rich content such as caption tracks. Introduces authoring complexities. Where does that sit in the plan?
17:23:03 <wendyreid> ack wendyreid
17:23:04 <cpn> Adam: Focus on menus
17:23:25 <cpn> Wendy: Does the CG have a use cases document yet?
17:23:35 <cpn> Adam: Not yet, that would be something to do early on
17:23:39 <Karen> +1 use cases document
17:23:49 <cpn> Wendy: I think that would help to help alignment
17:23:52 <wendyreid> ack zheng_xu
17:24:39 <cpn> Zheng: Interactive video is interesting. Netflix and YouTube. Users can choose a story, is that a vision here?
17:24:52 <cpn> Adam: Yes, that's a use case we can include
17:24:53 <cpn> q?
17:24:54 <cpn> q+
17:25:00 <wendyreid> ack cpn
17:25:02 <wendyreid> scribe+
17:25:18 <wendyreid> cpn: In my org we've been working on a technology called object based media
17:25:37 <wendyreid> ... I think there is some overlap, branching narratives, responsive overlays on videos
17:25:42 <wendyreid> ... more adaptive to devices
17:25:56 <wendyreid> ... have you established any other connections to communities interested in these topics?
17:26:13 <wendyreid> AdamSobieski: I've reached out to Twine, an interactive fiction group
17:26:32 <Craig> q+
17:26:33 <wendyreid> ... at BBC there's a tool called Story Former, interactive video and film, I'm new to that community as well
17:26:45 <wendyreid> ack Craig
17:27:00 <wendyreid> Craig: Use case of accessible menus and choice points
17:27:13 <wendyreid> ... have you played around with implementing that in modern browsers
17:27:21 <wendyreid> ... what limitations did you encounter?
17:27:36 <wendyreid> AdamSobieski: I haven't started yet aside from visualziing
17:27:50 <wendyreid> ... it's just getting started, no foreseeable obstacles
17:28:05 <wendyreid> ... just a standard way to make a menu
17:28:10 <zheng_xu> q+
17:28:19 <wendyreid> ack zheng_xu
17:28:35 <wendyreid> zheng_xu: In the presentation, in some parts it looks like there is overlap with SMIL
17:28:45 <cpn> q+
17:28:48 <wendyreid> ... how to map text or other media to audio to read to the user
17:28:51 <wendyreid> ... have you looked at this?
17:29:10 <wendyreid> AdamSobieski: We would definitely be referencing the SMIL standard in our documents
17:29:21 <leonardr> q+
17:29:24 <wendyreid> ... some of the differences include using JS and CSS
17:29:28 <wendyreid> ack cpn
17:29:44 <wendyreid> cpn: Another question, where we see needs for interoperability
17:30:08 <wendyreid> ... one aspect to consider, limitations in existing browsers for playback and rendering
17:30:31 <wendyreid> ... for things like SMIL, are you thinking we end up with a standardized runtime environment for interactive experiences
17:30:59 <wendyreid> AdamSobieski: I was considering an AMPL player that uses all of the methods I presented, reference implementation for an AMPL player
17:31:02 <cpn> q?
17:31:03 <wendyreid> ack leonardr
17:31:26 <wendyreid> leonardr: You mentioned before, one of the big issues in publishing land is around security
17:31:35 <wendyreid> ... one of the concerns there is presence of JS in EPUB
17:31:45 <wendyreid> ... presence of scripting in EPUB is considered problematic
17:31:59 <wendyreid> ... AMPL would use scripting, do you see it as required or optional?
17:32:03 <wendyreid> ... or declarative
17:32:19 <wendyreid> AdamSobieski: In the example with a switch case, you could use declarative markup for the spine in an EPUB
17:32:23 <wendyreid> ... a non-linear graph
17:32:42 <wendyreid> ... Twine makes interactive fiction, I would be advocating for some JS, but I understand your points
17:32:51 <wendyreid> leonardr: I look forward to those conversations
17:32:59 <cpn> q?
17:33:05 <Craig> q+
17:33:36 <wendyreid> Craig: It feels like the logical first step is bridging the gap between the current standards and what we need
17:34:11 <wendyreid> ... review the current browser implementations and then use this as a use case to push some initiatives ahead
17:34:20 <wendyreid> ... a layer on top to address some of the security concerns
17:34:29 <wendyreid> AdamSobieski: Looking forward to feedback from others
17:34:33 <cpn> q?
17:34:34 <wendyreid> ack Craig
17:34:59 <wendyreid> cpn: Where do we go next? What is the status of the CG?
17:35:16 <wendyreid> AdamSobieski: The group is new and ready to join
17:35:31 <wendyreid> ... it's currently growing and we'll be working on structure and chairs and use case documents next
17:35:38 <wendyreid> cpn: Could you share a link?
17:36:00 <AdamSobieski> https://www.w3.org/community/interactive-media/
17:36:02 <wendyreid> ... one thing I might recommend is to set a charter to establish a scope and goals for the group
17:36:16 <wendyreid> ... it seems broad, and drafting a charter can help scope the work
17:36:20 <wendyreid> ... there is a template somewhere
17:36:38 <wendyreid> AdamSobieski: I think a charter will be a useful first step
17:36:41 <zheng_xu> q+
17:36:53 <wendyreid> ... in there we can describe the process for chairs, co-chairs, work items
17:37:10 <wendyreid> ... use case documents, AMPL, menus, and other interesting projects for standardization
17:37:18 <wendyreid> ack zheng_xu
17:37:30 <wendyreid> zheng_xu: If there is anything the Publishing CG can help with, please let us know
17:37:45 <wendyreid> ... it's more focused on work with the EPUB3 WG and incubation
17:37:53 <wendyreid> ... use cases and documentation for digital publishing
17:38:04 <wendyreid> AdamSobieski: Thanks
17:38:13 <gpellegrino> q+
17:38:45 <wendyreid> cpn: I'd like to echo that for the Media and Entertainment Interest Group, we are interested in media related use cases
17:38:55 <wendyreid> ... and also from the Media WG point of vieew
17:39:09 <wendyreid> ... if there is a gap analysis in the browser APIs, we can take that forward as well
17:39:22 <wendyreid> ... we welcome this new group and want to keep in contact
17:39:30 <wendyreid> ack gpellegrino
17:39:48 <wendyreid> gpellegrino: I joined a little late, so you might have answered, I work in accessibility
17:40:02 <wendyreid> ... do you see use cases for accessible interactive media, aside from media overlays
17:40:12 <wendyreid> ... do you see possible accessibility issues
17:40:19 <wendyreid> ... anything that is not just text poses problems
17:40:38 <wendyreid> AdamSobieski: My own interest pertains to education and educational technology, so accessibility is important
17:40:57 <wendyreid> ... speech synthesis and speech recognition, accessibility is key to our work
17:41:03 <CharlesL1> q+
17:41:10 <wendyreid> ack CharlesL1
17:41:16 <wendyreid> ack CharlesL
17:41:44 <cpn> Charles: I'm curious about interactive video, having a live transcript that you can click on to select words or phrases and go to that part of the book and highlight it
17:42:09 <cpn> ... Work that Kim Patch has donw with WordPress plugins
17:42:34 <cpn> Adam: Interesting, I can see how that would help with multimedia search. Something to consider
17:42:55 <cpn> ... We talked about dialog systems and synchronise to the video. There might be some overlap there
17:43:02 <wendyreid> q?
17:43:45 <cpn> Wendy: What are the next steps? Sounds like you have a good idea of what to do with the CG
17:43:56 <cpn> ... I can share the link with the publishing community
17:45:07 <cpn> cpn: Craig, any communities we can connect Adam with?
17:45:36 <cpn> Craig: There's the BBC MakerBox community. This CG could be a helpful point of contact for us
17:45:57 <cpn> Adam: Thank you. Everyone from MakerBox and StoryFormer is welcome
17:46:35 <cpn> ... We've published some things, got people to look at it, but need to look at the tech to support it
17:46:47 <cpn> q?
17:49:04 <cpn> [adjourned]
17:49:08 <cpn> rrsagent, draft minutes
17:49:08 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/09-interactive-media-minutes.html cpn
17:49:13 <cpn> rrsagent, make log public
17:49:30 <gpellegr_> gpellegr_ has joined #interactive-media
17:49:59 <cpn> Chair: Chris_Needham, Wendy_Reid
17:50:01 <cpn> rrsagent, draft minutes
17:50:01 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/09-interactive-media-minutes.html cpn
17:50:56 <cpn> i/Topic: AMPL/https://docs.google.com/presentation/d/1NwIJaz-Lin8WNmop_fjkvjaJr7L_P2-iSgrDUSsCO00/edit/
17:50:58 <cpn> rrsagent, draft minutes
17:50:58 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/09-interactive-media-minutes.html cpn
17:54:26 <cpn> s/.../ We've/Craig: We've/
17:54:28 <cpn> rrsagent, draft minutes
17:54:28 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/09-interactive-media-minutes.html cpn
17:56:56 <cpn> i/AdamSobieski: I think a charter will be a useful first step/https://w3c.github.io/cg-charter/CGCharter.html/
17:56:59 <cpn> rrsagent, draft minutes
17:56:59 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/09-interactive-media-minutes.html cpn
18:21:15 <Karen> Karen has joined #interactive-media
19:29:51 <gpellegrino> gpellegrino has joined #interactive-media
19:50:22 <gpellegrino> gpellegrino has joined #interactive-media
19:55:51 <gpellegr_> gpellegr_ has joined #interactive-media
20:16:25 <Zakim> Zakim has left #interactive-media
20:37:37 <Karen> Karen has joined #interactive-media
21:10:44 <Karen> Karen has joined #interactive-media
22:26:02 <Karen> Karen has joined #interactive-media