14:48:25 <RRSAgent> RRSAgent has joined #ai-powered-accessibility
14:48:29 <RRSAgent> logging to https://www.w3.org/2024/09/25-ai-powered-accessibility-irc
14:48:29 <tpac-breakout-bot> RRSAgent, do not leave
14:48:30 <tpac-breakout-bot> RRSAgent, make logs public
14:48:31 <tpac-breakout-bot> Meeting: Demonstration of AI Powered Accessibility Auditing
14:48:31 <tpac-breakout-bot> Chair: David Fazio
14:48:31 <tpac-breakout-bot> Agenda: https://github.com/w3c/tpac2024-breakouts/issues/19
14:48:31 <Zakim> Zakim has joined #ai-powered-accessibility
14:48:32 <tpac-breakout-bot> Zakim, clear agenda
14:48:32 <Zakim> agenda cleared
14:48:32 <tpac-breakout-bot> Zakim, agenda+ Pick a scribe
14:48:33 <Zakim> agendum 1 added
14:48:33 <tpac-breakout-bot> Zakim, agenda+ Reminders: code of conduct, health policies, recorded session policy
14:48:33 <Zakim> agendum 2 added
14:48:33 <tpac-breakout-bot> Zakim, agenda+ Goal of this session
14:48:34 <Zakim> agendum 3 added
14:48:34 <tpac-breakout-bot> Zakim, agenda+ Discussion
14:48:34 <Zakim> agendum 4 added
14:48:34 <tpac-breakout-bot> Zakim, agenda+ Next steps / where discussion continues
14:48:35 <Zakim> agendum 5 added
14:48:36 <tpac-breakout-bot> tpac-breakout-bot has left #ai-powered-accessibility
17:31:47 <cyns> cyns has joined #ai-powered-accessibility
17:43:58 <cyns> cyns has left #ai-powered-accessibility
17:55:44 <hgarg> hgarg has joined #ai-powered-accessibility
18:00:26 <Susi_Pallero> Susi_Pallero has joined #ai-powered-accessibility
18:09:03 <mgarrish> mgarrish has joined #ai-powered-accessibility
18:10:07 <CharlesL> CharlesL has joined #ai-powered-accessibility
18:11:57 <NehaJ> NehaJ has joined #ai-powered-accessibility
18:12:39 <CharlesL> present+
18:13:21 <asully> asully has joined #ai-powered-accessibility
18:15:50 <giacomo-petri> giacomo-petri has joined #ai-powered-accessibility
18:15:53 <hgarg> present+
18:16:10 <Lionel_Wolberger> Lionel_Wolberger has joined #ai-powered-accessibility
18:16:19 <Lionel_Wolberger> zakim, who is here?
18:16:19 <Zakim> Present: CharlesL, hgarg
18:16:23 <Zakim> On IRC I see Lionel_Wolberger, giacomo-petri, asully, NehaJ, CharlesL, mgarrish, hgarg, Zakim, RRSAgent
18:16:42 <hgarg> scribe+
18:16:46 <MJ> MJ has joined #ai-powered-accessibility
18:17:00 <MJ> present+
18:17:20 <JackieFei> JackieFei has joined #ai-powered-accessibility
18:19:25 <zolkis> zolkis has joined #ai-powered-accessibility
18:19:40 <Daniel> Daniel has joined #ai-powered-accessibility
18:20:29 <lambda> lambda has joined #ai-powered-accessibility
18:20:42 <MJ> MJ has joined #ai-powered-accessibility
18:20:59 <hgo> hgo has joined #ai-powered-accessibility
18:21:14 <jamesn> jamesn has joined #ai-powered-accessibility
18:21:25 <hgarg> Traditionally accessibility audits have been manual. We're attempting use of AI to automate some of it.
18:21:38 <cyns> cyns has joined #ai-powered-accessibility
18:21:56 <hgarg> Leveraging AI (LLM's) where they help.
18:22:00 <duga> duga has joined #ai-powered-accessibility
18:22:07 <duga> present+
18:22:56 <edward> edward has joined #ai-powered-accessibility
18:23:29 <Ben_Tillyer_> Ben_Tillyer_ has joined #ai-powered-accessibility
18:23:34 <Ben_Tillyer_> present+
18:23:42 <cyns> present+
18:23:47 <hgarg> Current set of tools have limited localization in local languages. We have used AI to localize the tool itself and also to analyze/audit pages in different languages.
18:25:04 <cyns> Can you share a link to the slides? It's hard to see in the room
18:25:24 <JaseW> JaseW has joined #ai-powered-accessibility
18:27:26 <ericaconnell2> ericaconnell2 has joined #ai-powered-accessibility
18:27:33 <kzms2> kzms2 has joined #ai-powered-accessibility
18:27:49 <hgarg> One rule that the tool checks against is WCAG 3.1.4 which checks for use of uncommon abbreviations in text.
18:30:00 <Fazio> Fazio has joined #ai-powered-accessibility
18:30:10 <hgarg> Another rule that the tool checks against is WCAG 3.1.4 which checks for use of unusual words in text.
18:30:12 <Fazio> present+
18:30:20 <Fazio> chair: Fazio
18:30:22 <Fazio> q?
18:30:47 <Ben_Tillyer_> @fazio, we have had requests for a link to the slides if possible
18:31:57 <hgarg> Use of LLM's allows analysis of different languages in the tool.
18:32:47 <ZoeBijl> ZoeBijl has joined #ai-powered-accessibility
18:33:18 <hgarg> The tool would incorporate elements to allow end users to interact with AI to fetch more examples or possible solutions for reported issues.
18:35:16 <hgarg> The tool also uses LLM's to analyze where the Link text is inadequate and could more meaningfully convey the link target.
18:40:34 <Ben_Tillyer_> q+ to ask 3 questions 1) about links 2) about hallucinations 3) about sustainability
18:40:59 <CharlesL> q+
18:41:08 <Fazio> q?
18:41:09 <NehaJ> present+
18:42:51 <hgarg> Question: `Click here` can be reported by non AI tools too. Do you look at the surrounding text too?
18:42:51 <hgarg> Answer: Yes, the context is shared with AI.
18:43:17 <Adam_Page> Adam_Page has joined #ai-powered-accessibility
18:43:58 <Ben_Tillyer_> ack ben
18:43:58 <Zakim> Ben_Tillyer_, you wanted to ask 3 questions 1) about links 2) about hallucinations 3) about sustainability
18:44:44 <hgarg> Question: How do you protect against hallucinations?
18:45:39 <hgarg> Answer: Human intervention is used.
18:47:18 <hgarg> Question: 10 clients submitting requests that are similar? Do you plan to offline some of the LLM responses?
18:47:18 <hgarg> Answer: Yes. Not yet. But a necessity.
18:49:25 <hgarg> Limits on number of tokens, requests are current challenges
18:50:03 <Ben_Tillyer_> q?
18:50:48 <Ben_Tillyer_> ack Char
18:51:40 <Fazio> q
18:51:40 <Fazio> ?
18:51:45 <Fazio> q?
18:51:48 <hgarg> Question: How do you fix source files hosted on wordpress?
18:51:48 <hgarg> Answer: We can't, but the idea is to test it locally via the tool. And then fix it at source
18:53:04 <hgarg> Question: Is checking for use of correct semantic tags on the horizon?
18:53:04 <hgarg> Answer: Yes, though not implemented yet. Work in progress.
18:53:38 <chrisp> chrisp has joined #ai-powered-accessibility
18:53:43 <Fazio> q?
18:53:53 <chrisp> q+
18:54:26 <CharlesL> CharlesL has left #ai-powered-accessibility
18:54:34 <hgarg> We will be at m-enabling in October also showcasing this.
18:54:49 <Ben_Tillyer_> ack chr
18:56:07 <Adam_Page> Adam_Page has left #ai-powered-accessibility
18:56:17 <hgarg> Question: Existing LLM's vs fine tuning vs prompt engineering, which one?
18:56:17 <hgarg> Answer: Existing LLM's with appropriate input from the web page for analysis.
18:56:25 <Ben_Tillyer_> q?
18:56:32 <Fazio> q?
18:57:32 <hgarg> Email: dfazio@helixopp.com
18:57:34 <Fazio> dfazio@helixopp.com
18:57:38 <NehaJ> njadhav@helixopp.com
18:57:42 <Ben_Tillyer_> rssagent, create minutes
18:59:00 <ZoeBijl> RRSAgent, make minutes
18:59:02 <RRSAgent> I have made the request to generate https://www.w3.org/2024/09/25-ai-powered-accessibility-minutes.html ZoeBijl
18:59:58 <hgarg> That worked ZoeBijl Ben_Tillyer_
19:00:03 <hgarg> Thanks
19:00:39 <ZoeBijl> Did that capture everything?
19:01:14 <hgarg> Yes most of what I put down as scribe.
19:01:21 <ZoeBijl> Zakim, end meeting
19:01:21 <Zakim> As of this point the attendees have been CharlesL, hgarg, MJ, duga, Ben_Tillyer_, cyns, Fazio, NehaJ
19:01:23 <Zakim> RRSAgent, please draft minutes
19:01:24 <RRSAgent> I have made the request to generate https://www.w3.org/2024/09/25-ai-powered-accessibility-minutes.html Zakim
19:01:31 <Zakim> I am happy to have been of service, ZoeBijl; please remember to excuse RRSAgent.  Goodbye
19:01:31 <Zakim> Zakim has left #ai-powered-accessibility
19:04:04 <ZoeBijl> RRSAgent, LEAVE
19:04:04 <RRSAgent> I see no action items