WebKit Bugzilla
New
Browse
Search+
Log In
×
Sign in with GitHub
or
Remember my login
Create Account
·
Forgot Password
Forgotten password account recovery
NEW
256785
AX: Decorative Images have weird AI generated text read out
https://bugs.webkit.org/show_bug.cgi?id=256785
Summary
AX: Decorative Images have weird AI generated text read out
Zoltan Hawryluk
Reported
2023-05-15 08:02:49 PDT
This issue is on OSX Monterey using Safari 16.1 When doing accessibility testing, we found a very unusual bug. Voiceover reads out AI generated text in images rendered by Safari, even though the image is marked as decorative and should not have alt text. How to reproduce: 1) Go to
https://codepen.io/zoltan-dulac/pen/NWOBEQK
using Safari/Voiceover 2) Tab into the "dummy link" 3) Use Voiceover's reading mode to read the content (i.e. press CAPSLOCK+A). Instead of ignoring the text like it should, it reads the Shadow DOM content that has text that looks like it was generated by an OCR function that attempts to read the text inside the image (i.e. the text on the van's door). There is another related issue that involves tabbing into a link that contains the image: 1) Go to same page
https://codepen.io/zoltan-dulac/pen/NWOBEQK
using Safari/Voiceover 2) Tab into the "dummy link" 3) Tab into the link. Sometimes the screenreader reads the URL of the link. Sometimes it reads the OCR text. If you tab out of it and tab backwards into it again, it may give different results. It is very inconsistent. I tagged this as a major issue since decorative images reading incorrect information can be very confusing to screen reader users and result in misunderstanding the content of a webpage.
Attachments
Add attachment
proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1
2023-05-15 08:03:05 PDT
<
rdar://problem/109354127
>
Zoltan Hawryluk
Comment 2
2023-05-15 08:11:57 PDT
After I posted this bug, I did further reading and noticed it's part of Safari's LiveText implementation:
https://www.macworld.com/article/351094/ios-15-how-live-text-camera-photos-safari.html
While this feature can be useful, it shouldn't be overriden and read as the default text to screen reader users when the alt="".
Zoltan Hawryluk
Comment 3
2023-07-24 08:10:43 PDT
There has been no traction made on this ticket. Is there any update on this? This is a serious accessibility issue, and I want to see if there was a way this can be fixed and if a developer can work around this.
Note
You need to
log in
before you can comment on or make changes to this bug.
Top of Page
Format For Printing
XML
Clone This Bug