Bug 261052

Summary:	REGRESSION(267516@main): [ macOS ] editing/mac/dictionary-lookup/dictionary-lookup.html is a constant text failure.
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	Text	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	mmaxfield, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=261041 https://bugs.webkit.org/show_bug.cgi?id=259373 https://bugs.webkit.org/show_bug.cgi?id=261048 https://bugs.webkit.org/show_bug.cgi?id=261054

Description Ben Schwartz 2023-09-01 16:30:30 PDT

accessibility/mac/iframe-pdf.html

This test is a constant failure on all versions of macOS, wk2.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=editing%2Fmac%2Fdictionary-lookup%2Fdictionary-lookup.html

TEXT DIFF:

 Some text to look up.
 
 Lookup string for normal text: 'look'.
-Lookup string for title-case phrase: 'New'.
+Lookup string for title-case phrase: 'New York'.
 Lookup string for unselectable text: 'null'.

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/267553%40main%20(4741)/editing/mac/dictionary-lookup/dictionary-lookup-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --clobber-old-results --verbose editing/mac/dictionary-lookup/dictionary-lookup.html

REGRESSION:

I was able to identify a clear regression point at 267516@main, as the issue did not reproduce at 267515@main and the test was constantly passing before this point.

NOTE:

It appears this test itself needs to be re-baselined, as there is a trivial difference in the test expectation ("New" instead of "New York") that is likely outdated.

Comment 1 Radar WebKit Bug Importer 2023-09-01 16:30:52 PDT

<rdar://problem/114846802>

Comment 2 Ben Schwartz 2023-09-01 16:32:52 PDT

CORRECTION:

editing/mac/dictionary-lookup/dictionary-lookup.html

This test is a constant failure on all versions of macOS.

Comment 3 EWS 2023-09-01 16:48:02 PDT

Test gardening commit 267567@main (37da045c5ae4): <https://commits.webkit.org/267567@main>

Reviewed commits have been landed. Closing PR #17362 and removing active labels.

Comment 4 Ben Schwartz 2023-09-01 17:10:33 PDT

Closing, as issue verified resolved after changes landed.