Bug 254351

Summary:	[ iOS, macOS ] imported/w3c/web-platform-tests/css/css-backgrounds/border-image-round-and-stretch.html is a constant ImageOnly Failure.
Product:	WebKit	Reporter:	Bri Harris <bharris9>
Component:	Layout and Rendering	Assignee:	Bri Harris <bharris9>
Status:	NEW ---
Severity:	Normal	CC:	bfulgham, ntim, simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer, zalan
Priority:	P2	Keywords:	InRadar
Version:	Other
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=155955

Description Bri Harris 2023-03-23 11:12:51 PDT

imported/w3c/web-platform-tests/css/css-backgrounds/border-image-round-and-stretch.html

is a constant ImageOnly Failure on iOS 16 and macOS.


HISTORY:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-backgrounds%2Fborder-image-round-and-stretch.html



LINK TO DIFF IMAGES: https://build.webkit.org/results/Apple-iOS-16-Simulator-Release-WK2-Tests/262014@main%20(1906)/imported/w3c/web-platform-tests/css/css-backgrounds/border-image-round-and-stretch-diff.png

Comment 1 Bri Harris 2023-03-23 11:18:36 PDT

I was able to replicate this failure on iOS 16 ToT as follows:

run-webkit-tests imported/w3c/web-platform-tests/css/css-backgrounds/border-image-round-and-stretch.html

I was also able to replicate at Ventura ToT the same way.

Comment 2 Radar WebKit Bug Importer 2023-03-23 11:19:06 PDT

<rdar://problem/107144311>

Comment 3 Bri Harris 2023-03-23 14:09:34 PDT

Pull request: https://github.com/WebKit/WebKit/pull/11887

Comment 4 EWS 2023-03-23 14:14:29 PDT

Test gardening commit 262037@main (f2b627192be8): <https://commits.webkit.org/262037@main>

Reviewed commits have been landed. Closing PR #11887 and removing active labels.

Comment 5 Ryan Haddad 2023-03-23 15:53:17 PDT

It looks like this test was re-enabled with https://commits.webkit.org/261903@main.

The fuzzy match metrics added with that commit seem to have made it pass on arm64 based macOS queues, but it continued to fail on x86 macOS bots as well as both arm64 and x86 iOS simulator queues.

The fuzzy match change in https://commits.webkit.org/262037@main may have been too extreme and might cover up real failures.

Comment 6 Brent Fulgham 2023-03-23 15:59:12 PDT

(In reply to Ryan Haddad from comment #5)
> It looks like this test was re-enabled with
> https://commits.webkit.org/261903@main.
> 
> The fuzzy match metrics added with that commit seem to have made it pass on
> arm64 based macOS queues, but it continued to fail on x86 macOS bots as well
> as both arm64 and x86 iOS simulator queues.
> 
> The fuzzy match change in https://commits.webkit.org/262037@main may have
> been too extreme and might cover up real failures.

I think the wider fuzzy-match values are better than the original state of an expected image failure.

It's frustrating that Arm and Intel have different pixel rounding on these images.