Bug 259740

Summary:	[ Ventura Release arm64 WK2 ] css3/color-filters/color-filter-outline.html is a flaky IMAGE failure
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	CSS	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	heycam, m_dubet, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Ben Schwartz 2023-08-02 10:31:05 PDT

css3/color-filters/color-filter-outline.html

This test is a flaky failure on macOS Ventura, on arm64 machines, running release versions.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=css3%2Fcolor-filters%2Fcolor-filter-outline.html&platform=mac&version_name=Ventura&style=release&architecture=arm64&flavor=wk2

COMPARE LINK:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/264919@main%20(3433)/css3/color-filters/color-filter-outline-diffs.html

DIFF PICTURE:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/264919@main%20(3433)/css3/color-filters/color-filter-outline-diff.png

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura arm64 release ToT running the test as follows:

run-webkit-tests --clobber-old-results --iterations 500 --verbose --exit-after-n-failures=1 css3/color-filters/color-filter-outline.html

REGRESSION:

I was unable to bisect a clear regression point; however, the failure appears to be due to a faulty test rather than a regression in the code. See the diff picture for the test results -- it appears that the text above the intended test subject is being evaluated as part of the test.

Comment 1 Radar WebKit Bug Importer 2023-08-02 10:31:18 PDT

<rdar://problem/113277222>

Comment 2 Ben Schwartz 2023-08-02 10:42:11 PDT

I have set marked test as a flaky failure on the reported platform while the issue is being investigated. (PR link: https://github.com/WebKit/WebKit/pull/16320)

Comment 3 EWS 2023-08-02 10:56:45 PDT

Test gardening commit 266518@main (2f2651de9589): <https://commits.webkit.org/266518@main>

Reviewed commits have been landed. Closing PR #16320 and removing active labels.