Bug 259740 - [ Ventura Release arm64 WK2 ] css3/color-filters/color-filter-outline.html is a flaky IMAGE failure
Summary: [ Ventura Release arm64 WK2 ] css3/color-filters/color-filter-outline.html is...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: CSS (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-08-02 10:31 PDT by Ben Schwartz
Modified: 2023-08-04 07:33 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-08-02 10:31:05 PDT
css3/color-filters/color-filter-outline.html

This test is a flaky failure on macOS Ventura, on arm64 machines, running release versions.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=css3%2Fcolor-filters%2Fcolor-filter-outline.html&platform=mac&version_name=Ventura&style=release&architecture=arm64&flavor=wk2

COMPARE LINK:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/264919@main%20(3433)/css3/color-filters/color-filter-outline-diffs.html

DIFF PICTURE:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/264919@main%20(3433)/css3/color-filters/color-filter-outline-diff.png

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura arm64 release ToT running the test as follows:

run-webkit-tests --clobber-old-results --iterations 500 --verbose --exit-after-n-failures=1 css3/color-filters/color-filter-outline.html

REGRESSION:

I was unable to bisect a clear regression point; however, the failure appears to be due to a faulty test rather than a regression in the code. See the diff picture for the test results -- it appears that the text above the intended test subject is being evaluated as part of the test.
Comment 1 Radar WebKit Bug Importer 2023-08-02 10:31:18 PDT
<rdar://problem/113277222>
Comment 2 Ben Schwartz 2023-08-02 10:42:11 PDT
I have set marked test as a flaky failure on the reported platform while the issue is being investigated. (PR link: https://github.com/WebKit/WebKit/pull/16320)
Comment 3 EWS 2023-08-02 10:56:45 PDT
Test gardening commit 266518@main (2f2651de9589): <https://commits.webkit.org/266518@main>

Reviewed commits have been landed. Closing PR #16320 and removing active labels.