Bug 259482 - REGRESSION(264554@main): [ WK2 ] fast/media/managed-media-source-open-crash.html is a flaky failure
Summary: REGRESSION(264554@main): [ WK2 ] fast/media/managed-media-source-open-crash.h...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-07-25 09:35 PDT by Ben Schwartz
Modified: 2023-07-27 09:41 PDT (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-07-25 09:35:48 PDT 
fast/media/managed-media-source-open-crash.html

This test is a consistent/flaky failure on WK2.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=fast%2Fmedia%2Fmanaged-media-source-open-crash.html&flavor=wk2

TEXT DIFF:

-CONSOLE MESSAGE: Unhandled Promise Rejection: InvalidStateError: The object is in an invalid state.
 PASS if no crash.

DIFF URL:

https://build.webkit.org/results/Apple-Monterey-Release-AppleSilicon-WK2-Tests/266291@main%20(10275)/fast/media/managed-media-source-open-crash-pretty-diff.html
Comment 1 Radar WebKit Bug Importer 2023-07-25 09:36:00 PDT 
<rdar://problem/112839193>
Comment 2 Ben Schwartz 2023-07-25 09:40:25 PDT 
I was able to reproduce this bug on macOS Ventura using arm64 running the test as follows:

run-webkit-tests fast/media/managed-media-source-open-crash.html --iterations 50

Using the flakiness dashboard, I was able to identify that the regression point appears to be the test's introduction to the project at 264554@main.
Comment 3 Ben Schwartz 2023-07-25 09:49:04 PDT 
Pull request: https://github.com/WebKit/WebKit/pull/16070
Comment 4 EWS 2023-07-25 10:21:06 PDT 
Test gardening commit 266294@main (d9c2f80ff563): <https://commits.webkit.org/266294@main>

Reviewed commits have been landed. Closing PR #16070 and removing active labels.
Comment 5 Ben Schwartz 2023-07-25 10:22:04 PDT 
To clarify, this is a flaky failure; however, it is fairly consistently failing (which is why I wrote "consistent/flaky failure" in the original bug message).

I have marked this test as a flaky failure while this issue is investigated (https://github.com/WebKit/WebKit/pull/16070).
Comment 6 Ben Schwartz 2023-07-27 09:41:56 PDT 
Investigation completed, determined that it is normal for the test to either pass or fail. Closing as resolved.