Bug 259482

Summary:	REGRESSION(264554@main): [ WK2 ] fast/media/managed-media-source-open-crash.html is a flaky failure
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	Media	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED CONFIGURATION CHANGED
Severity:	Normal	CC:	chirag_m_shah, jer.noble, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=257345

Description Ben Schwartz 2023-07-25 09:35:48 PDT

fast/media/managed-media-source-open-crash.html

This test is a consistent/flaky failure on WK2.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=fast%2Fmedia%2Fmanaged-media-source-open-crash.html&flavor=wk2

TEXT DIFF:

-CONSOLE MESSAGE: Unhandled Promise Rejection: InvalidStateError: The object is in an invalid state.
 PASS if no crash.

DIFF URL:

https://build.webkit.org/results/Apple-Monterey-Release-AppleSilicon-WK2-Tests/266291@main%20(10275)/fast/media/managed-media-source-open-crash-pretty-diff.html

Comment 1 Radar WebKit Bug Importer 2023-07-25 09:36:00 PDT

<rdar://problem/112839193>

Comment 2 Ben Schwartz 2023-07-25 09:40:25 PDT

I was able to reproduce this bug on macOS Ventura using arm64 running the test as follows:

run-webkit-tests fast/media/managed-media-source-open-crash.html --iterations 50

Using the flakiness dashboard, I was able to identify that the regression point appears to be the test's introduction to the project at 264554@main.

Comment 3 Ben Schwartz 2023-07-25 09:49:04 PDT

Pull request: https://github.com/WebKit/WebKit/pull/16070

Comment 4 EWS 2023-07-25 10:21:06 PDT

Test gardening commit 266294@main (d9c2f80ff563): <https://commits.webkit.org/266294@main>

Reviewed commits have been landed. Closing PR #16070 and removing active labels.

Comment 5 Ben Schwartz 2023-07-25 10:22:04 PDT

To clarify, this is a flaky failure; however, it is fairly consistently failing (which is why I wrote "consistent/flaky failure" in the original bug message).

I have marked this test as a flaky failure while this issue is investigated (https://github.com/WebKit/WebKit/pull/16070).

Comment 6 Ben Schwartz 2023-07-27 09:41:56 PDT

Investigation completed, determined that it is normal for the test to either pass or fail. Closing as resolved.