Bug 263226

Summary:	REGRESSION(268692@main?): [ macOS ] 7 tests under imported/w3c/web-platform-tests/media-source/mediasource-* are flaky failures.
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	Media	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	jean-yves.avenard, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=262231

Description Ben Schwartz 2023-10-16 16:54:18 PDT

The following tests are flaky failures on macOS (being more consistent on wk1 debug):

imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-audio-bitrate.html
imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-video-bitrate.html
imported/w3c/web-platform-tests/media-source/mediasource-play-then-seek-back.html
imported/w3c/web-platform-tests/media-source/mediasource-play.html
imported/w3c/web-platform-tests/media-source/mediasource-redundant-seek.html
imported/w3c/web-platform-tests/media-source/mediasource-remove-preserves-currentTime.html
imported/w3c/web-platform-tests/media-source/mediasource-remove.html

HISTORY:

https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-config-change-mp4-av-audio-bitrate.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-config-change-mp4-av-video-bitrate.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-play-then-seek-back.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-play.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-redundant-seek.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-remove-preserves-currentTime.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-remove.html

TEXT DIFF:

-PASS Tests mp4 audio bitrate changes in multiplexed content.
+FAIL Tests mp4 audio bitrate changes in multiplexed content. assert_equals: Event types match. expected "update" but got "updateend"

DIFF URL:

https://build.webkit.org/results/Apple-Sonoma-Debug-AppleSilicon-WK2-Tests/269370@main%20(208)/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-audio-bitrate-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Sonoma (14.0, 23A344/arm64) ToT using the following command:

run-webkit-tests -1 --debug --clobber-old-results --iterations 100 --child-processes 10 -f imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-audio-bitrate.html imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-video-bitrate.html imported/w3c/web-platform-tests/media-source/mediasource-play-then-seek-back.html imported/w3c/web-platform-tests/media-source/mediasource-play.html imported/w3c/web-platform-tests/media-source/mediasource-redundant-seek.html imported/w3c/web-platform-tests/media-source/mediasource-remove-preserves-currentTime.html imported/w3c/web-platform-tests/media-source/mediasource-remove.html

REGRESSION:

I was able to identify a potential regression point at 268692@main. Changes at this point seem to be related to this issue; however, I am not sure.

Comment 1 Radar WebKit Bug Importer 2023-10-16 16:54:40 PDT

<rdar://problem/117044354>

Comment 2 Ben Schwartz 2023-10-16 17:07:55 PDT

I observed a couple of isolated instances of crashes/timeouts on some of the tests; however, I decided not to file those as part of this test gardening commit since they could be isolated/separate issues.

Comment 3 EWS 2023-10-16 17:10:07 PDT

Test gardening commit 269389@main (418b7e23c9ec): <https://commits.webkit.org/269389@main>

Reviewed commits have been landed. Closing PR #19139 and removing active labels.