Bug 259489

Summary:	REGRESSION(266260@main): [ Monterey+ ] http/tests/media/hls/track-in-band-multiple-cues.html is a flaky failure
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	Media	Assignee:	Jer Noble <jer.noble>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	eric.carlson, jer.noble, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=259485 https://bugs.webkit.org/show_bug.cgi?id=251771

Description Ben Schwartz 2023-07-25 10:49:02 PDT

http/tests/media/hls/track-in-band-multiple-cues.html

This test is a flaky failure on macOS (with the exception of macOS Ventura WK1, which is a constant crash -- see related bug #259485).

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fhls%2Ftrack-in-band-multiple-cues.html

TEXT DIFF:

 Test that multiple cues in a sample buffer are parsed correctly.
 
 EVENT(addtrack)
+EVENT(cuechange)
 EVENT(playing)
-EVENT(cuechange)
 EXPECTED (track.cues.length === '5') OK
 
 END OF TEST

DIFF URL:

https://build.webkit.org/results/Apple-Monterey-Debug-AppleSilicon-WK1-Tests/266282@main%20(7963)/http/tests/media/hls/track-in-band-multiple-cues-pretty-diff.html

Comment 1 Radar WebKit Bug Importer 2023-07-25 10:49:25 PDT

<rdar://problem/112844842>

Comment 2 Ben Schwartz 2023-07-25 11:56:48 PDT

I was unable to reproduce this bug on any local testing environments; however, according to the diff, I suspect that the issue is related to the test attempting to synchronously check the order of asynchronous events (i.e., EVENT(cuechange) is firing before EVENT(playing) in some instances, but the test always expects vice versa).

Comment 3 Ben Schwartz 2023-07-25 12:09:15 PDT

I have marked this test as a flaky failure while this issue is investigated. (Link: https://github.com/WebKit/WebKit/pull/16076)

Comment 4 EWS 2023-07-25 13:26:21 PDT

Test gardening commit 266300@main (f08fe222fd75): <https://commits.webkit.org/266300@main>

Reviewed commits have been landed. Closing PR #16076 and removing active labels.

Comment 5 Jer Noble 2023-09-21 10:08:18 PDT

Pull request: https://github.com/WebKit/WebKit/pull/18024

Comment 6 EWS 2023-09-22 13:15:26 PDT

Committed 268328@main (33b8e8e1b031): <https://commits.webkit.org/268328@main>

Reviewed commits have been landed. Closing PR #18024 and removing active labels.