Bug 259489 - REGRESSION(266260@main): [ Monterey+ ] http/tests/media/hls/track-in-band-multiple-cues.html is a flaky failure
Summary: REGRESSION(266260@main): [ Monterey+ ] http/tests/media/hls/track-in-band-mul...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Jer Noble
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-07-25 10:49 PDT by Ben Schwartz
Modified: 2023-09-22 13:15 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-07-25 10:49:02 PDT
http/tests/media/hls/track-in-band-multiple-cues.html

This test is a flaky failure on macOS (with the exception of macOS Ventura WK1, which is a constant crash -- see related bug #259485).

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fhls%2Ftrack-in-band-multiple-cues.html

TEXT DIFF:

 Test that multiple cues in a sample buffer are parsed correctly.
 
 EVENT(addtrack)
+EVENT(cuechange)
 EVENT(playing)
-EVENT(cuechange)
 EXPECTED (track.cues.length === '5') OK
 
 END OF TEST

DIFF URL:

https://build.webkit.org/results/Apple-Monterey-Debug-AppleSilicon-WK1-Tests/266282@main%20(7963)/http/tests/media/hls/track-in-band-multiple-cues-pretty-diff.html
Comment 1 Radar WebKit Bug Importer 2023-07-25 10:49:25 PDT
<rdar://problem/112844842>
Comment 2 Ben Schwartz 2023-07-25 11:56:48 PDT
I was unable to reproduce this bug on any local testing environments; however, according to the diff, I suspect that the issue is related to the test attempting to synchronously check the order of asynchronous events (i.e., EVENT(cuechange) is firing before EVENT(playing) in some instances, but the test always expects vice versa).
Comment 3 Ben Schwartz 2023-07-25 12:09:15 PDT
I have marked this test as a flaky failure while this issue is investigated. (Link: https://github.com/WebKit/WebKit/pull/16076)
Comment 4 EWS 2023-07-25 13:26:21 PDT
Test gardening commit 266300@main (f08fe222fd75): <https://commits.webkit.org/266300@main>

Reviewed commits have been landed. Closing PR #16076 and removing active labels.
Comment 5 Jer Noble 2023-09-21 10:08:18 PDT
Pull request: https://github.com/WebKit/WebKit/pull/18024
Comment 6 EWS 2023-09-22 13:15:26 PDT
Committed 268328@main (33b8e8e1b031): <https://commits.webkit.org/268328@main>

Reviewed commits have been landed. Closing PR #18024 and removing active labels.