Bug 256108

Summary: New test: [macOS] media/video-audio-session-mode.html is a constant text failure
Product: WebKit Reporter: Robert Jenner <jenner>
Component: MediaAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: dino, jer.noble, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=255681
Attachments:
Description Flags
Test list used for reproduction case none

Description Robert Jenner 2023-04-28 13:53:21 PDT 
media/video-audio-session-mode.htm

is a constant text failure on macOS Monterey and higher.

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=webaudio%2Faudiocontext-low-samplerate.html

TEXT DIFF:
 RUN(video.pause())
 RUN(video.muted = true)
 EXPECTED (internals.audioSessionCategory() == 'MoviePlayback'), OBSERVED 'MediaPlayback' FAIL
-EXPECTED (internals.audioSessionMode() == 'Default') OK
+EXPECTED (internals.audioSessionMode() == 'Default'), OBSERVED 'MoviePlayback' FAIL
 EXPECTED (internals.routeSharingPolicy() == 'LongFormAudio') OK
 
 ** And check again after 3 seconds.
-EXPECTED (internals.audioSessionCategory() == 'None') OK
-EXPECTED (internals.routeSharingPolicy() == 'Default') OK
+EXPECTED (internals.audioSessionCategory() == 'None'), OBSERVED 'MediaPlayback' FAIL
+EXPECTED (internals.routeSharingPolicy() == 'Default'), OBSERVED 'LongFormAudio' FAIL
 END OF TEST
 

DIFF URL:
https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/263510@main%20(2966)/media/video-audio-session-mode-pretty-diff.html


This is a newly introduced test that has been failing since its introduction at https://commits.webkit.org/263201@main
Comment 1 Radar WebKit Bug Importer 2023-04-28 13:54:47 PDT 
<rdar://problem/108675835>
Comment 2 Robert Jenner 2023-04-28 15:15:20 PDT 
This does not reproduce standalone. But it does reproduce in a test list every time running at Ventura Debug ToT as follows:

run-webkit-tests --test-list <path_to_test_list.txt_goes_here>

So this appears to be a test list ordering issue. 

I have attached the test list used for repo do this bug.
Comment 3 Robert Jenner 2023-04-28 15:16:00 PDT 
Created attachment 466134 [details]
Test list used for reproduction case
Comment 4 Robert Jenner 2023-04-28 17:07:10 PDT 
So far not appears that when the following tests run BEFORE 'media/video-audio-session-mode.html' it causes said test to fail:

media/remoteplayback-cancel-invalid.html
media/remoteplayback-target-availability.html
media/remoteplayback-watch-availability-gc.html
media/remoteplayback-watch-disableremoteplayback.html
media/remoteplayback-prompt.html


When those tests are removed from the test list, 'media/video-audio-session-mode.htm' passes.
Comment 5 EWS 2023-04-28 17:20:15 PDT 
Test gardening commit 263523@main (2dd3036f6702): <https://commits.webkit.org/263523@main>

Reviewed commits have been landed. Closing PR #13297 and removing active labels.