media/video-audio-session-mode.htm is a constant text failure on macOS Monterey and higher. HISTORY: https://results.webkit.org/?suite=layout-tests&test=webaudio%2Faudiocontext-low-samplerate.html TEXT DIFF: RUN(video.pause()) RUN(video.muted = true) EXPECTED (internals.audioSessionCategory() == 'MoviePlayback'), OBSERVED 'MediaPlayback' FAIL -EXPECTED (internals.audioSessionMode() == 'Default') OK +EXPECTED (internals.audioSessionMode() == 'Default'), OBSERVED 'MoviePlayback' FAIL EXPECTED (internals.routeSharingPolicy() == 'LongFormAudio') OK ** And check again after 3 seconds. -EXPECTED (internals.audioSessionCategory() == 'None') OK -EXPECTED (internals.routeSharingPolicy() == 'Default') OK +EXPECTED (internals.audioSessionCategory() == 'None'), OBSERVED 'MediaPlayback' FAIL +EXPECTED (internals.routeSharingPolicy() == 'Default'), OBSERVED 'LongFormAudio' FAIL END OF TEST DIFF URL: https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/263510@main%20(2966)/media/video-audio-session-mode-pretty-diff.html This is a newly introduced test that has been failing since its introduction at https://commits.webkit.org/263201@main
<rdar://problem/108675835>
This does not reproduce standalone. But it does reproduce in a test list every time running at Ventura Debug ToT as follows: run-webkit-tests --test-list <path_to_test_list.txt_goes_here> So this appears to be a test list ordering issue. I have attached the test list used for repo do this bug.
Created attachment 466134 [details] Test list used for reproduction case
So far not appears that when the following tests run BEFORE 'media/video-audio-session-mode.html' it causes said test to fail: media/remoteplayback-cancel-invalid.html media/remoteplayback-target-availability.html media/remoteplayback-watch-availability-gc.html media/remoteplayback-watch-disableremoteplayback.html media/remoteplayback-prompt.html When those tests are removed from the test list, 'media/video-audio-session-mode.htm' passes.
Test gardening commit 263523@main (2dd3036f6702): <https://commits.webkit.org/263523@main> Reviewed commits have been landed. Closing PR #13297 and removing active labels.