REOPENED254289
REGRESSION(259811@main-259818@main): [ iOS Debug ] 4X TestWebKitAPI.AppPrivacyReport (API-Tests) are failing 
https://bugs.webkit.org/show_bug.cgi?id=254289
Summary REGRESSION(259811@main-259818@main): [ iOS Debug ] 4X TestWebKitAPI.AppPrivac...
Robert Jenner
Reported 2023-03-22 14:46:28 PDT
The following 4X TestWebKitAPI.AppPrivacyReport (API-Tests) are constant timeouts on iOS Debug: TestWebKitAPI.AppPrivacyReport.RestoreFromInteractionStateIsAppInitiated TestWebKitAPI.AppPrivacyReport.RestoreFromInteractionStateIsNonAppInitiated TestWebKitAPI.AppPrivacyReport.RestoreFromSessionStateIsAppInitiated TestWebKitAPI.AppPrivacyReport.RestoreFromSessionStateIsNonAppInitiated HISTORY: https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.AppPrivacyReport.RestoreFromInteractionStateIsAppInitiated&test=TestWebKitAPI.AppPrivacyReport.RestoreFromInteractionStateIsNonAppInitiated&test=TestWebKitAPI.AppPrivacyReport.RestoreFromSessionStateIsAppInitiated&test=TestWebKitAPI.AppPrivacyReport.RestoreFromSessionStateIsNonAppInitiated These tests appeared to be flaky timeouts, but switched to constant timeouts for debug iOS only between 259811@main and 259818@main
Attachments
Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2023-03-22 14:46:46 PDT
<rdar://problem/107077600>
Robert Jenner
Comment 2 2023-03-22 14:49:27 PDT
The other interesting thing about these tests is that they do appear to be consistently timing out on EWS observed here: https://ews-build.webkit.org/#/builders/13 However, they do not appear to be timing out on release in OpenSource/Post-commit testing.
Robert Jenner
Comment 3 2023-03-22 18:26:01 PDT
I was able to reproduce the timeouts at iOS 16 Debug ToT running the tests as follows: run-api-tests --ios-simulator <test_goes_here> --debug I will now attempt to bisect and uncover the regression point.
Alexey Proskuryakov
Comment 4 2023-03-25 19:29:29 PDT
This is marked RESOLVED/FIXED. but I see a false positive on EWS from these tests: https://ews-build.webkit.org/#/builders/13/builds/467
Ryan Haddad
Comment 5 2023-03-27 08:19:48 PDT
Reopening.
Ryan Haddad
Comment 6 2023-03-27 08:24:56 PDT
rdar://107268120
Ryan Haddad
Comment 7 2023-03-27 08:49:14 PDT
Pull request: https://github.com/WebKit/WebKit/pull/12007
EWS
Comment 8 2023-03-27 08:53:43 PDT
Test gardening commit 262152@main (1fa0bf2759a8): <https://commits.webkit.org/262152@main> Reviewed commits have been landed. Closing PR #12007 and removing active labels.
Alexey Proskuryakov
Comment 9 2023-03-27 09:34:26 PDT
Renaming to not say "constant timeouts", as the tests were flaky on EWS, causing false positives. But they definitely were 100% timing out in post commit.
EWS
Comment 10 2023-03-29 11:24:05 PDT
Test gardening commit 259548.509@safari-7615-branch (96be2e666d51): <https://commits.webkit.org/259548.509@safari-7615-branch> Reviewed commits have been landed. Closing PR #504 and removing active labels.
Ryan Haddad
Comment 11 2023-05-08 14:44:11 PDT
Pull request: https://github.com/WebKit/WebKit/pull/13600
Ryan Haddad
Comment 12 2023-05-09 09:11:40 PDT
(In reply to Ryan Haddad from comment #11) > Pull request: https://github.com/WebKit/WebKit/pull/13600 ^ this was to unskip the tests to see how they fared, they are still timing out.
Note You need to log in before you can comment on or make changes to this bug.