Bug 262088 - REGRESSION(266896@main): [ wk2 debug ] imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html is flaky failure
Summary: REGRESSION(266896@main): [ wk2 debug ] imported/w3c/web-platform-tests/fetch/...
Status: REOPENED
Alias: None
Product: WebKit
Classification: Unclassified
Component: DOM (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Ryosuke Niwa
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-09-25 17:41 PDT by Ben Schwartz
Modified: 2023-09-28 08:43 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-09-25 17:41:20 PDT
imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html

This test is a near-constant/consistent failure on all platforms, wk2 debug builds.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Ffetch%2Fprivate-network-access%2Fiframe.tentative.https.window.html&style=debug

TEXT DIFF:

 
-PASS local to local: no preflight required.
-PASS local to private: no preflight required.
-PASS local to public: no preflight required.
-FAIL private to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL local to local: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL local to private: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL local to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS private to local: failed preflight.
 PASS private to local: missing CORS headers.
 PASS private to local: missing PNA header.
 FAIL private to local: success. assert_equals: expected "loaded" but got "timeout"
-PASS private to private: no preflight required.
-PASS private to public: no preflight required.
-FAIL public to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL private to private: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL private to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS public to local: failed preflight.
 PASS public to local: missing CORS headers.
 PASS public to local: missing PNA header.
 FAIL public to local: success. assert_equals: expected "loaded" but got "timeout"
-FAIL public to private: failed preflight. assert_equals: expected "timeout" but got "loaded"
+PASS public to private: failed preflight.
 PASS public to private: missing CORS headers.
 PASS public to private: missing PNA header.
 FAIL public to private: success. assert_equals: expected "loaded" but got "timeout"
-PASS public to public: no preflight required.
-FAIL treat-as-public-address to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL public to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS treat-as-public-address to local: failed preflight.
 PASS treat-as-public-address to local: missing CORS headers.
 PASS treat-as-public-address to local: missing PNA header.
 FAIL treat-as-public-address to local: success. assert_equals: expected "loaded" but got "timeout"
-FAIL treat-as-public-address to private: failed preflight. assert_equals: expected "timeout" but got "loaded"
+PASS treat-as-public-address to private: failed preflight.
 PASS treat-as-public-address to private: missing CORS headers.
 PASS treat-as-public-address to private: missing PNA header.
 FAIL treat-as-public-address to private: success. assert_equals: expected "loaded" but got "timeout"

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-AppleSilicon-WK2-Tests/268414@main%20(3733)/imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --debug --verbose --clobber-old-results imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html
Comment 1 Radar WebKit Bug Importer 2023-09-25 17:41:31 PDT
<rdar://problem/116025642>
Comment 2 EWS 2023-09-25 17:56:47 PDT
Test gardening commit 268424@main (4b69127af56d): <https://commits.webkit.org/268424@main>

Reviewed commits have been landed. Closing PR #18201 and removing active labels.
Comment 3 Ryosuke Niwa 2023-09-26 10:55:52 PDT
I can't reproduce this failure on macOS Sonoma.
Comment 4 Ben Schwartz 2023-09-26 14:24:30 PDT
Reproduced on macOS Sonoma using the following command:

run-webkit-tests --debug --verbose --clobber-old-results --force --iterations 100 --child-processes 10 -f --exit-after-n-failures 1 imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html
Comment 5 Ryosuke Niwa 2023-09-27 08:43:45 PDT
Pull request: https://github.com/WebKit/WebKit/pull/18284
Comment 6 EWS 2023-09-27 10:36:04 PDT
Committed 268519@main (1cfc40dde59d): <https://commits.webkit.org/268519@main>

Reviewed commits have been landed. Closing PR #18284 and removing active labels.
Comment 7 Ryosuke Niwa 2023-09-28 07:51:30 PDT
Hm... this test is still flaky.
Comment 8 Ryosuke Niwa 2023-09-28 08:39:27 PDT
Pull request: https://github.com/WebKit/WebKit/pull/18357
Comment 9 EWS 2023-09-28 08:43:11 PDT
Test gardening commit 268590@main (1242f2ee324a): <https://commits.webkit.org/268590@main>

Reviewed commits have been landed. Closing PR #18357 and removing active labels.