Bug 262088

Summary:	REGRESSION(266896@main): [ wk2 debug ] imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html is flaky failure
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	DOM	Assignee:	Ryosuke Niwa <rniwa>
Status:	REOPENED ---
Severity:	Normal	CC:	m_finkel, rniwa, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=260112

Description Ben Schwartz 2023-09-25 17:41:20 PDT

imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html

This test is a near-constant/consistent failure on all platforms, wk2 debug builds.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Ffetch%2Fprivate-network-access%2Fiframe.tentative.https.window.html&style=debug

TEXT DIFF:

 
-PASS local to local: no preflight required.
-PASS local to private: no preflight required.
-PASS local to public: no preflight required.
-FAIL private to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL local to local: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL local to private: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL local to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS private to local: failed preflight.
 PASS private to local: missing CORS headers.
 PASS private to local: missing PNA header.
 FAIL private to local: success. assert_equals: expected "loaded" but got "timeout"
-PASS private to private: no preflight required.
-PASS private to public: no preflight required.
-FAIL public to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL private to private: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL private to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS public to local: failed preflight.
 PASS public to local: missing CORS headers.
 PASS public to local: missing PNA header.
 FAIL public to local: success. assert_equals: expected "loaded" but got "timeout"
-FAIL public to private: failed preflight. assert_equals: expected "timeout" but got "loaded"
+PASS public to private: failed preflight.
 PASS public to private: missing CORS headers.
 PASS public to private: missing PNA header.
 FAIL public to private: success. assert_equals: expected "loaded" but got "timeout"
-PASS public to public: no preflight required.
-FAIL treat-as-public-address to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL public to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS treat-as-public-address to local: failed preflight.
 PASS treat-as-public-address to local: missing CORS headers.
 PASS treat-as-public-address to local: missing PNA header.
 FAIL treat-as-public-address to local: success. assert_equals: expected "loaded" but got "timeout"
-FAIL treat-as-public-address to private: failed preflight. assert_equals: expected "timeout" but got "loaded"
+PASS treat-as-public-address to private: failed preflight.
 PASS treat-as-public-address to private: missing CORS headers.
 PASS treat-as-public-address to private: missing PNA header.
 FAIL treat-as-public-address to private: success. assert_equals: expected "loaded" but got "timeout"

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-AppleSilicon-WK2-Tests/268414@main%20(3733)/imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --debug --verbose --clobber-old-results imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html

Comment 1 Radar WebKit Bug Importer 2023-09-25 17:41:31 PDT

<rdar://problem/116025642>

Comment 2 EWS 2023-09-25 17:56:47 PDT

Test gardening commit 268424@main (4b69127af56d): <https://commits.webkit.org/268424@main>

Reviewed commits have been landed. Closing PR #18201 and removing active labels.

Comment 3 Ryosuke Niwa 2023-09-26 10:55:52 PDT

I can't reproduce this failure on macOS Sonoma.

Comment 4 Ben Schwartz 2023-09-26 14:24:30 PDT

Reproduced on macOS Sonoma using the following command:

run-webkit-tests --debug --verbose --clobber-old-results --force --iterations 100 --child-processes 10 -f --exit-after-n-failures 1 imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html

Comment 5 Ryosuke Niwa 2023-09-27 08:43:45 PDT

Pull request: https://github.com/WebKit/WebKit/pull/18284

Comment 6 EWS 2023-09-27 10:36:04 PDT

Committed 268519@main (1cfc40dde59d): <https://commits.webkit.org/268519@main>

Reviewed commits have been landed. Closing PR #18284 and removing active labels.

Comment 7 Ryosuke Niwa 2023-09-28 07:51:30 PDT

Hm... this test is still flaky.

Comment 8 Ryosuke Niwa 2023-09-28 08:39:27 PDT

Pull request: https://github.com/WebKit/WebKit/pull/18357

Comment 9 EWS 2023-09-28 08:43:11 PDT

Test gardening commit 268590@main (1242f2ee324a): <https://commits.webkit.org/268590@main>

Reviewed commits have been landed. Closing PR #18357 and removing active labels.