Bug 259382

Summary:	[ Monterey+ WK2 ] http/wpt/service-workers/cache-mode-hard-reload-serviceworker.html is a flaky TEXT failure
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	Service Workers	Assignee:	youenn fablet <youennf>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Ben Schwartz 2023-07-20 18:02:42 PDT

http/wpt/service-workers/cache-mode-hard-reload-serviceworker.html

This test is a flaky TEXT failure on macOS Monterey and above (WK2).

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=http%2Fwpt%2Fservice-workers%2Fcache-mode-hard-reload-serviceworker.html

TEXT DIFF: 

 PASS : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?first-script-static","cache":"reload"}
 PASS : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?second-script-dynamic","cache":"reload"}
 PASS : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?third-script-async","cache":"reload"}
+FAIL : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?fourth-script-during-onload","cache":"default"}
+FAIL : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?fifth-script-just-after-onload","cache":"default"}
+FAIL : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?sixth-script-async","cache":"default"}

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/266188%40main%20(4102)/http/wpt/service-workers/cache-mode-hard-reload-serviceworker-pretty-diff.html

Comment 1 Radar WebKit Bug Importer 2023-07-20 18:03:11 PDT

<rdar://problem/112630912>

Comment 2 Ben Schwartz 2023-07-20 18:09:19 PDT

This test seems to have been a flaky failure since this commit: https://commits.webkit.org/265309@main. It was introduced in this commit: https://commits.webkit.org/259019@main.

Furthermore, I was able to reproduce this test failure at macOS Ventura Production ToT running the test as follows:

run-webkit-tests http/wpt/service-workers/cache-mode-hard-reload-serviceworker.html --verbose --iterations 10

Comment 3 youenn fablet 2023-07-21 00:01:55 PDT

Pull request: https://github.com/WebKit/WebKit/pull/15973

Comment 4 EWS 2023-07-24 01:17:57 PDT

Committed 266240@main (40825ec29338): <https://commits.webkit.org/266240@main>

Reviewed commits have been landed. Closing PR #15973 and removing active labels.

Comment 5 Ben Schwartz 2023-07-25 16:11:14 PDT

Re-opening, as issue persists after 266240@main on macOS Ventura Release ToT.

TEXT DIFF:

 PASS : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?first-script-static","cache":"reload"}
 PASS : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?second-script-dynamic","cache":"reload"}
 PASS : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?third-script-async","cache":"reload"}
+FAIL : {"url":"http://localhost:8800/WebKit/service-workers/resources/cache-mode-hard-reload-serviceworker.py?sixth-script-async","cache":"reload"}
 
DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/266302@main%20(4160)/http/wpt/service-workers/cache-mode-hard-reload-serviceworker-pretty-diff.html

Comment 6 youenn fablet 2023-10-18 05:24:46 PDT

Pull request: https://github.com/WebKit/WebKit/pull/19223

Comment 7 EWS 2023-10-19 11:46:16 PDT

Committed 269540@main (20a293b6ecc6): <https://commits.webkit.org/269540@main>

Reviewed commits have been landed. Closing PR #19223 and removing active labels.