Bug 260052

Summary: [ macOS iOS ] Multiple tests under http/tests/privateClickMeasurement are flaky TEXT failures
Product: WebKit Reporter: Ben Schwartz <ben_schwartz>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ehutchison, webkit-bot-watchers-bugzilla, webkit-bug-importer, wilander
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=242228
https://bugs.webkit.org/show_bug.cgi?id=227555

Description Ben Schwartz 2023-08-10 18:45:24 PDT
http/tests/privateClickMeasurement/attribution-conversion-through-fetch-keepalive.html
http/tests/privateClickMeasurement/attribution-conversion-through-image-redirect-ephemeral.html
http/tests/privateClickMeasurement/triggering-event-with-attribution-source-through-fetch-keepalive.html
http/tests/privateClickMeasurement/triggering-event-with-attribution-source-through-fetch-keepalive-ephemeral.html

These tests are flaky text failures on wk2, both macOS and iOS. They are grouped into one bug as they all fail with a similar diff (no stored data).

HISTORY:

https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=http%2Ftests%2FprivateClickMeasurement%2Fattribution-conversion-through-fetch-keepalive.html&test=http%2Ftests%2FprivateClickMeasurement%2Fattribution-conversion-through-image-redirect-ephemeral.html&test=http%2Ftests%2FprivateClickMeasurement%2Ftriggering-event-with-attribution-source-through-fetch-keepalive-ephemeral.html&test=http%2Ftests%2FprivateClickMeasurement%2Ftriggering-event-with-attribution-source-through-fetch-keepalive.html

TEXT DIFF:

 Tests triggering of ephemeral private click measurement attribution with same-site triggering event request.
 
 
-Attributed Private Click Measurements:
-WebCore::PrivateClickMeasurement 1
-Source site: 127.0.0.1
-Attribute on site: localhost
-Source ID: 3
-Attribution trigger data: 12
-Attribution priority: 0
-Attribution earliest time to send: Within 24-48 hours
-Destination token: Not set
-Application bundle identifier: testBundleID
+
+No stored Private Click Measurement data.

DIFF URL:

https://build.webkit.org/results/Apple-Monterey-Release-AppleSilicon-WK2-Tests/266777@main%20(10523)/http/tests/privateClickMeasurement/triggering-event-with-attribution-source-through-fetch-keepalive-ephemeral-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura Release ToT running the test as follows:

run-webkit-tests --clobber-old-results --iterations 100 --child-processes=5 -f --verbose http/test/privateClickMeasurement/clear-through-website-data-removal.html http/tests/privateClickMeasurement/triggering-event-with-attribution-source-through-fetch-keepalive-ephemeral.html

NOTES:

I believe this issue may be related to data being cleared after a previous test run (clear-through-website-data-removal.html), since the issue only reproduced when running that test with the affected tests.
Comment 1 Radar WebKit Bug Importer 2023-08-10 18:45:33 PDT
<rdar://problem/113726036>
Comment 2 Ben Schwartz 2023-08-10 18:51:28 PDT
Specifically not marking this as a duplicate of bug #227555, as this issue persists across multiple tests (not just the test reported in that bug).
Comment 3 EWS 2023-08-10 19:09:25 PDT
Test gardening commit 266804@main (defd70129091): <https://commits.webkit.org/266804@main>

Reviewed commits have been landed. Closing PR #16589 and removing active labels.