Bug 260052 - [ macOS iOS ] Multiple tests under http/tests/privateClickMeasurement are flaky TEXT failures
Summary: [ macOS iOS ] Multiple tests under http/tests/privateClickMeasurement are fla...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-08-10 18:45 PDT by Ben Schwartz
Modified: 2023-08-10 19:09 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-08-10 18:45:24 PDT
http/tests/privateClickMeasurement/attribution-conversion-through-fetch-keepalive.html
http/tests/privateClickMeasurement/attribution-conversion-through-image-redirect-ephemeral.html
http/tests/privateClickMeasurement/triggering-event-with-attribution-source-through-fetch-keepalive.html
http/tests/privateClickMeasurement/triggering-event-with-attribution-source-through-fetch-keepalive-ephemeral.html

These tests are flaky text failures on wk2, both macOS and iOS. They are grouped into one bug as they all fail with a similar diff (no stored data).

HISTORY:

https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=http%2Ftests%2FprivateClickMeasurement%2Fattribution-conversion-through-fetch-keepalive.html&test=http%2Ftests%2FprivateClickMeasurement%2Fattribution-conversion-through-image-redirect-ephemeral.html&test=http%2Ftests%2FprivateClickMeasurement%2Ftriggering-event-with-attribution-source-through-fetch-keepalive-ephemeral.html&test=http%2Ftests%2FprivateClickMeasurement%2Ftriggering-event-with-attribution-source-through-fetch-keepalive.html

TEXT DIFF:

 Tests triggering of ephemeral private click measurement attribution with same-site triggering event request.
 
 
-Attributed Private Click Measurements:
-WebCore::PrivateClickMeasurement 1
-Source site: 127.0.0.1
-Attribute on site: localhost
-Source ID: 3
-Attribution trigger data: 12
-Attribution priority: 0
-Attribution earliest time to send: Within 24-48 hours
-Destination token: Not set
-Application bundle identifier: testBundleID
+
+No stored Private Click Measurement data.

DIFF URL:

https://build.webkit.org/results/Apple-Monterey-Release-AppleSilicon-WK2-Tests/266777@main%20(10523)/http/tests/privateClickMeasurement/triggering-event-with-attribution-source-through-fetch-keepalive-ephemeral-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura Release ToT running the test as follows:

run-webkit-tests --clobber-old-results --iterations 100 --child-processes=5 -f --verbose http/test/privateClickMeasurement/clear-through-website-data-removal.html http/tests/privateClickMeasurement/triggering-event-with-attribution-source-through-fetch-keepalive-ephemeral.html

NOTES:

I believe this issue may be related to data being cleared after a previous test run (clear-through-website-data-removal.html), since the issue only reproduced when running that test with the affected tests.
Comment 1 Radar WebKit Bug Importer 2023-08-10 18:45:33 PDT
<rdar://problem/113726036>
Comment 2 Ben Schwartz 2023-08-10 18:51:28 PDT
Specifically not marking this as a duplicate of bug #227555, as this issue persists across multiple tests (not just the test reported in that bug).
Comment 3 EWS 2023-08-10 19:09:25 PDT
Test gardening commit 266804@main (defd70129091): <https://commits.webkit.org/266804@main>

Reviewed commits have been landed. Closing PR #16589 and removing active labels.