Bug 261958

Summary: NEW TEST (263261@main): [ macOS Release ] inspector/console/timestamp.html is a flaky failure.
Product: WebKit Reporter: Ben Schwartz <ben_schwartz>
Component: Web InspectorAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: hi, inspector-bugzilla-changes, pangle, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=255033

Description Ben Schwartz 2023-09-22 10:36:47 PDT 
inspector/console/timestamp.html

This test is a flaky failure on macOS release builds (nearly completely occurring on wk2, with a single failure at 268297@main on Ventura x86_64 wk1 release).

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=inspector%2Fconsole%2Ftimestamp.html&style=release&platform=mac

TEXT DIFF:

 == Running test suite: ConsoleMessage.Timestamp
 -- Running test case: ConsoleMessage.Timestamp.Basic
 PASS: Should be after pre-captured timestamp.
-PASS: Should be before post-captured timestamp.
+FAIL: Should be before post-captured timestamp.
+    Expected: less than or equal to 1695400386774
+    Actual: 1695400386774.175

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/268315@main%20(5071)/inspector/console/timestamp-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --clobber-old-results --verbose --iterations 10 --exit-after-n-failures 1 inspector/console/timestamp.html

REGRESSION:

This test seems to have been flaky since it was introduced at 263261@main.
Comment 1 Radar WebKit Bug Importer 2023-09-22 10:36:58 PDT 
<rdar://problem/115900923>
Comment 2 Ben Schwartz 2023-09-22 10:37:37 PDT 
Correction in description: there is the reported single failure on wk1 in recent history; however, it appears the test was previously more flaky on wk1.
Comment 3 EWS 2023-09-22 10:49:00 PDT 
Test gardening commit 268321@main (77b9de8d7fda): <https://commits.webkit.org/268321@main>

Reviewed commits have been landed. Closing PR #18089 and removing active labels.