Bug 261958 - NEW TEST (263261@main): [ macOS Release ] inspector/console/timestamp.html is a flaky failure.
Summary: NEW TEST (263261@main): [ macOS Release ] inspector/console/timestamp.html is...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Web Inspector (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-09-22 10:36 PDT by Ben Schwartz
Modified: 2023-09-22 10:49 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-09-22 10:36:47 PDT
inspector/console/timestamp.html

This test is a flaky failure on macOS release builds (nearly completely occurring on wk2, with a single failure at 268297@main on Ventura x86_64 wk1 release).

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=inspector%2Fconsole%2Ftimestamp.html&style=release&platform=mac

TEXT DIFF:

 == Running test suite: ConsoleMessage.Timestamp
 -- Running test case: ConsoleMessage.Timestamp.Basic
 PASS: Should be after pre-captured timestamp.
-PASS: Should be before post-captured timestamp.
+FAIL: Should be before post-captured timestamp.
+    Expected: less than or equal to 1695400386774
+    Actual: 1695400386774.175

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/268315@main%20(5071)/inspector/console/timestamp-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --clobber-old-results --verbose --iterations 10 --exit-after-n-failures 1 inspector/console/timestamp.html

REGRESSION:

This test seems to have been flaky since it was introduced at 263261@main.
Comment 1 Radar WebKit Bug Importer 2023-09-22 10:36:58 PDT
<rdar://problem/115900923>
Comment 2 Ben Schwartz 2023-09-22 10:37:37 PDT
Correction in description: there is the reported single failure on wk1 in recent history; however, it appears the test was previously more flaky on wk1.
Comment 3 EWS 2023-09-22 10:49:00 PDT
Test gardening commit 268321@main (77b9de8d7fda): <https://commits.webkit.org/268321@main>

Reviewed commits have been landed. Closing PR #18089 and removing active labels.