Bug 161742
| Summary: | REGRESSION: [mac-wk2 debug] LayoutTest imported/w3c/web-platform-tests/IndexedDB/keyorder.htm is a flaky failure | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Ryan Haddad <ryanhaddad> |
| Component: | New Bugs | Assignee: | Nobody <webkit-unassigned> |
| Status: | RESOLVED DUPLICATE | ||
| Severity: | Normal | CC: | beidson, sihui_liu |
| Priority: | P2 | ||
| Version: | WebKit Nightly Build | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Bug Depends on: | |||
| Bug Blocks: | 154968 | ||
Ryan Haddad
REGRESSION: LayoutTest imported/w3c/web-platform-tests/IndexedDB/keyorder.htm is a flaky failure
https://build.webkit.org/builders/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/builds/8053
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2FIndexedDB%2Fkeyorder.htm
--- /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/IndexedDB/keyorder-expected.txt
+++ /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/IndexedDB/keyorder-actual.txt
@@ -1,26 +1,26 @@
-PASS Database readback sort - String < Array
+TIMEOUT Database readback sort - String < Array Test timed out
PASS IDBKey.cmp sorted - String < Array
-PASS Database readback sort - float < String
+TIMEOUT Database readback sort - float < String Test timed out
PASS IDBKey.cmp sorted - float < String
-PASS Database readback sort - float < Date
+TIMEOUT Database readback sort - float < Date Test timed out
PASS IDBKey.cmp sorted - float < Date
-PASS Database readback sort - float < Date < String < Array
+TIMEOUT Database readback sort - float < Date < String < Array Test timed out
PASS IDBKey.cmp sorted - float < Date < String < Array
-PASS Database readback sort - Date(1 sec ago) < Date(now) < Date(1 minute in future)
+TIMEOUT Database readback sort - Date(1 sec ago) < Date(now) < Date(1 minute in future) Test timed out
PASS IDBKey.cmp sorted - Date(1 sec ago) < Date(now) < Date(1 minute in future)
-PASS Database readback sort - -1.1 < 1 < 1.01337 < 1.013373 < 2
+TIMEOUT Database readback sort - -1.1 < 1 < 1.01337 < 1.013373 < 2 Test timed out
PASS IDBKey.cmp sorted - -1.1 < 1 < 1.01337 < 1.013373 < 2
-PASS Database readback sort - -Infinity < -0.01 < 0 < Infinity
+TIMEOUT Database readback sort - -Infinity < -0.01 < 0 < Infinity Test timed out
PASS IDBKey.cmp sorted - -Infinity < -0.01 < 0 < Infinity
-PASS Database readback sort - "" < "a" < "ab" < "b" < "ba"
+TIMEOUT Database readback sort - "" < "a" < "ab" < "b" < "ba" Test timed out
PASS IDBKey.cmp sorted - "" < "a" < "ab" < "b" < "ba"
-PASS Database readback sort - Arrays
+TIMEOUT Database readback sort - Arrays Test timed out
PASS IDBKey.cmp sorted - Arrays
-PASS Database readback sort - Array.length: 10,000 < Array.length: 10,001
+TIMEOUT Database readback sort - Array.length: 10,000 < Array.length: 10,001 Test timed out
PASS IDBKey.cmp sorted - Array.length: 10,000 < Array.length: 10,001
-PASS Database readback sort - Infinity inside arrays
+TIMEOUT Database readback sort - Infinity inside arrays Test timed out
PASS IDBKey.cmp sorted - Infinity inside arrays
-PASS Database readback sort - Test different stuff at once
+TIMEOUT Database readback sort - Test different stuff at once Test timed out
PASS IDBKey.cmp sorted - Test different stuff at once
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Ryan Haddad
The first failure according to the dashboard was a test run with https://trac.webkit.org/log/?verbose=on&rev=204839&stop_rev=204832
Since it is a flaky failure, those revisions may not include the actual regression point.
Ryan Haddad
Marked test as flaky in http://trac.webkit.org/projects/webkit/changeset/205748
Brady Eidson
Every remotely recent failure on the flakiness dashboard is due to a much more systemic problem:
Either the w3c platform test server crashing, or due to file handle leaks causing *all* tests to start failing.
I don't think this has legitimately been flaking for some time - Probably since my massive key-serialization performance improvements.
Sihui Liu
Expectations updated at https://bugs.webkit.org/show_bug.cgi?id=228241 as the test is no longer flaky.
*** This bug has been marked as a duplicate of bug 228241 ***