Bug 255035

Summary: [ews] A PR that failed to fix a pre-existing test failure was marked as green even though the test was still failing
Product: WebKit Reporter: Ryan Haddad <ryanhaddad>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: aakash_jain, ap, jbedard, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   

Description Ryan Haddad 2023-04-05 09:20:43 PDT
Here is an interesting case with our EWS + results DB integration, but I’m not sure how we’d mitigate it: 
https://github.com/WebKit/WebKit/pull/11769 was supposed to fix TestWebKitAPI.WebKit.MediaBufferingPolicy, and since EWS was ignoring the failure based on post-commit results, it ignored the fact that the test continued to fail with the PR and marked the run as ✅ https://ews-build.webkit.org/#/builders/18/builds/1253
Comment 1 Radar WebKit Bug Importer 2023-04-05 09:20:54 PDT
<rdar://problem/107662421>
Comment 2 Ryan Haddad 2023-06-13 06:43:07 PDT
*** Bug 258005 has been marked as a duplicate of this bug. ***