Bug 254149
| Summary: | [Results Dashboard] List failing results | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Sam Sneddon [:gsnedders] <gsnedders> |
| Component: | Tools / Tests | Assignee: | Nobody <webkit-unassigned> |
| Status: | NEW | ||
| Severity: | Normal | CC: | jbedard, webkit-bug-importer |
| Priority: | P2 | Keywords: | InRadar |
| Version: | WebKit Nightly Build | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
Sam Sneddon [:gsnedders]
It seems like at an API level this was implemented in bug 203905, but we don't have any easy way through the UI to just get a list of failing results for a given test.
This is often useful when investigating flakiness, as it's often most useful to just look at the results when the test does fail. I don't want to have to scroll through all the test results to find failing results—I'd just like a list of most recent failures.
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Radar WebKit Bug Importer
<rdar://problem/106937015>
Jonathan Bedard
I don't think https://bugs.webkit.org/show_bug.cgi?id=203905 is quite the API version of what you're requesting here. It sounds like the request here is basically "give me a list of test runs where a given test has failed", https://bugs.webkit.org/show_bug.cgi?id=203905 is "give me a list of all tests which have failed in a given range".
That being said, I do think the API gives us everything we need to build a UI for "give me a list of test runs where a given test has failed" easily, I'm just not quite sure what the user story to get to such a view would be. I don't think such a UI would make much sense as a timeline (it would involve much scrolling), I'm thinking either a collapsed timeline which eliminates commits that weren't testing (something Zhifei and I have discussed in the past) or something akin to our "investigate" tab which gives you a list of builds.
Sam Sneddon [:gsnedders]
(In reply to Jonathan Bedard from comment #2)
> I don't think https://bugs.webkit.org/show_bug.cgi?id=203905 is quite the
> API version of what you're requesting here. It sounds like the request here
> is basically "give me a list of test runs where a given test has failed",
> https://bugs.webkit.org/show_bug.cgi?id=203905 is "give me a list of all
> tests which have failed in a given range".
Ah, I misunderstood from skimming what that issue was!
> That being said, I do think the API gives us everything we need to build a
> UI for "give me a list of test runs where a given test has failed" easily,
> I'm just not quite sure what the user story to get to such a view would be.
> I don't think such a UI would make much sense as a timeline (it would
> involve much scrolling), I'm thinking either a collapsed timeline which
> eliminates commits that weren't testing (something Zhifei and I have
> discussed in the past) or something akin to our "investigate" tab which
> gives you a list of builds.
Yeah, I'm not sure what the right UI (and path to the UI) is either.