Bug 265491 - JSON results should contain port name/baseline search path
Summary: JSON results should contain port name/baseline search path
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Sam Sneddon [:gsnedders]
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-11-28 17:26 PST by Sam Sneddon [:gsnedders]
Modified: 2023-12-01 10:49 PST (History)
3 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Sam Sneddon [:gsnedders] 2023-11-28 17:26:59 PST 
If you're looking at a failed test run, e.g., https://ews-build.webkit.org/#/builders/50/builds/2799, currently the only way to determine the test configuration programatically is to parse it from the layout-tests stdio. This is… not ideal. We should put it in the JSON.
Comment 1 Sam Sneddon [:gsnedders] 2023-11-28 17:45:54 PST 
Except, of course, we can run tests for multiple devices (and multiple configurations, multiple baseline search paths, etc.) per test run, none of which the JSON currently gives us any insight into.

This is problematic for update-test-expectations-from-bugzilla.
Comment 2 Radar WebKit Bug Importer 2023-11-28 17:46:02 PST 
<rdar://problem/118907743>
Comment 3 Sam Sneddon [:gsnedders] 2023-11-29 16:33:12 PST 
Pull request: https://github.com/WebKit/WebKit/pull/21082
Comment 4 EWS 2023-12-01 10:49:28 PST 
Committed 271396@main (647c89210b17): <https://commits.webkit.org/271396@main>

Reviewed commits have been landed. Closing PR #21082 and removing active labels.