Bug 257239 - [ iPhone XS + ] TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot is a constant failure
Summary: [ iPhone XS + ] TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot is a const...
Status: RESOLVED DUPLICATE of bug 257235
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebKit API (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-05-23 16:28 PDT by Robert Jenner
Modified: 2023-05-24 17:10 PDT (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2023-05-23 16:28:07 PDT 
TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot

is a constant failure on iOS 16 Debug, when running on an iPhone XS and higher.

HISTORY:
https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot

The history indicates that this is constantly passing, and that's true. However, we are currently set to use an iPhone SE (3rd gen) as the set simulator for API-test. This test passes there, but it fails on iPhone XS and higher. The test will need to be updated so that it doesn't become a constant failure, because we would like to move our simulator to iPhone 12 from iPhone SE. 

STDIO TEXT FAILURE: 
    TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot
        2023-05-23 13:46:32.476 TestWebKitAPI[48887:8262975] Loading file:///Volumes/Data/Builds/iOS/SydneyE/Debug/debugbuild264422@main/TestWebKitAPI.resources/large-red-square-image.html
        No leak checking done: At least one WebView is still open.

        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitLegacy/ios/SnapshotViaRenderInContext.mm:103
        Expected equality of these values:
          255
          value
            Which is: '\xBD' (189)


        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitLegacy/ios/SnapshotViaRenderInContext.mm:104
        Expected equality of these values:
          0
          pixelBuffer[pixelIndex + 1]
            Which is: '\xBD' (189)


        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitLegacy/ios/SnapshotViaRenderInContext.mm:105
        Expected equality of these values:
          0
          pixelBuffer[pixelIndex + 2]
            Which is: '\xC2' (194)
Comment 1 Radar WebKit Bug Importer 2023-05-23 16:28:53 PDT 
<rdar://problem/109744653>
Comment 2 Robert Jenner 2023-05-23 16:29:54 PDT 
This test is very easily reproducible at iOS 16 Debug ToT running the test as follows:


run-api-tests --iOS-simulator TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot

You will specifically need to boot an iPhone XS or higher simulator to reproduce the failure. After you have chosen your booted simulator it will choose to run on that simulated device, and not the one that we have set for our testing.
Comment 3 Robert Jenner 2023-05-24 17:10:28 PDT 

*** This bug has been marked as a duplicate of bug 257235 ***