Bug 257239

Summary:	[ iPhone XS + ] TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot is a constant failure
Product:	WebKit	Reporter:	Robert Jenner <jenner>
Component:	WebKit API	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED DUPLICATE
Severity:	Normal	CC:	simon.fraser, thorton, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=172485

Description Robert Jenner 2023-05-23 16:28:07 PDT

TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot

is a constant failure on iOS 16 Debug, when running on an iPhone XS and higher.

HISTORY:
https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot

The history indicates that this is constantly passing, and that's true. However, we are currently set to use an iPhone SE (3rd gen) as the set simulator for API-test. This test passes there, but it fails on iPhone XS and higher. The test will need to be updated so that it doesn't become a constant failure, because we would like to move our simulator to iPhone 12 from iPhone SE. 

STDIO TEXT FAILURE: 
    TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot
        2023-05-23 13:46:32.476 TestWebKitAPI[48887:8262975] Loading file:///Volumes/Data/Builds/iOS/SydneyE/Debug/debugbuild264422@main/TestWebKitAPI.resources/large-red-square-image.html
        No leak checking done: At least one WebView is still open.

        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitLegacy/ios/SnapshotViaRenderInContext.mm:103
        Expected equality of these values:
          255
          value
            Which is: '\xBD' (189)


        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitLegacy/ios/SnapshotViaRenderInContext.mm:104
        Expected equality of these values:
          0
          pixelBuffer[pixelIndex + 1]
            Which is: '\xBD' (189)


        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitLegacy/ios/SnapshotViaRenderInContext.mm:105
        Expected equality of these values:
          0
          pixelBuffer[pixelIndex + 2]
            Which is: '\xC2' (194)

Comment 1 Radar WebKit Bug Importer 2023-05-23 16:28:53 PDT

<rdar://problem/109744653>

Comment 2 Robert Jenner 2023-05-23 16:29:54 PDT

This test is very easily reproducible at iOS 16 Debug ToT running the test as follows:


run-api-tests --iOS-simulator TestWebKitAPI.WebKitLegacy.RenderInContextSnapshot

You will specifically need to boot an iPhone XS or higher simulator to reproduce the failure. After you have chosen your booted simulator it will choose to run on that simulated device, and not the one that we have set for our testing.

Comment 3 Robert Jenner 2023-05-24 17:10:28 PDT


*** This bug has been marked as a duplicate of bug 257235 ***