Bug 257228

Summary: [ iPhone XS+ ] 3X TestWebKitAPI.AnimatedResize (API-Tests) are constant failures
Product: WebKit Reporter: Robert Jenner <jenner>
Component: WebKit Misc.Assignee: Nobody <webkit-unassigned>
Status: RESOLVED DUPLICATE    
Severity: Normal CC: ap, thorton, webkit-bot-watchers-bugzilla, webkit-bug-importer, wenson_hsieh
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=242233

Description Robert Jenner 2023-05-23 14:51:04 PDT 
TestWebKitAPI.AnimatedResize.ChangeFrameAndMinimumEffectiveDeviceWidthDuringAnimatedResize
TestWebKitAPI.AnimatedResize.ResizeWithContentHiddenCompletes
TestWebKitAPI.AnimatedResize.ResizeWithContentHiddenWithSubsequentNoOpResizeCompletes


Are constant failures on iOS when run in an iPhone XS simulator and higher. They pass in an iPhone SE (3rd gen) simulator.

HISTORY:
https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.AnimatedResize.ChangeFrameAndMinimumEffectiveDeviceWidthDuringAnimatedResize&test=TestWebKitAPI.AnimatedResize.ResizeWithContentHiddenCompletes&test=TestWebKitAPI.AnimatedResize.ResizeWithContentHiddenWhileScrolling&test=TestWebKitAPI.AnimatedResize.ResizeWithContentHiddenWithSubsequentNoOpResizeCompletes

As you can see, they currently all pass. That is because our simualtor being used to run testing for API-tests on iOS is an iPhone SE (3rd Gen). We want to move to an iPhone 12 to match the testing model for layout-tests.


STDIO for Failures on iPhone XS+:
    TestWebKitAPI.AnimatedResize.ChangeFrameAndMinimumEffectiveDeviceWidthDuringAnimatedResize
        LEAK: 1 WebProcessPool

        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/AnimatedResize.mm:330
        Expected equality of these values:
          innerHeight
            Which is: 656
          750


    TestWebKitAPI.AnimatedResize.ResizeWithContentHiddenCompletes
        LEAK: 1 WebProcessPool

        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/AnimatedResize.mm:381
        Expected equality of these values:
          innerHeight
            Which is: 153
          200

    TestWebKitAPI.AnimatedResize.ResizeWithContentHiddenWithSubsequentNoOpResizeCompletes
        LEAK: 1 WebProcessPool

        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/AnimatedResize.mm:428
        Expected equality of these values:
          innerHeight
            Which is: 153
          200
Comment 1 Radar WebKit Bug Importer 2023-05-23 14:55:45 PDT 
<rdar://problem/109740305>
Comment 2 Robert Jenner 2023-05-23 14:56:27 PDT 
It is very easy to reproduce these failures at iOS 16 Debug ToT by running the test as follows:

run-api-tests --iOS-simulator <test_goes_here>

You will specifically need to boot an iPhone XS or higher simulator to get the failure. After you have chosen your booted simulator it will choose to run on that simulated device, and not the one that we have set for our testing.
Comment 3 Robert Jenner 2023-05-23 15:49:02 PDT 
*** Bug 257231 has been marked as a duplicate of this bug. ***
Comment 4 Robert Jenner 2023-05-24 17:10:03 PDT 

*** This bug has been marked as a duplicate of bug 257235 ***