Bug 257876

Summary: [ REBASELINE ] REGRESSION(264802@main): 4X TestWebKitAPI.DragAndDropTests (API-tests) are constant failures
Product: WebKit Reporter: Robert Jenner <jenner>
Component: New BugsAssignee: Robert Jenner <jenner>
Status: RESOLVED FIXED    
Severity: Normal CC: webkit-bot-watchers-bugzilla, webkit-bug-importer, wenson_hsieh, zalan
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Robert Jenner 2023-06-08 16:48:35 PDT
TestWebKitAPI.DragAndDropTests.BackgroundImageLinkToInput
TestWebKitAPI.DragAndDropTests.ImageInLinkToInput
TestWebKitAPI.DragAndDropTests.LinkToInput
TestWebKitAPI.DragAndDropTests.TextAreaToInput

are constant failing API tests. They only appear to run on iOS, and they are constant failures on iOS. 

HISTORY:
https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.DragAndDropTests.BackgroundImageLinkToInput&test=TestWebKitAPI.DragAndDropTests.ImageInLinkToInput&test=TestWebKitAPI.DragAndDropTests.LinkToInput&test=TestWebKitAPI.DragAndDropTests.TextAreaToInput

    TestWebKitAPI.DragAndDropTests.BackgroundImageLinkToInput
        2023-06-01 15:25:38.419 com.apple.WebKit.WebContent.Development[76482:9965490] CoreText note: Client requested name ".SFUI-Regular", it will get TimesNewRomanPSMT rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[UIFont systemFontOfSize:].
        2023-06-01 15:25:38.419 com.apple.WebKit.WebContent.Development[76482:9965490] CoreText note: Set a breakpoint on CTFontLogSystemFontNameRequest to debug.
        2023-06-01 15:25:38.419 com.apple.WebKit.WebContent.Development[76482:9965490] CoreText note: Client requested name ".SFUI-Regular", it will get TimesNewRomanPSMT rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[UIFont systemFontOfSize:].
        2023-06-01 15:25:39.188 TestWebKitAPI[76481:9965479] Expected: {{2069, 241}, {2, 240}} but observed: {{2069, 170}, {2, 240}}
        
        /Volumes/Data/worker/Apple-iOS-16-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/ios/DragAndDropTestsIOS.mm:124
        Value of: isEqual
          Actual: false
        Expected: true
        
    TestWebKitAPI.DragAndDropTests.ImageInLinkToInput
        2023-06-01 15:28:42.332 TestWebKitAPI[77064:9969875] Expected: {{2069, 241}, {2, 240}} but observed: {{2069, 170}, {2, 240}}
        
        /Volumes/Data/worker/Apple-iOS-16-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/ios/DragAndDropTestsIOS.mm:124
        Value of: isEqual
          Actual: false
        Expected: true
        
    TestWebKitAPI.DragAndDropTests.LinkToInput
        2023-06-01 15:29:02.097 com.apple.WebKit.WebContent.Development[77130:9970389] CoreText note: Client requested name ".SFUI-Regular", it will get TimesNewRomanPSMT rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[UIFont systemFontOfSize:].
        2023-06-01 15:29:02.097 com.apple.WebKit.WebContent.Development[77130:9970389] CoreText note: Set a breakpoint on CTFontLogSystemFontNameRequest to debug.
        2023-06-01 15:29:02.097 com.apple.WebKit.WebContent.Development[77130:9970389] CoreText note: Client requested name ".SFUI-Regular", it will get TimesNewRomanPSMT rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[UIFont systemFontOfSize:].
        2023-06-01 15:29:02.898 TestWebKitAPI[77129:9970379] Expected: {{2069, 273}, {2, 240}} but observed: {{2069, 202}, {2.0520000457763672, 240}}
        
        /Volumes/Data/worker/Apple-iOS-16-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/ios/DragAndDropTestsIOS.mm:124
        Value of: isEqual
          Actual: false
        Expected: true
        
    TestWebKitAPI.DragAndDropTests.TextAreaToInput
        2023-06-01 15:29:30.037 TestWebKitAPI[77210:9971025] Expected: {{1033, 241}, {2, 240}} but observed: {{1033, 170}, {2, 240}}
        
        /Volumes/Data/worker/Apple-iOS-16-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/ios/DragAndDropTestsIOS.mm:124
        Value of: isEqual
          Actual: false
        Expected: true
Comment 1 Robert Jenner 2023-06-08 16:49:12 PDT
These all have been reproduced by running the test
Comment 2 Radar WebKit Bug Importer 2023-06-08 16:49:22 PDT
<rdar://problem/110495316>
Comment 3 Robert Jenner 2023-06-08 16:52:35 PDT
(In reply to Robert Jenner from comment #1)
> These all have been reproduced by running the test

Forgot to finish my thought before hitting submit.. Oops..

These all have been reproduced at iOS 16 Debug ToT by running the tests as follows:

run-api-tests --iOS-simulator <test_name_goes_here>

I was able able to bisect to a regression point. These reproduce at 264802@main, but not at 264801@main. 

In speaking to Wenson about this, it was indicated that these just need rebaselines. So I am going to attempt that.
Comment 4 Robert Jenner 2023-06-08 17:07:24 PDT
Pull request: https://github.com/WebKit/WebKit/pull/14798
Comment 5 EWS 2023-06-08 23:02:08 PDT
Committed 265012@main (dba2d1deff1f): <https://commits.webkit.org/265012@main>

Reviewed commits have been landed. Closing PR #14798 and removing active labels.