Skip to content

tests: Import actionscript.all tests from gnash #22050

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Oct 28, 2025
Merged

tests: Import actionscript.all tests from gnash #22050

merged 1 commit into from
Oct 28, 2025

Conversation

@Dinnerbone
Copy link
Contributor

@Dinnerbone Dinnerbone commented Oct 26, 2025 •
edited
Loading

Once again, way too many tests to detail - sadly.

All these tests surround a specific AS2 class, and the behaviour often changes per FP version - in these cases the output is in e.g. fp10 subfolder.

All tests are ran on Windows using FP 9 -> 32. A SharedObject test was skipped as we don't have support for this in out test framework yet.

Summary is:

     Summary [  18.666s] 378 tests run: 50 passed, 328 failed
        FAIL [   0.112s] tests::tests from_gnash/actionscript.all/ASnative-v5
        FAIL [   0.134s] tests::tests from_gnash/actionscript.all/ASnative-v6
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/ASnative-v7
        FAIL [   0.144s] tests::tests from_gnash/actionscript.all/ASnative-v8
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Accessibility-v5
        FAIL [   0.122s] tests::tests from_gnash/actionscript.all/AsBroadcaster-v5
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/AsBroadcaster-v6
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/AsBroadcaster-v7
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/AsBroadcaster-v8
        FAIL [   0.134s] tests::tests from_gnash/actionscript.all/BitmapData-v5
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/BitmapData-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/BitmapData-v7
        FAIL [   0.346s] tests::tests from_gnash/actionscript.all/BitmapData-v8
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/Boolean-v5
        FAIL [   0.062s] tests::tests from_gnash/actionscript.all/Camera-v5
        FAIL [   0.108s] tests::tests from_gnash/actionscript.all/Camera-v6
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Camera-v7
        FAIL [   0.098s] tests::tests from_gnash/actionscript.all/Camera-v8
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/Color-v5
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/ColorTransform-v5
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/ColorTransform-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/ColorTransform-v7
        FAIL [   0.107s] tests::tests from_gnash/actionscript.all/ColorTransform-v8
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/ContextMenu-v7
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/ContextMenu-v8
        FAIL [   0.102s] tests::tests from_gnash/actionscript.all/Date-v5/fp10
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/Date-v5/fp9
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/Date-v6/fp10
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Date-v6/fp9
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Date-v7/fp10
        FAIL [   0.093s] tests::tests from_gnash/actionscript.all/Date-v7/fp9
        FAIL [   0.087s] tests::tests from_gnash/actionscript.all/Date-v8/fp10
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Date-v8/fp9
        FAIL [   0.098s] tests::tests from_gnash/actionscript.all/Error-v5
        FAIL [   0.096s] tests::tests from_gnash/actionscript.all/Error-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Error-v7
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/Error-v8
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/ExternalInterface-v5
        FAIL [   0.072s] tests::tests from_gnash/actionscript.all/ExternalInterface-v6
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/ExternalInterface-v7
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/ExternalInterface-v8
        FAIL [   0.091s] tests::tests from_gnash/actionscript.all/Function-v5/fp13
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/Function-v5/fp14
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/Function-v5/fp18
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/Function-v5/fp9
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/Function-v6/fp13
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/Function-v6/fp14
        FAIL [   0.138s] tests::tests from_gnash/actionscript.all/Function-v6/fp18
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/Function-v6/fp24
        FAIL [   0.122s] tests::tests from_gnash/actionscript.all/Function-v6/fp9
        FAIL [   0.098s] tests::tests from_gnash/actionscript.all/Function-v7/fp13
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/Function-v7/fp14
        FAIL [   0.134s] tests::tests from_gnash/actionscript.all/Function-v7/fp18
        FAIL [   0.116s] tests::tests from_gnash/actionscript.all/Function-v7/fp24
        FAIL [   0.102s] tests::tests from_gnash/actionscript.all/Function-v7/fp9
        FAIL [   0.092s] tests::tests from_gnash/actionscript.all/Function-v8/fp13
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/Function-v8/fp14
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/Function-v8/fp18
        FAIL [   0.082s] tests::tests from_gnash/actionscript.all/Function-v8/fp24
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Function-v8/fp9
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/Global-v5/fp10
        FAIL [   0.087s] tests::tests from_gnash/actionscript.all/Global-v5/fp11
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/Global-v5/fp9
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/Global-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Global-v7
        FAIL [   0.082s] tests::tests from_gnash/actionscript.all/Global-v8
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/HitTest-v6
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/HitTest-v7
        FAIL [   0.064s] tests::tests from_gnash/actionscript.all/HitTest-v8
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Inheritance-v5
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/Inheritance-v6
        FAIL [   0.078s] tests::tests from_gnash/actionscript.all/Inheritance-v7
        FAIL [   0.095s] tests::tests from_gnash/actionscript.all/Inheritance-v8
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/Instance-v5
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/Instance-v6
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Instance-v7
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/Instance-v8
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/Key-v5
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/LoadVars-v6
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/LoadVars-v7
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/LoadVars-v8
        FAIL [   0.072s] tests::tests from_gnash/actionscript.all/LocalConnection-v5
        FAIL [   0.068s] tests::tests from_gnash/actionscript.all/LocalConnection-v6
        FAIL [   0.080s] tests::tests from_gnash/actionscript.all/LocalConnection-v7
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/LocalConnection-v8
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Math-v5
        FAIL [   0.102s] tests::tests from_gnash/actionscript.all/Math-v6
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/Math-v7
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Math-v8
        FAIL [   0.066s] tests::tests from_gnash/actionscript.all/Matrix-v5
        FAIL [   0.147s] tests::tests from_gnash/actionscript.all/Matrix-v6
        FAIL [   0.112s] tests::tests from_gnash/actionscript.all/Matrix-v7
        FAIL [   0.123s] tests::tests from_gnash/actionscript.all/Matrix-v8
        FAIL [   0.106s] tests::tests from_gnash/actionscript.all/Microphone-v6
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/Microphone-v7
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/Microphone-v8
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/MovieClip-v5
        FAIL [   0.150s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp10
        FAIL [   0.143s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp13
        FAIL [   0.144s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp14
        FAIL [   0.138s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp16
        FAIL [   0.203s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp19
        FAIL [   0.149s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp21
        FAIL [   0.186s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp23
        FAIL [   0.137s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp9
        FAIL [   0.131s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp10
        FAIL [   0.120s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp13
        FAIL [   0.142s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp14
        FAIL [   0.148s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp16
        FAIL [   0.152s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp19
        FAIL [   0.149s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp21
        FAIL [   0.161s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp23
        FAIL [   0.193s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp9
        FAIL [   0.179s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp10
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp13
        FAIL [   0.181s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp14
        FAIL [   0.157s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp16
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp19
        FAIL [   0.177s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp21
        FAIL [   0.185s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp23
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp9
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/MovieClipLoader-v7
        FAIL [   0.078s] tests::tests from_gnash/actionscript.all/MovieClipLoader-v8
        FAIL [   0.068s] tests::tests from_gnash/actionscript.all/NetConnection-v5
        FAIL [   0.124s] tests::tests from_gnash/actionscript.all/NetConnection-v6/fp30
        FAIL [   0.083s] tests::tests from_gnash/actionscript.all/NetConnection-v6/fp9
        FAIL [   0.079s] tests::tests from_gnash/actionscript.all/NetConnection-v7/fp30
        FAIL [   0.074s] tests::tests from_gnash/actionscript.all/NetConnection-v7/fp9
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/NetConnection-v8/fp30
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/NetConnection-v8/fp9
        FAIL [   0.082s] tests::tests from_gnash/actionscript.all/NetStream-v6
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/NetStream-v7
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/NetStream-v8
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/Number-v5
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/Number-v6
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Number-v7
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Number-v8
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/Object-v5/fp18
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/Object-v5/fp19
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Object-v5/fp20
        FAIL [   0.062s] tests::tests from_gnash/actionscript.all/Object-v5/fp9
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/Object-v6/fp18
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/Object-v6/fp19
        FAIL [   0.126s] tests::tests from_gnash/actionscript.all/Object-v6/fp20
        FAIL [   0.126s] tests::tests from_gnash/actionscript.all/Object-v6/fp9
        FAIL [   0.147s] tests::tests from_gnash/actionscript.all/Object-v7/fp18
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/Object-v7/fp19
        FAIL [   0.141s] tests::tests from_gnash/actionscript.all/Object-v7/fp20
        FAIL [   0.170s] tests::tests from_gnash/actionscript.all/Object-v7/fp9
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/Object-v8/fp18
        FAIL [   0.142s] tests::tests from_gnash/actionscript.all/Object-v8/fp19
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/Object-v8/fp20
        FAIL [   0.152s] tests::tests from_gnash/actionscript.all/Object-v8/fp9
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/Point-v5
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/Point-v6
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/Point-v7
        FAIL [   0.095s] tests::tests from_gnash/actionscript.all/Point-v8
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Rectangle-v5
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/Rectangle-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Rectangle-v7
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/Rectangle-v8
        FAIL [   0.127s] tests::tests from_gnash/actionscript.all/Selection-v6
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/Selection-v7
        FAIL [   0.080s] tests::tests from_gnash/actionscript.all/Selection-v8
        FAIL [   0.080s] tests::tests from_gnash/actionscript.all/Sound-v5
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Sound-v6
        FAIL [   0.080s] tests::tests from_gnash/actionscript.all/Sound-v7
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/Sound-v8
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Stage-v5
        FAIL [   0.095s] tests::tests from_gnash/actionscript.all/Stage-v6/fp10
        FAIL [   0.110s] tests::tests from_gnash/actionscript.all/Stage-v6/fp32
        FAIL [   0.092s] tests::tests from_gnash/actionscript.all/Stage-v6/fp9
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/Stage-v7/fp10
        FAIL [   0.079s] tests::tests from_gnash/actionscript.all/Stage-v7/fp32
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Stage-v7/fp9
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/Stage-v8/fp10
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/Stage-v8/fp32
        FAIL [   0.074s] tests::tests from_gnash/actionscript.all/Stage-v8/fp9
        FAIL [   0.107s] tests::tests from_gnash/actionscript.all/String-v5
        FAIL [   0.128s] tests::tests from_gnash/actionscript.all/String-v6
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/String-v7
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/String-v8
        FAIL [   0.102s] tests::tests from_gnash/actionscript.all/System-v5
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/System-v6
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/System-v7
        FAIL [   0.107s] tests::tests from_gnash/actionscript.all/System-v8
        FAIL [   0.092s] tests::tests from_gnash/actionscript.all/TextField-v5
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/TextField-v6/fp13
        FAIL [   0.116s] tests::tests from_gnash/actionscript.all/TextField-v6/fp14
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/TextField-v6/fp16
        FAIL [   0.128s] tests::tests from_gnash/actionscript.all/TextField-v6/fp17
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/TextField-v6/fp9
        FAIL [   0.209s] tests::tests from_gnash/actionscript.all/TextField-v7/fp13
        FAIL [   0.122s] tests::tests from_gnash/actionscript.all/TextField-v7/fp14
        FAIL [   0.173s] tests::tests from_gnash/actionscript.all/TextField-v7/fp16
        FAIL [   0.141s] tests::tests from_gnash/actionscript.all/TextField-v7/fp17
        FAIL [   0.145s] tests::tests from_gnash/actionscript.all/TextField-v7/fp9
        FAIL [   0.142s] tests::tests from_gnash/actionscript.all/TextField-v8/fp13
        FAIL [   0.167s] tests::tests from_gnash/actionscript.all/TextField-v8/fp14
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/TextField-v8/fp16
        FAIL [   0.138s] tests::tests from_gnash/actionscript.all/TextField-v8/fp17
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/TextField-v8/fp9
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/TextFieldHTML-v6
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/TextFieldHTML-v7
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/TextFieldHTML-v8
        FAIL [   0.108s] tests::tests from_gnash/actionscript.all/TextFormat-v5
        FAIL [   0.068s] tests::tests from_gnash/actionscript.all/TextFormat-v6
        FAIL [   0.118s] tests::tests from_gnash/actionscript.all/TextFormat-v7
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/TextFormat-v8/fp10
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/TextFormat-v8/fp9
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/TextSnapshot-v5
        FAIL [   0.155s] tests::tests from_gnash/actionscript.all/TextSnapshot-v6
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/TextSnapshot-v7
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/TextSnapshot-v8
        FAIL [   0.065s] tests::tests from_gnash/actionscript.all/Transform-v5
        FAIL [   0.091s] tests::tests from_gnash/actionscript.all/Transform-v8/fp10
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/Transform-v8/fp9
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/Video-v6
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Video-v7
        FAIL [   0.114s] tests::tests from_gnash/actionscript.all/Video-v8
        FAIL [   0.152s] tests::tests from_gnash/actionscript.all/XML-v5/fp10
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/XML-v5/fp9
        FAIL [   0.127s] tests::tests from_gnash/actionscript.all/XML-v6/fp10
        FAIL [   0.119s] tests::tests from_gnash/actionscript.all/XML-v6/fp9
        FAIL [   0.112s] tests::tests from_gnash/actionscript.all/XML-v7/fp10
        FAIL [   0.126s] tests::tests from_gnash/actionscript.all/XML-v7/fp9
        FAIL [   0.108s] tests::tests from_gnash/actionscript.all/XML-v8/fp10
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/XML-v8/fp9
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/XMLNode-v5/fp10
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/XMLNode-v5/fp11
        FAIL [   0.093s] tests::tests from_gnash/actionscript.all/XMLNode-v5/fp9
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/XMLNode-v6/fp10
        FAIL [   0.120s] tests::tests from_gnash/actionscript.all/XMLNode-v6/fp11
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/XMLNode-v6/fp9
        FAIL [   0.079s] tests::tests from_gnash/actionscript.all/XMLNode-v7/fp10
        FAIL [   0.097s] tests::tests from_gnash/actionscript.all/XMLNode-v7/fp11
        FAIL [   0.083s] tests::tests from_gnash/actionscript.all/XMLNode-v7/fp9
        FAIL [   0.106s] tests::tests from_gnash/actionscript.all/XMLNode-v8/fp10
        FAIL [   0.123s] tests::tests from_gnash/actionscript.all/XMLNode-v8/fp9
        FAIL [   0.063s] tests::tests from_gnash/actionscript.all/XMLSocket-v5
        FAIL [   0.060s] tests::tests from_gnash/actionscript.all/XMLSocket-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/XMLSocket-v7
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/XMLSocket-v8
        FAIL [   0.203s] tests::tests from_gnash/actionscript.all/argstest-v5
        FAIL [   0.228s] tests::tests from_gnash/actionscript.all/argstest-v6/fp10
        FAIL [   0.179s] tests::tests from_gnash/actionscript.all/argstest-v6/fp11
        FAIL [   0.197s] tests::tests from_gnash/actionscript.all/argstest-v6/fp13
        FAIL [   0.185s] tests::tests from_gnash/actionscript.all/argstest-v6/fp14
        FAIL [   0.204s] tests::tests from_gnash/actionscript.all/argstest-v6/fp18
        FAIL [   0.198s] tests::tests from_gnash/actionscript.all/argstest-v6/fp32
        FAIL [   0.190s] tests::tests from_gnash/actionscript.all/argstest-v6/fp9
        FAIL [   0.185s] tests::tests from_gnash/actionscript.all/argstest-v7/fp10
        FAIL [   0.309s] tests::tests from_gnash/actionscript.all/argstest-v7/fp11
        FAIL [   0.182s] tests::tests from_gnash/actionscript.all/argstest-v7/fp13
        FAIL [   0.201s] tests::tests from_gnash/actionscript.all/argstest-v7/fp14
        FAIL [   0.272s] tests::tests from_gnash/actionscript.all/argstest-v7/fp18
        FAIL [   0.177s] tests::tests from_gnash/actionscript.all/argstest-v7/fp32
        FAIL [   0.154s] tests::tests from_gnash/actionscript.all/argstest-v7/fp9
        FAIL [   0.188s] tests::tests from_gnash/actionscript.all/argstest-v8/fp11
        FAIL [   0.201s] tests::tests from_gnash/actionscript.all/argstest-v8/fp13
        FAIL [   0.201s] tests::tests from_gnash/actionscript.all/argstest-v8/fp14
        FAIL [   0.192s] tests::tests from_gnash/actionscript.all/argstest-v8/fp18
        FAIL [   0.180s] tests::tests from_gnash/actionscript.all/argstest-v8/fp32
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/array-v5
        FAIL [   0.107s] tests::tests from_gnash/actionscript.all/array-v6/fp13
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/array-v6/fp14
        FAIL [   0.151s] tests::tests from_gnash/actionscript.all/array-v6/fp17
        FAIL [   0.220s] tests::tests from_gnash/actionscript.all/array-v6/fp24
        FAIL [   0.135s] tests::tests from_gnash/actionscript.all/array-v6/fp9
        FAIL [   0.124s] tests::tests from_gnash/actionscript.all/array-v7/fp13
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/array-v7/fp14
        FAIL [   0.115s] tests::tests from_gnash/actionscript.all/array-v7/fp17
        FAIL [   0.189s] tests::tests from_gnash/actionscript.all/array-v7/fp24
        FAIL [   0.132s] tests::tests from_gnash/actionscript.all/array-v7/fp9
        FAIL [   0.133s] tests::tests from_gnash/actionscript.all/array-v8/fp13
        FAIL [   0.140s] tests::tests from_gnash/actionscript.all/array-v8/fp14
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/array-v8/fp17
        FAIL [   0.127s] tests::tests from_gnash/actionscript.all/array-v8/fp24
        FAIL [   0.152s] tests::tests from_gnash/actionscript.all/array-v8/fp9
        FAIL [   0.066s] tests::tests from_gnash/actionscript.all/case-v6
        FAIL [   0.101s] tests::tests from_gnash/actionscript.all/case-v7
        FAIL [   0.067s] tests::tests from_gnash/actionscript.all/case-v8
        FAIL [  17.496s] tests::tests from_gnash/actionscript.all/caseconv-v6/fp9
        FAIL [  17.317s] tests::tests from_gnash/actionscript.all/caseconv-v7/fp9
        FAIL [  17.387s] tests::tests from_gnash/actionscript.all/caseconv-v8/fp9
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/delete-v5
        FAIL [   0.065s] tests::tests from_gnash/actionscript.all/delete-v6
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/delete-v7
        FAIL [   0.101s] tests::tests from_gnash/actionscript.all/delete-v8
        FAIL [   0.057s] tests::tests from_gnash/actionscript.all/flash-v5
        FAIL [   0.101s] tests::tests from_gnash/actionscript.all/flash-v6
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/flash-v7
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/flash-v8/fp10
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/flash-v8/fp9
        FAIL [   0.059s] tests::tests from_gnash/actionscript.all/getvariable-v5/fp10
        FAIL [   0.064s] tests::tests from_gnash/actionscript.all/getvariable-v5/fp9
        FAIL [   0.072s] tests::tests from_gnash/actionscript.all/getvariable-v6/fp10
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/getvariable-v6/fp9
        FAIL [   0.072s] tests::tests from_gnash/actionscript.all/getvariable-v7/fp10
        FAIL [   0.053s] tests::tests from_gnash/actionscript.all/getvariable-v7/fp9
        FAIL [   0.074s] tests::tests from_gnash/actionscript.all/getvariable-v8/fp10
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/getvariable-v8/fp9
        FAIL [   0.116s] tests::tests from_gnash/actionscript.all/ops-v5/fp10
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/ops-v5/fp9
        FAIL [   0.109s] tests::tests from_gnash/actionscript.all/ops-v6/fp10
        FAIL [   0.094s] tests::tests from_gnash/actionscript.all/ops-v6/fp9
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/ops-v7/fp10
        FAIL [   0.111s] tests::tests from_gnash/actionscript.all/ops-v7/fp9
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/ops-v8
        FAIL [   0.095s] tests::tests from_gnash/actionscript.all/setProperty-v5/fp10
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/setProperty-v5/fp9
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/setProperty-v6/fp10
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/setProperty-v6/fp9
        FAIL [   0.068s] tests::tests from_gnash/actionscript.all/setProperty-v7/fp10
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/setProperty-v7/fp9
        FAIL [   0.064s] tests::tests from_gnash/actionscript.all/setProperty-v8/fp10
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/setProperty-v8/fp9
        FAIL [   0.058s] tests::tests from_gnash/actionscript.all/targetPath-v6
        FAIL [   0.062s] tests::tests from_gnash/actionscript.all/targetPath-v7
        FAIL [   0.059s] tests::tests from_gnash/actionscript.all/targetPath-v8
        FAIL [   0.074s] tests::tests from_gnash/actionscript.all/toString_valueOf-v5
        FAIL [   0.057s] tests::tests from_gnash/actionscript.all/toString_valueOf-v6
        FAIL [   0.061s] tests::tests from_gnash/actionscript.all/toString_valueOf-v7
        FAIL [   0.050s] tests::tests from_gnash/actionscript.all/toString_valueOf-v8
        FAIL [   0.043s] tests::tests from_gnash/actionscript.all/with-v5
        FAIL [   0.050s] tests::tests from_gnash/actionscript.all/with-v6
        FAIL [   0.041s] tests::tests from_gnash/actionscript.all/with-v7
        FAIL [   0.033s] tests::tests from_gnash/actionscript.all/with-v8

@Dinnerbone Dinnerbone added A-tests Area: Tests & Test Framework T-chore Type: Chore (like updating a dependency, it's gotta be done) labels Oct 26, 2025
@Dinnerbone Dinnerbone mentioned this pull request Oct 26, 2025
Merged
@kjarosh
Copy link
Member

kjarosh commented Oct 27, 2025 •
edited
Loading

Some tests fail when running coverage:

from_gnash/actionscript.all/caseconv-v7/fp10
from_gnash/actionscript.all/caseconv-v6/fp10
from_gnash/actionscript.all/caseconv-v8/fp10

They actually fail locally too for me.

@kjarosh
Copy link
Member

kjarosh commented Oct 27, 2025

I think something's wrong with the caseconv tests, their execution time is super high and they fail on some platforms. Those tests usually do tens of thousands of iterations checking all integer values, which may be an overkill here especially that on some FP versions, tests fail for a lot of integers, causing thousands of failures and lines in output.txt.

We might want to write them in such a way that they rarely produce output, or (better IMO) modify them not to iterate over all integers, but only over edge cases.

@kjarosh
Copy link
Member

kjarosh commented Oct 27, 2025

Regarding TextField tests, did you make sure to install the exact same Noto Sans from the .ttf file committed to the repo before running the tests? Noto Sans differs across distributions, so the .ttf must be the exact same used by FP.

@Dinnerbone
Copy link
Contributor Author

Regarding TextField tests, did you make sure to install the exact same Noto Sans from the .ttf file committed to the repo before running the tests? Noto Sans differs across distributions, so the .ttf must be the exact same used by FP.

Yes. That exact ttf file was used on Windows to replace Times New Roman for those tests.

@Dinnerbone
Copy link
Contributor Author

Let's remove caseconv for now to unblock the rest of the tests, whilst we think of something better there

@kjarosh
Copy link
Member

kjarosh commented Oct 27, 2025

Yes. That exact ttf file was used on Windows to replace Times New Roman for those tests.

On Windows? IIUC FP does not use fontconfig on Windows, no?

@Dinnerbone
Copy link
Contributor Author

Yes. That exact ttf file was used on Windows to replace Times New Roman for those tests.

On Windows? IIUC FP does not use fontconfig on Windows, no?

Correct, I had to rename the font to Times New Roman, install it as a user font, and verify that the values changed when I did so, so it's picking up the custom font instead of the system font.

@Dinnerbone Dinnerbone mentioned this pull request Oct 27, 2025
Merged
@kjarosh
Copy link
Member

kjarosh commented Oct 28, 2025 •
edited
Loading

I did some perf testing of those tests, and:

  • caseconv takes around 32 min of workload,
  • argstest takes around 21 min of workload,
  • the rest of 352 tests take around 3.7 min of workload.

I think we should drop argstest too until we come up with something (marking slow tests and running them once per day, etc.).

BitmapData-v8 and MovieClip-v8 are large too, but acceptable (6 s, 14 s).

@Dinnerbone
Copy link
Contributor Author

Surprising that argstest takes so long. It's actually one of the more useful tests as it's essentially checking everything doesn't panic (and already caught two big issues). Do you know if it's the printing or the iteration/calling that is so slow? It's of course not that slow for me, so I'm guessing that's all the instrumentation 😅

@kjarosh
Copy link
Member

kjarosh commented Oct 28, 2025

Hmmm, you're right, something weird must have happened during my testing as now it runs in acceptable time.

kjarosh
kjarosh approved these changes Oct 28, 2025
View reviewed changes
Copy link
Member

@kjarosh kjarosh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, those look like very useful tests!

@kjarosh kjarosh force-pushed the gnash/actionscript branch from b688df5 to 2a80b20 Compare October 28, 2025 20:48
@kjarosh kjarosh enabled auto-merge (rebase) October 28, 2025 20:48
@Dinnerbone
Copy link
Contributor Author

You fixed some tests! :D

@Dinnerbone
Copy link
Contributor Author

And broke one, it seems 🤔 Video-v5 no longer passes. I'll merge it as known-failure though

@kjarosh kjarosh merged commit 6a167aa into ruffle-rs:master Oct 28, 2025
25 of 26 checks passed
@Dinnerbone Dinnerbone deleted the gnash/actionscript branch October 28, 2025 21:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kjarosh kjarosh kjarosh approved these changes

Assignees

No one assigned

Labels

A-tests Area: Tests & Test Framework T-chore Type: Chore (like updating a dependency, it's gotta be done)

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Dinnerbone @kjarosh