sdk icon indicating copy to clipboard operation
sdk copied to clipboard

Failures on new `dart2wasm-linux-optimized-jsc` builder that runs JavaScriptCore's shell

Open mkustermann opened this issue 1 year ago • 3 comments

There are new test failures on [dart2wasm] Add dart2wasm-linux-optimized-jsc builder (to existing configuration with same name).

The test results were baselined with D8 test results, so these should be the differences to D8 (modulo a co19 roll that happened, so some co19 failures may also happen in D8)

Crash -> CompileTimeError (expected Pass)

co19/Language/Statements/Yield_and_Yield_Each/Yield_Each/execution_sync_t05
language/sync_star/generator3_test/test1
language/sync_star/generator3_test/test2
language/sync_star/sync_star_exception_iterator_test
language/sync_star/sync_star_exception_nested_test
language/sync_star/sync_star_exception_test

Fail -> RuntimeError (expected Pass)

co19/Language/Statements/Yield_and_Yield_Each/Yield_Each/execution_async_A03_t07
language/async_star/yield_test

Pass -> Crash (expected Pass)

language/closure/identity_equality_tearoff_test
language/constructor/tear_off_test
language/generic_methods/explicit_instantiated_tearoff_test
language/typedef/aliased_constructor_tear_off_test

Pass -> Fail (expected Pass)

lib/async/catch_errors11_test
lib/async/catch_errors12_test
lib/async/catch_errors13_test
lib/async/catch_errors15_test
lib/async/catch_errors19_test
lib/async/catch_errors20_test
lib/async/catch_errors8_test

Pass -> RuntimeError (expected Pass)

co19/Language/Expressions/Await_Expressions/evaluation_throws_t06
co19/Language/Expressions/Await_Expressions/execution_t01
co19/Language/Expressions/Await_Expressions/execution_t02
co19/Language/Expressions/Await_Expressions/execution_t03
co19/Language/Expressions/Await_Expressions/execution_t04
co19/Language/Expressions/Await_Expressions/execution_t05
co19/Language/Expressions/Await_Expressions/execution_t06
co19/Language/Expressions/Await_Expressions/value_t03
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A01_t02
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A01_t03
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A01_t04
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A01_t05
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A01_t06
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A01_t08
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A03_t01
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A03_t02
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A03_t03
co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A05_t01
co19/Language/Statements/Yield_and_Yield_Each/Yield_Each/execution_async_A03_t10
co19/LanguageFeatures/Patterns/switch_expression_A03_t03
co19/LanguageFeatures/nnbd/future_flattening_A01_t57
co19/LanguageFeatures/nnbd/future_flattening_A01_t58
co19/LanguageFeatures/nnbd/future_flattening_A01_t59
co19/LanguageFeatures/nnbd/future_flattening_A01_t64
co19/LanguageFeatures/nnbd/future_flattening_A01_t65
co19/LanguageFeatures/nnbd/future_flattening_A01_t66
co19/LanguageFeatures/nnbd/future_flattening_A01_t75
co19/LanguageFeatures/nnbd/future_flattening_A01_t76
co19/LanguageFeatures/nnbd/future_flattening_A01_t77
co19/LanguageFeatures/nnbd/future_flattening_A01_t79
co19/LanguageFeatures/nnbd/future_flattening_A01_t80
co19/LanguageFeatures/nnbd/future_flattening_A01_t81
co19/LanguageFeatures/nnbd/syntax_A05_t01
co19/LanguageFeatures/nnbd/syntax_A05_t06
co19/LanguageFeatures/regression/34482_t01
co19/LibTest/async/Future/Future.delayed_A01_t01
co19/LibTest/async/Future/Future.delayed_A01_t02
co19/LibTest/async/Future/Future.delayed_A01_t03
co19/LibTest/async/Future/Future.delayed_A02_t01
co19/LibTest/async/Future/Future.delayed_A03_t01
co19/LibTest/async/Future/Future_A01_t01
co19/LibTest/async/Future/Future_A01_t02
co19/LibTest/async/Future/Future_A01_t03
co19/LibTest/async/Future/Future_A01_t04
co19/LibTest/async/Future/any_A01_t05
co19/LibTest/async/Future/asStream_A01_t01
co19/LibTest/async/Future/doWhile_A05_t01
co19/LibTest/async/Future/forEach_A01_t03
co19/LibTest/async/Future/timeout_A01_t01
co19/LibTest/async/Future/timeout_A02_t01
co19/LibTest/async/Future/timeout_A02_t02
co19/LibTest/async/Future/timeout_A02_t03
co19/LibTest/async/Future/timeout_A03_t01
co19/LibTest/async/Future/wait_A01_t07
co19/LibTest/async/Stream/Stream.fromFuture_A02_t01
co19/LibTest/async/Stream/Stream.fromFuture_A02_t02
co19/LibTest/async/Stream/Stream.fromFutures_all_t01
co19/LibTest/async/Stream/Stream.fromFutures_all_t02
co19/LibTest/async/Stream/Stream.fromIterable_A02_t01
co19/LibTest/async/Stream/Stream.periodic_all_t01
co19/LibTest/async/Stream/Stream.periodic_all_t02
co19/LibTest/async/Stream/asBroadcastStream_A01_t03
co19/LibTest/async/Stream/asBroadcastStream_A01_t05
co19/LibTest/async/Stream/asBroadcastStream_A01_t07
co19/LibTest/async/Stream/timeout_A04_t01
co19/LibTest/async/StreamController/StreamController.broadcast_A04_t01
co19/LibTest/async/StreamController/StreamController.broadcast_A08_t02
co19/LibTest/async/StreamController/StreamController.broadcast_Stream_all_A01_t01
co19/LibTest/async/StreamController/StreamController.broadcast_Stream_all_A01_t02
co19/LibTest/async/StreamController/StreamController.broadcast_Stream_all_A02_t01
co19/LibTest/async/StreamController/StreamController.broadcast_Stream_all_A02_t02
co19/LibTest/async/StreamController/StreamController_A06_t02
co19/LibTest/async/StreamController/StreamController_A07_t01
co19/LibTest/async/StreamController/stream_all_A01_t01
co19/LibTest/async/StreamController/stream_all_A01_t02
co19/LibTest/async/StreamController/stream_all_A02_t01
co19/LibTest/async/StreamController/stream_all_A02_t02
co19/LibTest/async/Timer/Timer_A01_t01
co19/LibTest/async/Timer/Timer_A02_t02
co19/LibTest/async/Timer/cancel_A01_t01
co19/LibTest/async/Timer/cancel_A01_t02
co19/LibTest/async/Timer/isActive_A01_t01
co19/LibTest/async/Timer/run_A01_t01
co19/LibTest/async/Timer/run_A01_t02
co19/LibTest/async/Zone/createTimer_A01_t01
co19/LibTest/core/StackTrace/current_A01_t01
co19/LibTest/core/Stopwatch/elapsedMicroseconds_A01_t01
co19/LibTest/core/Stopwatch/elapsedMilliseconds_A01_t01
co19/LibTest/core/Stopwatch/elapsedTicks_A01_t01
co19/LibTest/core/Stopwatch/elapsedTicks_A01_t02
co19/LibTest/core/Stopwatch/elapsedTicks_A01_t03
co19/LibTest/core/Stopwatch/elapsed_A01_t01
co19/LibTest/core/Stopwatch/elapsed_A01_t02
co19/LibTest/core/Stopwatch/elapsed_A01_t03
co19/LibTest/core/Stopwatch/isRunning_A01_t01
co19/LibTest/core/Stopwatch/reset_A01_t01
co19/LibTest/core/Stopwatch/start_A01_t01
co19/LibTest/core/Stopwatch/start_A01_t02
co19/LibTest/core/Stopwatch/start_A01_t03
co19/LibTest/core/Stopwatch/stop_A01_t01
corelib/error_stack_trace1_test
corelib/list_insert_all_test
corelib/list_replace_range_test
corelib/regexp/lookahead_test
corelib/regexp/named_captures_test
corelib/regexp/overflow_test
corelib/regexp/regexp_test
corelib/regexp/unicode-character-ranges_test
corelib/regexp/unicode-escapes-in-regexps_test
corelib/regexp/unicode-property-general-category_test
corelib/regexp/unicode-property-special_test
corelib/regexp/unicode-regexp-backrefs_test
corelib/regexp/unicode-regexp-ignore-case_test
corelib/regexp/unicode-regexp-match-index_test
corelib/regexp/unicode-regexp-zero-length_test
language/async/call_test
language/async/cascade_test
language/async_star/async_star2_regression_test
language/async_star/await_for_test
language/async_star/await_pauses_test
language/async_star/cancel_while_paused_at_yield_test
language/async_star/cancel_while_paused_test
language/async_star/pause2_test
language/await/for_cancel_test
language/await/future_test
language/closure/cycles_test
language/control_flow_collections/for_await_test
language/import/conditional_import_string_test
language/import/conditional_import_test
language/number/identity2_test
language/regress/regress21795_test
language/regress/regress34482_test
language/stack_trace/demangle_ctors_test
language/stack_trace/full1_test
language/stack_trace/full2_test
language/stack_trace/full3_test
language/stack_trace/rethrow_error_test/none
language/stack_trace/rethrow_error_test/withtraceparameter
language/stack_trace/rethrow_nonerror_test
language/stack_trace/stack_trace_test
language/sync_star/yield_star_pause_test
lib/async/catch_errors14_test
lib/async/catch_errors17_test
lib/async/catch_errors18_test
lib/async/catch_errors21_test
lib/async/catch_errors22_test
lib/async/catch_errors23_test
lib/async/catch_errors24_test
lib/async/catch_errors25_test
lib/async/catch_errors26_test
lib/async/catch_errors27_test
lib/async/catch_errors28_test
lib/async/catch_errors2_test
lib/async/catch_errors3_test
lib/async/catch_errors5_test
lib/async/catch_errors6_test
lib/async/catch_errors7_test
lib/async/catch_errors_test
lib/async/future_constructor2_test
lib/async/future_constructor_test
lib/async/future_extension_test
lib/async/future_foreach_test
lib/async/future_regression_48493_test
lib/async/future_test
lib/async/futures_test
lib/async/intercept_schedule_microtask5_test
lib/async/intercept_schedule_microtask6_test
lib/async/multiple_timer_test
lib/async/periodic_timer4_test
lib/async/regress154963234_strong_test
lib/async/schedule_microtask3_test
lib/async/schedule_microtask5_test
lib/async/schedule_microtask_test
lib/async/slow_consumer2_test
lib/async/slow_consumer3_test
lib/async/slow_consumer_test
lib/async/stack_trace02_test
lib/async/stack_trace03_test
lib/async/stack_trace04_test
lib/async/stack_trace05_test
lib/async/stack_trace12_test
lib/async/stack_trace13_test
lib/async/stack_trace14_test
lib/async/stack_trace15_test
lib/async/stream_controller_async_test
lib/async/stream_controller_test
lib/async/stream_empty_test
lib/async/stream_error_test
lib/async/stream_event_transformed_test
lib/async/stream_from_iterable_test
lib/async/stream_iterator_double_cancel_test
lib/async/stream_periodic4_test
lib/async/stream_periodic5_test
lib/async/stream_state_nonzero_timer_test
lib/async/stream_subscription_as_future_test
lib/async/stream_subscription_cancel_test
lib/async/stream_timeout_test
lib/async/stream_transformation_broadcast_test
lib/async/stream_transformer_from_handlers_test
lib/async/stream_value_test
lib/async/stream_zones_test
lib/async/timer_cancel1_test
lib/async/timer_cancel_test
lib/async/timer_isActive_test
lib/async/timer_test
lib/async/uncaught_error_handler_throws_test
lib/async/wait_for_cancel_test
lib/async/zone_bind_test
lib/async/zone_create_periodic_timer_test
lib/async/zone_create_timer2_test
lib/async/zone_create_timer_test
lib/async/zone_empty_description2_test
lib/async/zone_empty_description_test
lib/async/zone_error_callback_test
lib/convert/streamed_conversion_json_encode1_test
lib/convert/streamed_conversion_json_utf8_encode_test
lib/convert/streamed_conversion_utf8_decode_test
lib/convert/streamed_conversion_utf8_encode_test
lib/js/static_interop_test/isa/functional_test
lib/js/static_interop_test/js_types_test
lib/js_interop_unsafe/basic_test
web/wasm/js_exceptions_test

Pass -> Timeout (expected Pass)

co19/LibTest/collection/ListBase/ListBase_class_A01_t04
co19/LibTest/collection/ListBase/ListBase_class_A01_t05
co19/LibTest/collection/ListBase/ListBase_class_A01_t06
co19/LibTest/collection/ListMixin/ListMixin_class_A01_t04
co19/LibTest/collection/ListMixin/ListMixin_class_A01_t05
co19/LibTest/collection/ListMixin/ListMixin_class_A01_t06
co19/LibTest/core/List/List_all_t04
co19/LibTest/core/List/List_all_t05
co19/LibTest/core/List/List_all_t06

new test -> CompileTimeError (expected Pass)

co19/Language/Expressions/Constants/is_not_type_A01_t02
co19/Language/Expressions/Constants/is_type_A01_t02
lib/js/export/static_interop_mock/proto_test
lib/js/static_interop_test/constants_test
lib/js/static_interop_test/futurevaluetype_test
lib/js/static_interop_test/supertype_transform_test
new test -> Fail (expected Pass)
lib/js/static_interop_test/import/import_test

are failing on configuration dart2wasm-linux-optimized-jsc

mkustermann avatar Jan 29 '24 08:01 mkustermann

The tests

language/closure/identity_equality_tearoff_test Crash (expected Pass)

are failing on configurations

dart2wasm-linux-optimized-jsc

mkustermann avatar Jan 30 '24 11:01 mkustermann

There are new test failures on [CFE] Add a few helper utils...[dart2wasm] Roll binaryen to newer version.

The tests

co19/LanguageFeatures/Spread-collections/DynamicSemantics_Set_A03_t03 RuntimeError (expected Pass)
co19/LibTest/async/StreamController/StreamController_A02_t01 RuntimeError (expected Pass)
co19/LibTest/async/StreamController/addError_A01_t01 RuntimeError (expected Pass)
co19/LibTest/async/StreamController/add_A01_t01 RuntimeError (expected Pass)
co19/LibTest/async/StreamIterator/current_A01_t02 RuntimeError (expected Pass)
co19/LibTest/async/StreamTransformer/StreamTransformer_A03_t01 RuntimeError (expected Pass)
language/generic_methods/generic_invocation_all_subexpression_types_test RuntimeError (expected Pass)
language/generic_methods/non_generic_invocation_all_first_expression_types_test RuntimeError (expected Pass)
language/generic_methods/non_generic_invocation_all_first_types_test RuntimeError (expected Pass)
language/generic_methods/non_generic_invocation_all_second_expression_types_test RuntimeError (expected Pass)
language/generic_methods/non_generic_invocation_all_second_types_test RuntimeError (expected Pass)

are failing on configurations

dart2wasm-linux-optimized-jsc

mkustermann avatar Feb 15 '24 14:02 mkustermann

There are new test failures on [CFE] Add a few helper utils...[dart2wasm] Roll binaryen to newer version.

The tests

co19/LanguageFeatures/Spread-collections/DynamicSemantics_Set_A03_t03 RuntimeError (expected Pass)
co19/LibTest/async/StreamController/StreamController_A02_t01 RuntimeError (expected Pass)
co19/LibTest/async/StreamController/addError_A01_t01 RuntimeError (expected Pass)
co19/LibTest/async/StreamController/add_A01_t01 RuntimeError (expected Pass)
co19/LibTest/async/StreamIterator/current_A01_t02 RuntimeError (expected Pass)
co19/LibTest/async/StreamTransformer/StreamTransformer_A03_t01 RuntimeError (expected Pass)
language/generic_methods/generic_invocation_all_subexpression_types_test RuntimeError (expected Pass)
language/generic_methods/non_generic_invocation_all_first_expression_types_test RuntimeError (expected Pass)
language/generic_methods/non_generic_invocation_all_first_types_test RuntimeError (expected Pass)
language/generic_methods/non_generic_invocation_all_second_expression_types_test RuntimeError (expected Pass)
language/generic_methods/non_generic_invocation_all_second_types_test RuntimeError (expected Pass)

are failing on configurations

dart2wasm-linux-optimized-jsc

dcharkes avatar Feb 16 '24 11:02 dcharkes

Approved the tests

co19/Language/Statements/Yield_and_Yield_Each/Yield/execution_async_A01_t06 RuntimeError (expected Pass)

are failing on configurations

dart2wasm-linux-optimized-jsc

mkustermann avatar Feb 26 '24 11:02 mkustermann