Run main rust-analyzer tests in rust-lang/rust CI by jieyouxu · Pull Request #147372 · rust-lang/rust (original) (raw)
What is this?This is an experimental post-merge analysis report that shows differences in test outcomes between the merged PR and its parent PR.
Comparing ce63e5d (parent) -> eb171a2 (this PR)
Test differences
Show 15001 test diffs
Stage 0
completions::dot::tests::macro_expansion_resilient: [missing] -> pass (J0)completions::item_list::trait_impl::tests::macro_generated_assoc_item: [missing] -> pass (J0)completions::keyword::tests::if_completion_in_format: [missing] -> pass (J0)completions::keyword::tests::test_else_edit_after_if: [missing] -> pass (J0)config::tests::proc_macro_srv_null: [missing] -> pass (J0)goto_definition::tests::goto_def_for_match_nested_in_if: [missing] -> pass (J0)handlers::add_missing_impl_members::tests::nested_macro_should_not_cause_crash: [missing] -> pass (J0)handlers::apply_demorgan::tests::demorgan_method_call_receiver: [missing] -> pass (J0)handlers::convert_closure_to_fn::tests::with_existing_params_trailing_comma: [missing] -> pass (J0)handlers::convert_nested_function_to_closure::tests::convert_nested_function_to_closure_works: [missing] -> pass (J0)handlers::convert_two_arm_bool_match_to_matches_macro::tests::not_applicable_non_two_arm_match: [missing] -> pass (J0)handlers::desugar_doc_comment::tests::quotes_and_escapes: [missing] -> pass (J0)handlers::elided_lifetimes_in_path::tests::fn_: [missing] -> pass (J0)handlers::expand_glob_import::tests::expanding_glob_reexport: [missing] -> pass (J0)handlers::expand_glob_import::tests::test_expanding_multiple_variants_at_once: [missing] -> pass (J0)handlers::extract_variable::tests::extract_var_in_match_guard: [missing] -> pass (J0)handlers::extract_variable::tests::extract_var_name_from_function: [missing] -> pass (J0)handlers::generate_delegate_trait::test::assoc_items_attributes_mutably_cloned: [missing] -> pass (J0)handlers::generate_new::tuple_tests::generate_new_not_applicable_if_fn_exists: [missing] -> pass (J0)handlers::generate_single_field_struct_from::tests::unit: [missing] -> pass (J0)handlers::inline_call::tests::inline_call_closure_body: [missing] -> pass (J0)handlers::inline_local_variable::tests::test_used_in_while_expr: [missing] -> pass (J0)handlers::introduce_named_lifetime::tests::test_function_not_applicable_without_self_and_multiple_unnamed_param_lifetimes: [missing] -> pass (J0)handlers::missing_fields::tests::test_fill_struct_fields_shorthand: [missing] -> pass (J0)handlers::missing_unsafe::tests::needs_parentheses_for_unambiguous: [missing] -> pass (J0)handlers::missing_unsafe::tests::no_missing_unsafe_diagnostic_with_legacy_safe_intrinsic: [missing] -> pass (J0)handlers::promote_local_to_const::tests::multiple_uses: [missing] -> pass (J0)handlers::pull_assignment_up::tests::pull_assignment_up_let_stmt_not_applicable: [missing] -> pass (J0)handlers::remove_dbg::tests::test_remove_trailing_comma_dbg: [missing] -> pass (J0)handlers::replace_filter_map_next_with_find_map::tests::replace_with_find_map: [missing] -> pass (J0)handlers::replace_qualified_name_with_use::tests::does_not_replace_assoc_item_path: [missing] -> pass (J0)handlers::trait_impl_missing_assoc_item::tests::trait_with_default_value: [missing] -> pass (J0)handlers::type_mismatch::tests::type_mismatch_pat_smoke_test: [missing] -> pass (J0)handlers::unwrap_return_type::tests::unwrap_result_return_type_break_split_tail: [missing] -> pass (J0)handlers::wrap_return_type::tests::wrap_return_type_in_result_simple_with_tail_block_like_match_return_expr: [missing] -> pass (J0)hover::tests::raw_keyword_different_editions: [missing] -> pass (J0)hover::tests::test_hover_enum_has_impl_action: [missing] -> pass (J0)macro_expansion_tests::builtin_derive_macro::test_clone_expand: [missing] -> pass (J0)macro_expansion_tests::mbe::test_match_is_not_greedy: [missing] -> pass (J0)nameres::tests::reexport_across_crates: [missing] -> pass (J0)render::tests::no_parens_in_call: [missing] -> pass (J0)render::tests::no_parens_in_use_item: [missing] -> pass (J0)syntax_editor::tests::test_replace_root_with_dependent: [missing] -> pass (J0)tests::fn_param::first_param: [missing] -> pass (J0)tests::generated::doctest_remove_underscore_from_used_variables: [missing] -> pass (J0)tests::macros::infer_type_value_non_legacy_macro_use_as: [missing] -> pass (J0)tests::never_type::diverging_place_match2: [missing] -> pass (J0)tests::record::record_pattern_field_in_macro: [missing] -> pass (J0)tests::regression::new_solver::regression_20975: [missing] -> pass (J0)tests::runner::ok::record_field_pat_leading_or: [missing] -> pass (J0)tests::simple::infer_while_let: [missing] -> pass (J0)tests::special::completes_after_colon_without_trigger: [missing] -> pass (J0)typing::on_enter::tests::indents_fn_body_block: [missing] -> pass (J0)
Stage 1
completions::dot::tests::test_tuple_field_inference: [missing] -> pass (J1)completions::keyword::tests::test_completion_await_impls_future: [missing] -> pass (J1)consteval::tests::locals: [missing] -> pass (J1)fixup::tests::for_no_iter_pattern: [missing] -> pass (J1)goto_definition::tests::goto_def_for_super_assoc_ty_in_path: [missing] -> pass (J1)handlers::auto_import::tests::associated_trait_function: [missing] -> pass (J1)handlers::convert_bool_to_enum::tests::field_in_mod_properly_indented: [missing] -> pass (J1)handlers::convert_tuple_return_type_to_struct::tests::function_basic: [missing] -> pass (J1)handlers::destructure_struct_binding::tests::record_private_fields_appends_rest: [missing] -> pass (J1)handlers::extract_function::tests::non_tail_expr_of_tail_expr_loop: [missing] -> pass (J1)handlers::extract_struct_from_enum_variant::tests::test_extract_struct_one_field_named: [missing] -> pass (J1)handlers::extract_variable::tests::extract_var_regular_parameter: [missing] -> pass (J1)handlers::generate_getter_or_setter::tests_getter::test_convert_reference_type: [missing] -> pass (J1)handlers::generic_args_prohibited::tests::in_record_pat: [missing] -> pass (J1)handlers::inline_call::tests::inline_call_wrapped_in_parentheses: [missing] -> pass (J1)handlers::json_is_not_rust::tests::nested_structs: [missing] -> pass (J1)handlers::merge_imports::tests::test_double_comma: [missing] -> pass (J1)handlers::missing_unsafe::tests::multiple_target_feature_enable: [missing] -> pass (J1)handlers::qualify_path::tests::not_applicable_in_non_start_use: [missing] -> pass (J1)handlers::qualify_path::tests::not_applicable_when_no_imports_found: [missing] -> pass (J1)handlers::replace_if_let_with_match::tests::test_replace_match_with_if_bool: [missing] -> pass (J1)handlers::toggle_async_sugar::tests::desugar_with_use: [missing] -> pass (J1)handlers::unmerge_imports::tests::unmerge_import_with_attributes: [missing] -> pass (J1)handlers::unwrap_return_type::tests::unwrap_result_return_type_simple_with_nested_if: [missing] -> pass (J1)hover::tests::float_literal: [missing] -> pass (J1)hover::tests::test_hover_struct_doc_attr: [missing] -> pass (J1)imports::insert_use::tests::merge_last_fail1: [missing] -> pass (J1)lsp::utils::tests::empty_completion_disjoint_tests: [missing] -> pass (J1)math: [missing] -> pass (J1)references::tests::proc_macro: [missing] -> pass (J1)syntax_helpers::format_string_exprs::tests::format_str_parser: [missing] -> pass (J1)syntax_highlighting::tests::test_rainbow_highlighting: [missing] -> pass (J1)tests::flyimport::trait_method_fuzzy_completion_aware_of_fundamental_boxes: [missing] -> pass (J1)tests::generated::doctest_desugar_async_into_impl_future: [missing] -> pass (J1)tests::item_list::in_trait_assoc_const_missing_body: [missing] -> pass (J1)tests::method_resolution::method_resolution_trait_before_autoderef: [missing] -> pass (J1)tests::never_type::diverging_place_match8: [missing] -> pass (J1)tests::overlapping_possible_matches: [missing] -> pass (J1)tests::runner::err::path_item_without_excl: [missing] -> pass (J1)tests::runner::err::static_where_clause: [missing] -> pass (J1)tests::runner::ok::marco_pat: [missing] -> pass (J1)tests::runner::ok::where_clause: [missing] -> pass (J1)tests::simple::generic_default_depending_on_other_type_arg_forward: [missing] -> pass (J1)tests::traits::dyn_trait: [missing] -> pass (J1)tests::traits::infer_async: [missing] -> pass (J1)tests::traits::infer_await: [missing] -> pass (J1)tests::traits::lifetime_bounds: [missing] -> pass (J1)
(and 14838 additional test diffs)
Additionally, 63 doctest diffs were found. These are ignored, as they are noisy.
Job group index
- J0: x86_64-gnu-llvm-20-3, x86_64-gnu-llvm-21-3
- J1: aarch64-apple, aarch64-gnu, aarch64-gnu-llvm-20-2, aarch64-msvc-2, x86_64-gnu, x86_64-gnu-llvm-20-1, x86_64-gnu-llvm-21-1, x86_64-gnu-nopt, x86_64-gnu-stable, x86_64-mingw-2, x86_64-msvc-2 Test dashboard
Run
cargo run --manifest-path src/ci/citool/Cargo.toml --
test-dashboard eb171a227f9e5de5d376b6edb56b174bc8235fb3 --output-dir test-dashboard
And then open test-dashboard/index.html in your browser to see an overview of all executed tests.
Job duration changes
- aarch64-apple: 8697.0s -> 15116.9s (+73.8%)
- aarch64-gnu-llvm-20-2: 2165.6s -> 2949.3s (+36.2%)
- x86_64-gnu-llvm-21-1: 3167.6s -> 4229.1s (+33.5%)
- x86_64-msvc-2: 7256.8s -> 9095.2s (+25.3%)
- x86_64-gnu-llvm-20-1: 3209.5s -> 3988.4s (+24.3%)
- aarch64-msvc-2: 5223.0s -> 6112.4s (+17.0%)
- x86_64-gnu-nopt: 7388.3s -> 8510.0s (+15.2%)
- x86_64-gnu-distcheck: 7046.4s -> 8051.0s (+14.3%)
- aarch64-gnu: 6443.9s -> 7352.3s (+14.1%)
- x86_64-gnu-llvm-21-2: 5653.0s -> 4868.8s (-13.9%) How to interpret the job duration changes?
Job durations can vary a lot, based on the actual runner instance
that executed the job, system noise, invalidated caches, etc. The table above is provided
mostly for t-infra members, for simpler debugging of potential CI slow-downs.