Pr benchmarking

[jprider63]

test

[github-actions]

Benchmark comparison for ](https://github.com/GaloisInc/cerberus/commit/ce6a2c1ded035126136ea5c42adad98414b3c743) (PR) vs [ (baseline).

tests/compare-benchmarks.py tests/benchmark-data-baseline.json tests/benchmark-data-pr.json

[github-actions]

Benchmark comparison for a83d04bf (PR) vs 3ea8e726 (baseline).

Benchmark comparison

Benchmark name	Baseline time (s)	New time (s)	Difference (s)
./cn/multifile/f.c	0.97	0.98	+0.01 (+1.03%)
./cn/multifile/g.c	0.54	0.54	+0.00 (+0.00%)
./cn/swap_pair.c	0.47	0.47	+0.00 (+0.00%)
./cn/use_enum.c	0.07	0.07	+0.00 (+0.00%)
./cn/mask_ptr.c	0.63	0.65	+0.02 (+3.17%)
./cn/ownership_at_negative_index.c	0.16	0.17	+0.01 (+6.25%)
./cn/cn_inline.c	0.58	0.63	+0.05 (+8.62%)
./cn/type_synonym.c	0.14	0.15	+0.01 (+7.14%)
./cn/division_with_constants.c	0.37	0.36	-0.01 (-2.70%)
./cn/forloop_with_decl.c	0.37	0.4	+0.03 (+8.11%)
./cn/extract_verbose.c	0.32	0.33	+0.01 (+3.12%)
./cn/pred_def01.c	0.18	0.19	+0.01 (+5.56%)
./cn/mod.c	0.21	0.21	+0.00 (+0.00%)
./cn/pred_def02.c	0.1	0.1	+0.00 (+0.00%)
./cn/b_xor.c	0.14	0.14	+0.00 (+0.00%)
./cn/get_from_arr.c	0.28	0.28	+0.00 (+0.00%)
./cn/shift_diff_sz.c	0.24	0.24	+0.00 (+0.00%)
./cn/bitwise_compl_precedence.c	0.06	0.06	+0.00 (+0.00%)
./cn/append.c	5.28	5.34	+0.06 (+1.14%)
./cn/simplify_add_0.c	0.61	0.62	+0.01 (+1.64%)
./cn/reverse.c	2.14	2.19	+0.05 (+2.34%)
./cn/fun_addrs_cn_stmt.c	0.24	0.23	-0.01 (-4.17%)
./cn/implies_associativity.c	0.07	0.06	-0.01 (-14.29%)
./cn/gnu_types_compatible.c	0.42	0.42	+0.00 (+0.00%)
./cn/inconsistent2.c	0.1	0.1	+0.00 (+0.00%)
./cn/enum_and_and.c	0.32	0.32	+0.00 (+0.00%)
./cn/arrow_access.c	0.35	0.36	+0.01 (+2.86%)
./cn/doubling.c	0.36	0.37	+0.01 (+2.78%)
./cn/match.c	0.22	0.22	+0.00 (+0.00%)
./cn/swap.c	0.46	0.47	+0.01 (+2.17%)
./cn/fun_ptr_extern.c	1.58	1.62	+0.04 (+2.53%)
./cn/ghost_pointer_to_bitvec_cast.c	0.11	0.11	+0.00 (+0.00%)
./cn/division_casting.c	0.18	0.18	+0.00 (+0.00%)
./cn/simple_loop.c	0.21	0.21	+0.00 (+0.00%)
./cn/magic_comment_not_closed.c	0.06	0.06	+0.00 (+0.00%)
./cn/test_pointer_eq.c	0.39	0.39	+0.00 (+0.00%)
./cn/implies.c	0.18	0.18	+0.00 (+0.00%)
./cn/void_star_arg.c	1.15	1.17	+0.02 (+1.74%)
./cn/ptr_diff2.c	0.24	0.24	+0.00 (+0.00%)
./cn/division.c	0.21	0.21	+0.00 (+0.00%)
./cn/inconsistent.c	0.13	0.12	-0.01 (-7.69%)
./cn/mod_casting.c	0.19	0.19	+0.00 (+0.00%)
./cn/split_case.c	1.21	1.21	+0.00 (+0.00%)
./cn/left_shift_const.c	0.37	0.37	+0.00 (+0.00%)
./cn/disj_nonnull.c	0.33	0.34	+0.01 (+3.03%)
./cn/mergesort.c	10.41	10.7	+0.29 (+2.79%)
./cn/bitwise_and.c	0.13	0.13	+0.00 (+0.00%)
./cn/tree_rev01.c	1.33	1.36	+0.03 (+2.26%)
./cn/tag_defs.c	0.12	0.12	+0.00 (+0.00%)
./cn/bitwise_compl.c	0.13	0.13	+0.00 (+0.00%)
./cn/division_precedence.c	0.4	0.4	+0.00 (+0.00%)
./cn/pointer_to_intptr_t_cast.c	0.17	0.17	+0.00 (+0.00%)
./cn/pointer_to_char_cast.c	0.32	0.33	+0.01 (+3.12%)
./cn/builtin_ctz.c	0.98	1	+0.02 (+2.04%)
./cn/gnu_ffs.c	0.32	0.33	+0.01 (+3.12%)
./cn/increments.c	0.59	0.61	+0.02 (+3.39%)
./cn/gnu_ctz.c	0.25	0.26	+0.01 (+4.00%)
./cn/max_min_consts.c	0.15	0.15	+0.00 (+0.00%)
./cn/gnu_case_ranges.c	0.28	0.29	+0.01 (+3.57%)
./cn/builtin_ctz_val.c	0.55	0.55	+0.00 (+0.00%)
./cn/use_typedef.c	0.1	0.1	+0.00 (+0.00%)
./cn/fun_ptr_three_opts.c	3.23	3.28	+0.05 (+1.55%)
./cn/unary_negation.c	0.07	0.07	+0.00 (+0.00%)
./cn/mutual_rec/mutual_rec.c	14.61	14.86	+0.25 (+1.71%)
./cn/list_rev01.c	1.5	1.51	+0.01 (+0.67%)
./cn/memcpy.c	1.02	1.01	-0.01 (-0.98%)
./cn/mod_with_constants.c	0.36	0.35	-0.01 (-2.78%)
./cn/tree16/as_mutual_dt/tree16.c	16.18	16.31	+0.13 (+0.80%)
./cn/tree16/as_partial_map/tree16.c	6.25	6.38	+0.13 (+2.08%)
./cn/pred_def04.c	0.08	0.08	+0.00 (+0.00%)
./cn/ptr_diff.c	0.46	0.46	+0.00 (+0.00%)
./cn/mod_precedence.c	0.4	0.4	+0.00 (+0.00%)
./cn/implies_precedence.c	0.16	0.16	+0.00 (+0.00%)
./cn/pointer_to_uintptr_t_cast.c	0.16	0.17	+0.01 (+6.25%)
./cn/b_or.c	0.14	0.14	+0.00 (+0.00%)
./cn/get_from_array.c	0.57	0.57	+0.00 (+0.00%)
./cn/gnu_choose.c	0.29	0.29	+0.00 (+0.00%)
./cn/fun_ptr_known.c	1.43	1.46	+0.03 (+2.10%)
./cn/block_type.c	0.21	0.22	+0.01 (+4.76%)

[github-actions]

Benchmark comparison for bd8ef219 (PR) vs 3ea8e726 (baseline).

Benchmark comparison

Benchmark name	Baseline time (s)	New time (s)	Difference (s)
./cn/multifile/f.c	0.98	0.99	+0.01 (+1.02%)
./cn/multifile/g.c	0.54	0.55	+0.01 (+1.85%)
./cn/swap_pair.c	0.48	0.49	+0.01 (+2.08%)
./cn/use_enum.c	0.07	0.07	+0.00 (+0.00%)
./cn/mask_ptr.c	0.64	0.65	+0.01 (+1.56%)
./cn/ownership_at_negative_index.c	0.16	0.16	+0.00 (+0.00%)
./cn/cn_inline.c	0.61	0.62	+0.01 (+1.64%)
./cn/type_synonym.c	0.15	0.15	+0.00 (+0.00%)
./cn/division_with_constants.c	0.35	0.36	+0.01 (+2.86%)
./cn/forloop_with_decl.c	0.38	0.38	+0.00 (+0.00%)
./cn/extract_verbose.c	0.33	0.33	+0.00 (+0.00%)
./cn/pred_def01.c	0.19	0.19	+0.00 (+0.00%)
./cn/mod.c	0.21	0.22	+0.01 (+4.76%)
./cn/pred_def02.c	0.1	0.1	+0.00 (+0.00%)
./cn/b_xor.c	0.14	0.14	+0.00 (+0.00%)
./cn/get_from_arr.c	0.29	0.29	+0.00 (+0.00%)
./cn/shift_diff_sz.c	0.24	0.24	+0.00 (+0.00%)
./cn/bitwise_compl_precedence.c	0.06	0.06	+0.00 (+0.00%)
./cn/append.c	5.44	5.49	+0.05 (+0.92%)
./cn/simplify_add_0.c	0.66	0.64	-0.02 (-3.03%)
./cn/reverse.c	2.19	2.2	+0.01 (+0.46%)
./cn/fun_addrs_cn_stmt.c	0.24	0.24	+0.00 (+0.00%)
./cn/implies_associativity.c	0.06	0.06	+0.00 (+0.00%)
./cn/gnu_types_compatible.c	0.41	0.44	+0.03 (+7.32%)
./cn/inconsistent2.c	0.1	0.11	+0.01 (+10.00%)
./cn/enum_and_and.c	0.32	0.33	+0.01 (+3.12%)
./cn/arrow_access.c	0.36	0.37	+0.01 (+2.78%)
./cn/doubling.c	0.37	0.38	+0.01 (+2.70%)
./cn/match.c	0.22	0.22	+0.00 (+0.00%)
./cn/swap.c	0.47	0.48	+0.01 (+2.13%)
./cn/fun_ptr_extern.c	1.63	1.68	+0.05 (+3.07%)
./cn/ghost_pointer_to_bitvec_cast.c	0.11	0.11	+0.00 (+0.00%)
./cn/division_casting.c	0.19	0.19	+0.00 (+0.00%)
./cn/simple_loop.c	0.21	0.22	+0.01 (+4.76%)
./cn/magic_comment_not_closed.c	0.06	0.06	+0.00 (+0.00%)
./cn/test_pointer_eq.c	0.39	0.41	+0.02 (+5.13%)
./cn/implies.c	0.18	0.19	+0.01 (+5.56%)
./cn/void_star_arg.c	1.16	1.21	+0.05 (+4.31%)
./cn/ptr_diff2.c	0.23	0.24	+0.01 (+4.35%)
./cn/division.c	0.21	0.22	+0.01 (+4.76%)
./cn/inconsistent.c	0.13	0.13	+0.00 (+0.00%)
./cn/mod_casting.c	0.18	0.19	+0.01 (+5.56%)
./cn/split_case.c	1.19	1.23	+0.04 (+3.36%)
./cn/left_shift_const.c	0.36	0.38	+0.02 (+5.56%)
./cn/disj_nonnull.c	0.34	0.34	+0.00 (+0.00%)
./cn/mergesort.c	10.27	10.67	+0.40 (+3.89%)
./cn/bitwise_and.c	0.13	0.14	+0.01 (+7.69%)
./cn/tree_rev01.c	1.35	1.42	+0.07 (+5.19%)
./cn/tag_defs.c	0.12	0.13	+0.01 (+8.33%)
./cn/bitwise_compl.c	0.13	0.14	+0.01 (+7.69%)
./cn/division_precedence.c	0.39	0.42	+0.03 (+7.69%)
./cn/pointer_to_intptr_t_cast.c	0.17	0.17	+0.00 (+0.00%)
./cn/pointer_to_char_cast.c	0.33	0.34	+0.01 (+3.03%)
./cn/builtin_ctz.c	0.98	1.04	+0.06 (+6.12%)
./cn/gnu_ffs.c	0.31	0.34	+0.03 (+9.68%)
./cn/increments.c	0.6	0.61	+0.01 (+1.67%)
./cn/gnu_ctz.c	0.26	0.27	+0.01 (+3.85%)
./cn/max_min_consts.c	0.15	0.15	+0.00 (+0.00%)
./cn/gnu_case_ranges.c	0.28	0.28	+0.00 (+0.00%)
./cn/builtin_ctz_val.c	0.55	0.58	+0.03 (+5.45%)
./cn/use_typedef.c	0.1	0.11	+0.01 (+10.00%)
./cn/fun_ptr_three_opts.c	3.25	3.37	+0.12 (+3.69%)
./cn/unary_negation.c	0.07	0.08	+0.01 (+14.29%)
./cn/mutual_rec/mutual_rec.c	14.71	15.53	+0.82 (+5.57%)
./cn/list_rev01.c	1.5	1.63	+0.13 (+8.67%)
./cn/memcpy.c	1	1.09	+0.09 (+9.00%)
./cn/mod_with_constants.c	0.35	0.38	+0.03 (+8.57%)
./cn/tree16/as_mutual_dt/tree16.c	16.54	17.32	+0.78 (+4.72%)
./cn/tree16/as_partial_map/tree16.c	6.4	6.61	+0.21 (+3.28%)
./cn/pred_def04.c	0.08	0.08	+0.00 (+0.00%)
./cn/ptr_diff.c	0.46	0.49	+0.03 (+6.52%)
./cn/mod_precedence.c	0.39	0.42	+0.03 (+7.69%)
./cn/implies_precedence.c	0.16	0.16	+0.00 (+0.00%)
./cn/pointer_to_uintptr_t_cast.c	0.17	0.17	+0.00 (+0.00%)
./cn/b_or.c	0.14	0.15	+0.01 (+7.14%)
./cn/get_from_array.c	0.57	0.6	+0.03 (+5.26%)
./cn/gnu_choose.c	0.29	0.31	+0.02 (+6.90%)
./cn/fun_ptr_known.c	1.45	1.5	+0.05 (+3.45%)
./cn/block_type.c	0.22	0.22	+0.00 (+0.00%)

[github-actions]

Benchmark comparison for c6aea899 (PR) vs 3ea8e726 (baseline).

Added benchmarks: ./cn/unsupported_union.error.c, ./cn/bitwise_and_type_left.error.c, ./cn/bitwise_compl_type.error.c, ./cn/missing_resource.error.c, ./cn/bitwise_and_type_right.error.c, ./cn/bad_constructor_user.error.c, ./cn/bad_record2.error.c, ./cn/pointer_to_char_cast.error.c, ./cn/incomplete_match.error.c, ./cn/merging_arrays.error.c, ./cn/unary_negation.error.c, ./cn/bad_function_call.error.c, ./cn/cnfunction_mismatched_args4.error.c, ./cn/division_return_sign.error.c, ./cn/duplicate_pattern_var.error.c, ./cn/bad_col.error.c, ./cn/failing_precond.error.c, ./cn/spec_after_curly_brace.error.c, ./cn/reverse.error.c, ./cn/map_set.error.c, ./cn/mod_return_size.error.c, ./cn/duplicate_datatype_var.error.c, ./cn/implies3.error.c, ./cn/pointer_to_unsigned_int_cast.error.c, ./cn/list_literal_type.error.c, ./cn/pointer_to_int_cast.error.c, ./cn/bad_recursion.error.c, ./cn/inconsistent.error.c, ./cn/mod_by_0.error.c, ./cn/redundant_pattern.error.c, ./cn/missing_resource_indirect.error.c, ./cn/struct_updates2.error.c, ./cn/cnfunction_mismatched_args1.error.c, ./cn/lexer_hack_parse.error.c, ./cn/division_return_size.error.c, ./cn/cnfunction_mismatched_args2.error.c, ./cn/division_by_0.error.c, ./cn/bad_resource_var.error.c, ./cn/arith_type.error.c, ./cn/implies2.error.c, ./cn/cnfunction_mismatched_args3.error.c, ./cn/tree16/as_auto_mutual_dt/tree16.error.c, ./cn/and_or_precedence.error.c, ./cn/bad_record.error.c, ./cn/assert_on_toplevel.error.c, ./cn/unsupported_flexible_array_member.error.c, ./cn/pred_def03.error.c, ./cn/struct_updates.error.c, ./cn/failing_postcond.error.c, ./cn/mod_return_sign.error.c

Benchmark comparison

Benchmark name	Baseline time (s)	New time (s)	Difference (s)
./cn/multifile/f.c	0.96	0.97	+0.01 (+1.04%)
./cn/multifile/g.c	0.53	0.54	+0.01 (+1.89%)
./cn/swap_pair.c	0.48	0.47	-0.01 (-2.08%)
./cn/use_enum.c	0.07	0.07	+0.00 (+0.00%)
./cn/mask_ptr.c	0.62	0.63	+0.01 (+1.61%)
./cn/ownership_at_negative_index.c	0.16	0.16	+0.00 (+0.00%)
./cn/cn_inline.c	0.57	0.59	+0.02 (+3.51%)
./cn/type_synonym.c	0.15	0.15	+0.00 (+0.00%)
./cn/division_with_constants.c	0.35	0.36	+0.01 (+2.86%)
./cn/forloop_with_decl.c	0.37	0.38	+0.01 (+2.70%)
./cn/extract_verbose.c	0.32	0.33	+0.01 (+3.12%)
./cn/pred_def01.c	0.18	0.18	+0.00 (+0.00%)
./cn/mod.c	0.21	0.21	+0.00 (+0.00%)
./cn/pred_def02.c	0.1	0.1	+0.00 (+0.00%)
./cn/b_xor.c	0.14	0.14	+0.00 (+0.00%)
./cn/get_from_arr.c	0.28	0.28	+0.00 (+0.00%)
./cn/shift_diff_sz.c	0.24	0.24	+0.00 (+0.00%)
./cn/bitwise_compl_precedence.c	0.06	0.06	+0.00 (+0.00%)
./cn/append.c	5.23	5.33	+0.10 (+1.91%)
./cn/simplify_add_0.c	0.61	0.63	+0.02 (+3.28%)
./cn/reverse.c	2.16	2.19	+0.03 (+1.39%)
./cn/fun_addrs_cn_stmt.c	0.23	0.24	+0.01 (+4.35%)
./cn/implies_associativity.c	0.06	0.06	+0.00 (+0.00%)
./cn/gnu_types_compatible.c	0.42	0.42	+0.00 (+0.00%)
./cn/inconsistent2.c	0.1	0.1	+0.00 (+0.00%)
./cn/enum_and_and.c	0.32	0.33	+0.01 (+3.12%)
./cn/arrow_access.c	0.35	0.36	+0.01 (+2.86%)
./cn/doubling.c	0.36	0.37	+0.01 (+2.78%)
./cn/match.c	0.22	0.22	+0.00 (+0.00%)
./cn/swap.c	0.46	0.47	+0.01 (+2.17%)
./cn/fun_ptr_extern.c	1.57	1.61	+0.04 (+2.55%)
./cn/ghost_pointer_to_bitvec_cast.c	0.11	0.11	+0.00 (+0.00%)
./cn/division_casting.c	0.19	0.18	-0.01 (-5.26%)
./cn/simple_loop.c	0.21	0.21	+0.00 (+0.00%)
./cn/magic_comment_not_closed.c	0.06	0.06	+0.00 (+0.00%)
./cn/test_pointer_eq.c	0.38	0.39	+0.01 (+2.63%)
./cn/implies.c	0.19	0.19	+0.00 (+0.00%)
./cn/void_star_arg.c	1.13	1.15	+0.02 (+1.77%)
./cn/ptr_diff2.c	0.23	0.24	+0.01 (+4.35%)
./cn/division.c	0.21	0.21	+0.00 (+0.00%)
./cn/inconsistent.c	0.12	0.12	+0.00 (+0.00%)
./cn/mod_casting.c	0.19	0.18	-0.01 (-5.26%)
./cn/split_case.c	1.18	1.2	+0.02 (+1.69%)
./cn/left_shift_const.c	0.36	0.37	+0.01 (+2.78%)
./cn/disj_nonnull.c	0.33	0.34	+0.01 (+3.03%)
./cn/mergesort.c	10.28	10.42	+0.14 (+1.36%)
./cn/bitwise_and.c	0.13	0.14	+0.01 (+7.69%)
./cn/tree_rev01.c	1.34	1.38	+0.04 (+2.99%)
./cn/tag_defs.c	0.12	0.12	+0.00 (+0.00%)
./cn/bitwise_compl.c	0.13	0.13	+0.00 (+0.00%)
./cn/division_precedence.c	0.39	0.4	+0.01 (+2.56%)
./cn/pointer_to_intptr_t_cast.c	0.17	0.17	+0.00 (+0.00%)
./cn/pointer_to_char_cast.c	0.32	0.32	+0.00 (+0.00%)
./cn/builtin_ctz.c	0.98	1	+0.02 (+2.04%)
./cn/gnu_ffs.c	0.31	0.32	+0.01 (+3.23%)
./cn/increments.c	0.59	0.6	+0.01 (+1.69%)
./cn/gnu_ctz.c	0.26	0.26	+0.00 (+0.00%)
./cn/max_min_consts.c	0.15	0.15	+0.00 (+0.00%)
./cn/gnu_case_ranges.c	0.28	0.28	+0.00 (+0.00%)
./cn/builtin_ctz_val.c	0.54	0.56	+0.02 (+3.70%)
./cn/use_typedef.c	0.11	0.11	+0.00 (+0.00%)
./cn/fun_ptr_three_opts.c	3.2	3.25	+0.05 (+1.56%)
./cn/unary_negation.c	0.07	0.07	+0.00 (+0.00%)
./cn/mutual_rec/mutual_rec.c	14.5	14.83	+0.33 (+2.28%)
./cn/list_rev01.c	1.46	1.48	+0.02 (+1.37%)
./cn/memcpy.c	0.99	1.01	+0.02 (+2.02%)
./cn/mod_with_constants.c	0.35	0.35	+0.00 (+0.00%)
./cn/tree16/as_mutual_dt/tree16.c	16.09	16.15	+0.06 (+0.37%)
./cn/tree16/as_partial_map/tree16.c	6.13	6.25	+0.12 (+1.96%)
./cn/pred_def04.c	0.08	0.08	+0.00 (+0.00%)
./cn/ptr_diff.c	0.45	0.46	+0.01 (+2.22%)
./cn/mod_precedence.c	0.39	0.4	+0.01 (+2.56%)
./cn/implies_precedence.c	0.16	0.16	+0.00 (+0.00%)
./cn/pointer_to_uintptr_t_cast.c	0.17	0.17	+0.00 (+0.00%)
./cn/b_or.c	0.13	0.14	+0.01 (+7.69%)
./cn/get_from_array.c	0.56	0.58	+0.02 (+3.57%)
./cn/gnu_choose.c	0.29	0.3	+0.01 (+3.45%)
./cn/fun_ptr_known.c	1.4	1.45	+0.05 (+3.57%)
./cn/block_type.c	0.22	0.21	-0.01 (-4.55%)

[github-actions]

Benchmark comparison for f8547810 (PR) vs 4ac053b1 (baseline).

Benchmark comparison

Benchmark name	Baseline time (s)	New time (s)	Difference (s)
./cn/unsupported_union.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bitwise_and_type_left.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bitwise_compl_type.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/missing_resource.error.c	0.15	0.15	+0.00 (+0.00%)
./cn/multifile/f.c	0.97	0.98	+0.01 (+1.03%)
./cn/multifile/g.c	0.54	0.55	+0.01 (+1.85%)
./cn/swap_pair.c	0.48	0.48	+0.00 (+0.00%)
./cn/bitwise_and_type_right.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/bad_constructor_user.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/use_enum.c	0.07	0.07	+0.00 (+0.00%)
./cn/mask_ptr.c	0.65	0.64	-0.01 (-1.54%)
./cn/bad_record2.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/ownership_at_negative_index.c	0.16	0.16	+0.00 (+0.00%)
./cn/cn_inline.c	0.59	0.6	+0.01 (+1.69%)
./cn/type_synonym.c	0.15	0.15	+0.00 (+0.00%)
./cn/division_with_constants.c	0.35	0.36	+0.01 (+2.86%)
./cn/forloop_with_decl.c	0.37	0.38	+0.01 (+2.70%)
./cn/pointer_to_char_cast.error.c	0.4	0.4	+0.00 (+0.00%)
./cn/incomplete_match.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/extract_verbose.c	0.33	0.33	+0.00 (+0.00%)
./cn/merging_arrays.error.c	0.57	0.58	+0.01 (+1.75%)
./cn/unary_negation.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/pred_def01.c	0.19	0.19	+0.00 (+0.00%)
./cn/bad_function_call.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/cnfunction_mismatched_args4.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/division_return_sign.error.c	0.05	0.05	+0.00 (+0.00%)
./cn/mod.c	0.22	0.21	-0.01 (-4.55%)
./cn/duplicate_pattern_var.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bad_col.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/pred_def02.c	0.1	0.1	+0.00 (+0.00%)
./cn/failing_precond.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/b_xor.c	0.13	0.14	+0.01 (+7.69%)
./cn/spec_after_curly_brace.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/get_from_arr.c	0.28	0.29	+0.01 (+3.57%)
./cn/shift_diff_sz.c	0.24	0.24	+0.00 (+0.00%)
./cn/bitwise_compl_precedence.c	0.06	0.06	+0.00 (+0.00%)
./cn/append.c	5.33	5.41	+0.08 (+1.50%)
./cn/reverse.error.c	2.54	2.58	+0.04 (+1.57%)
./cn/map_set.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/mod_return_size.error.c	3.29	3.42	+0.13 (+3.95%)
./cn/simplify_add_0.c	0.63	0.64	+0.01 (+1.59%)
./cn/reverse.c	2.14	2.21	+0.07 (+3.27%)
./cn/fun_addrs_cn_stmt.c	0.24	0.25	+0.01 (+4.17%)
./cn/implies_associativity.c	0.06	0.06	+0.00 (+0.00%)
./cn/gnu_types_compatible.c	0.44	0.43	-0.01 (-2.27%)
./cn/duplicate_datatype_var.error.c	0.02	0.03	+0.01 (+50.00%)
./cn/implies3.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/inconsistent2.c	0.1	0.11	+0.01 (+10.00%)
./cn/enum_and_and.c	0.32	0.32	+0.00 (+0.00%)
./cn/pointer_to_unsigned_int_cast.error.c	0.19	0.19	+0.00 (+0.00%)
./cn/arrow_access.c	0.37	0.36	-0.01 (-2.70%)
./cn/doubling.c	0.37	0.4	+0.03 (+8.11%)
./cn/match.c	0.22	0.23	+0.01 (+4.55%)
./cn/swap.c	0.47	0.48	+0.01 (+2.13%)
./cn/fun_ptr_extern.c	1.6	1.66	+0.06 (+3.75%)
./cn/list_literal_type.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/pointer_to_int_cast.error.c	0.11	0.11	+0.00 (+0.00%)
./cn/ghost_pointer_to_bitvec_cast.c	0.11	0.11	+0.00 (+0.00%)
./cn/division_casting.c	0.19	0.19	+0.00 (+0.00%)
./cn/simple_loop.c	0.21	0.21	+0.00 (+0.00%)
./cn/magic_comment_not_closed.c	0.06	0.06	+0.00 (+0.00%)
./cn/bad_recursion.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/test_pointer_eq.c	0.39	0.4	+0.01 (+2.56%)
./cn/inconsistent.error.c	0.04	0.03	-0.01 (-25.00%)
./cn/implies.c	0.18	0.19	+0.01 (+5.56%)
./cn/void_star_arg.c	1.14	1.19	+0.05 (+4.39%)
./cn/mod_by_0.error.c	0.2	0.21	+0.01 (+5.00%)
./cn/redundant_pattern.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/ptr_diff2.c	0.23	0.24	+0.01 (+4.35%)
./cn/division.c	0.21	0.21	+0.00 (+0.00%)
./cn/inconsistent.c	0.13	0.13	+0.00 (+0.00%)
./cn/missing_resource_indirect.error.c	0.17	0.17	+0.00 (+0.00%)
./cn/mod_casting.c	0.19	0.19	+0.00 (+0.00%)
./cn/split_case.c	1.18	1.23	+0.05 (+4.24%)
./cn/left_shift_const.c	0.37	0.38	+0.01 (+2.70%)
./cn/disj_nonnull.c	0.33	0.34	+0.01 (+3.03%)
./cn/struct_updates2.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/mergesort.c	10.4	10.66	+0.26 (+2.50%)
./cn/cnfunction_mismatched_args1.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/lexer_hack_parse.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bitwise_and.c	0.13	0.13	+0.00 (+0.00%)
./cn/tree_rev01.c	1.35	1.37	+0.02 (+1.48%)
./cn/division_return_size.error.c	0.43	0.43	+0.00 (+0.00%)
./cn/cnfunction_mismatched_args2.error.c	0.03	0.04	+0.01 (+33.33%)
./cn/tag_defs.c	0.12	0.12	+0.00 (+0.00%)
./cn/bitwise_compl.c	0.14	0.13	-0.01 (-7.14%)
./cn/division_precedence.c	0.4	0.41	+0.01 (+2.50%)
./cn/pointer_to_intptr_t_cast.c	0.17	0.17	+0.00 (+0.00%)
./cn/division_by_0.error.c	0.2	0.2	+0.00 (+0.00%)
./cn/pointer_to_char_cast.c	0.32	0.33	+0.01 (+3.12%)
./cn/builtin_ctz.c	0.99	1.01	+0.02 (+2.02%)
./cn/gnu_ffs.c	0.32	0.33	+0.01 (+3.12%)
./cn/increments.c	0.62	0.61	-0.01 (-1.61%)
./cn/gnu_ctz.c	0.25	0.26	+0.01 (+4.00%)
./cn/max_min_consts.c	0.15	0.15	+0.00 (+0.00%)
./cn/gnu_case_ranges.c	0.29	0.29	+0.00 (+0.00%)
./cn/builtin_ctz_val.c	0.56	0.56	+0.00 (+0.00%)
./cn/bad_resource_var.error.c	0.23	0.23	+0.00 (+0.00%)
./cn/arith_type.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/use_typedef.c	0.1	0.11	+0.01 (+10.00%)
./cn/fun_ptr_three_opts.c	3.26	3.33	+0.07 (+2.15%)
./cn/unary_negation.c	0.07	0.07	+0.00 (+0.00%)
./cn/mutual_rec/mutual_rec.c	14.86	15.08	+0.22 (+1.48%)
./cn/list_rev01.c	1.48	1.52	+0.04 (+2.70%)
./cn/implies2.error.c	0.18	0.19	+0.01 (+5.56%)
./cn/memcpy.c	1	1.02	+0.02 (+2.00%)
./cn/mod_with_constants.c	0.35	0.36	+0.01 (+2.86%)
./cn/cnfunction_mismatched_args3.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/tree16/as_mutual_dt/tree16.c	16.09	16.51	+0.42 (+2.61%)
./cn/tree16/as_partial_map/tree16.c	6.23	6.35	+0.12 (+1.93%)
./cn/tree16/as_auto_mutual_dt/tree16.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/pred_def04.c	0.08	0.08	+0.00 (+0.00%)
./cn/and_or_precedence.error.c	0.26	0.26	+0.00 (+0.00%)
./cn/bad_record.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/assert_on_toplevel.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/ptr_diff.c	0.46	0.47	+0.01 (+2.17%)
./cn/mod_precedence.c	0.4	0.4	+0.00 (+0.00%)
./cn/implies_precedence.c	0.16	0.16	+0.00 (+0.00%)
./cn/unsupported_flexible_array_member.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/pointer_to_uintptr_t_cast.c	0.17	0.17	+0.00 (+0.00%)
./cn/b_or.c	0.14	0.14	+0.00 (+0.00%)
./cn/pred_def03.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/get_from_array.c	0.57	0.58	+0.01 (+1.75%)
./cn/gnu_choose.c	0.29	0.3	+0.01 (+3.45%)
./cn/struct_updates.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/failing_postcond.error.c	0.14	0.15	+0.01 (+7.14%)
./cn/fun_ptr_known.c	1.43	1.47	+0.04 (+2.80%)
./cn/mod_return_sign.error.c	0.05	0.05	+0.00 (+0.00%)
./cn/block_type.c	0.22	0.22	+0.00 (+0.00%)

[github-actions]

Benchmark comparison for 5a0b6ab7 (PR) vs 4ac053b1 (baseline).

Warning: Performance degradations: ./cn/ghost_pointer_to_bitvec_cast.c
Warning: Removed benchmarks: ./cn/test_pointer_eq.c
Added benchmarks: ./cn/spec_null_shift.error.c, ./cn/copy_alloc_id.c, ./cn/copy_alloc_id.error.c, ./cn/has_alloc_id_ptr_eq2.error.c, ./cn/unconstrained_ptr_eq.error.c, ./cn/ptr_diff2.error.c, ./cn/simplify_array_shift.c, ./cn/has_alloc_id.c, ./cn/unconstrained_ptr_eq2.error.c, ./cn/has_alloc_id_ptr_eq.error.c, ./cn/has_alloc_id_ptr_neq.c, ./cn/has_alloc_id.error.c, ./cn/spec_null_shift.c, ./cn/has_alloc_id_ptr_neq.error.c

Benchmark comparison

Benchmark name	Baseline time (s)	New time (s)	Difference (s)
./cn/unsupported_union.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bitwise_and_type_left.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bitwise_compl_type.error.c	0.05	0.04	-0.01 (-20.00%)
./cn/missing_resource.error.c	0.15	0.15	+0.00 (+0.00%)
./cn/multifile/f.c	0.97	0.97	+0.00 (+0.00%)
./cn/multifile/g.c	0.55	0.74	+0.19 (+34.55%)
./cn/swap_pair.c	0.51	0.47	-0.04 (-7.84%)
./cn/bitwise_and_type_right.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/bad_constructor_user.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/use_enum.c	0.08	0.07	-0.01 (-12.50%)
./cn/mask_ptr.c	0.66	0.66	+0.00 (+0.00%)
./cn/bad_record2.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/ownership_at_negative_index.c	0.17	0.17	+0.00 (+0.00%)
./cn/cn_inline.c	0.61	0.61	+0.00 (+0.00%)
./cn/type_synonym.c	0.15	0.15	+0.00 (+0.00%)
./cn/division_with_constants.c	0.35	0.36	+0.01 (+2.86%)
./cn/forloop_with_decl.c	0.39	0.41	+0.02 (+5.13%)
./cn/pointer_to_char_cast.error.c	0.39	0.42	+0.03 (+7.69%)
./cn/incomplete_match.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/extract_verbose.c	0.33	0.33	+0.00 (+0.00%)
./cn/merging_arrays.error.c	0.58	0.63	+0.05 (+8.62%)
./cn/unary_negation.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/pred_def01.c	0.19	0.19	+0.00 (+0.00%)
./cn/bad_function_call.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/cnfunction_mismatched_args4.error.c	0.03	0.04	+0.01 (+33.33%)
./cn/division_return_sign.error.c	0.05	0.06	+0.01 (+20.00%)
./cn/mod.c	0.22	0.22	+0.00 (+0.00%)
./cn/duplicate_pattern_var.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bad_col.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/pred_def02.c	0.1	0.11	+0.01 (+10.00%)
./cn/failing_precond.error.c	0.03	0.04	+0.01 (+33.33%)
./cn/b_xor.c	0.15	0.15	+0.00 (+0.00%)
./cn/spec_after_curly_brace.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/get_from_arr.c	0.29	0.31	+0.02 (+6.90%)
./cn/shift_diff_sz.c	0.24	0.26	+0.02 (+8.33%)
./cn/bitwise_compl_precedence.c	0.06	0.06	+0.00 (+0.00%)
./cn/append.c	5.37	5.1	-0.27 (-5.03%)
./cn/reverse.error.c	2.55	2.86	+0.31 (+12.16%)
./cn/map_set.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/mod_return_size.error.c	3.51	2.61	-0.90 (-25.64%)
./cn/simplify_add_0.c	0.65	0.66	+0.01 (+1.54%)
./cn/reverse.c	2.22	2.6	+0.38 (+17.12%)
./cn/fun_addrs_cn_stmt.c	0.24	0.26	+0.02 (+8.33%)
./cn/implies_associativity.c	0.06	0.06	+0.00 (+0.00%)
./cn/gnu_types_compatible.c	0.45	0.45	+0.00 (+0.00%)
./cn/duplicate_datatype_var.error.c	0.02	0.03	+0.01 (+50.00%)
./cn/implies3.error.c	0.03	0.04	+0.01 (+33.33%)
./cn/inconsistent2.c	0.11	0.11	+0.00 (+0.00%)
./cn/enum_and_and.c	0.33	0.37	+0.04 (+12.12%)
./cn/pointer_to_unsigned_int_cast.error.c	0.19	0.19	+0.00 (+0.00%)
./cn/arrow_access.c	0.36	0.39	+0.03 (+8.33%)
./cn/doubling.c	0.37	0.38	+0.01 (+2.70%)
./cn/match.c	0.22	0.23	+0.01 (+4.55%)
./cn/swap.c	0.48	0.47	-0.01 (-2.08%)
./cn/fun_ptr_extern.c	1.64	1.91	+0.27 (+16.46%)
./cn/list_literal_type.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/pointer_to_int_cast.error.c	0.11	0.11	+0.00 (+0.00%)
./cn/ghost_pointer_to_bitvec_cast.c*	0.11	0.28	+0.17 (+154.55%)
./cn/division_casting.c	0.19	0.19	+0.00 (+0.00%)
./cn/simple_loop.c	0.21	0.22	+0.01 (+4.76%)
./cn/magic_comment_not_closed.c	0.06	0.06	+0.00 (+0.00%)
./cn/bad_recursion.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/inconsistent.error.c	0.04	0.03	-0.01 (-25.00%)
./cn/implies.c	0.19	0.2	+0.01 (+5.26%)
./cn/void_star_arg.c	1.16	1.27	+0.11 (+9.48%)
./cn/mod_by_0.error.c	0.2	0.21	+0.01 (+5.00%)
./cn/redundant_pattern.error.c	0.04	0.03	-0.01 (-25.00%)
./cn/ptr_diff2.c	0.24	0.26	+0.02 (+8.33%)
./cn/division.c	0.21	0.22	+0.01 (+4.76%)
./cn/inconsistent.c	0.13	0.13	+0.00 (+0.00%)
./cn/missing_resource_indirect.error.c	0.17	0.18	+0.01 (+5.88%)
./cn/mod_casting.c	0.19	0.2	+0.01 (+5.26%)
./cn/split_case.c	1.21	1.25	+0.04 (+3.31%)
./cn/left_shift_const.c	0.37	0.38	+0.01 (+2.70%)
./cn/disj_nonnull.c	0.33	0.34	+0.01 (+3.03%)
./cn/struct_updates2.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/mergesort.c	10.45	11.07	+0.62 (+5.93%)
./cn/cnfunction_mismatched_args1.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/lexer_hack_parse.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bitwise_and.c	0.14	0.14	+0.00 (+0.00%)
./cn/tree_rev01.c	1.37	1.46	+0.09 (+6.57%)
./cn/division_return_size.error.c	0.44	0.44	+0.00 (+0.00%)
./cn/cnfunction_mismatched_args2.error.c	0.03	0.04	+0.01 (+33.33%)
./cn/tag_defs.c	0.12	0.13	+0.01 (+8.33%)
./cn/bitwise_compl.c	0.14	0.14	+0.00 (+0.00%)
./cn/division_precedence.c	0.4	0.42	+0.02 (+5.00%)
./cn/pointer_to_intptr_t_cast.c	0.17	0.18	+0.01 (+5.88%)
./cn/division_by_0.error.c	0.2	0.21	+0.01 (+5.00%)
./cn/pointer_to_char_cast.c	0.33	0.34	+0.01 (+3.03%)
./cn/builtin_ctz.c	1	1.14	+0.14 (+14.00%)
./cn/gnu_ffs.c	0.32	0.39	+0.07 (+21.88%)
./cn/increments.c	0.59	0.62	+0.03 (+5.08%)
./cn/gnu_ctz.c	0.26	0.27	+0.01 (+3.85%)
./cn/max_min_consts.c	0.15	0.15	+0.00 (+0.00%)
./cn/gnu_case_ranges.c	0.29	0.32	+0.03 (+10.34%)
./cn/builtin_ctz_val.c	0.57	0.57	+0.00 (+0.00%)
./cn/bad_resource_var.error.c	0.23	0.24	+0.01 (+4.35%)
./cn/arith_type.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/use_typedef.c	0.11	0.11	+0.00 (+0.00%)
./cn/fun_ptr_three_opts.c	3.36	3.49	+0.13 (+3.87%)
./cn/unary_negation.c	0.07	0.07	+0.00 (+0.00%)
./cn/mutual_rec/mutual_rec.c	14.99	16.61	+1.62 (+10.81%)
./cn/list_rev01.c	1.53	1.62	+0.09 (+5.88%)
./cn/implies2.error.c	0.18	0.19	+0.01 (+5.56%)
./cn/memcpy.c	1.05	1.08	+0.03 (+2.86%)
./cn/mod_with_constants.c	0.36	0.36	+0.00 (+0.00%)
./cn/cnfunction_mismatched_args3.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/tree16/as_mutual_dt/tree16.c	16.55	12.74	-3.81 (-23.02%)
./cn/tree16/as_partial_map/tree16.c	6.46	6.58	+0.12 (+1.86%)
./cn/tree16/as_auto_mutual_dt/tree16.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/pred_def04.c	0.08	0.09	+0.01 (+12.50%)
./cn/and_or_precedence.error.c	0.27	0.28	+0.01 (+3.70%)
./cn/bad_record.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/assert_on_toplevel.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/ptr_diff.c	0.45	0.52	+0.07 (+15.56%)
./cn/mod_precedence.c	0.41	0.43	+0.02 (+4.88%)
./cn/implies_precedence.c	0.16	0.19	+0.03 (+18.75%)
./cn/unsupported_flexible_array_member.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/pointer_to_uintptr_t_cast.c	0.17	0.18	+0.01 (+5.88%)
./cn/b_or.c	0.14	0.15	+0.01 (+7.14%)
./cn/pred_def03.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/get_from_array.c	0.58	0.66	+0.08 (+13.79%)
./cn/gnu_choose.c	0.3	0.32	+0.02 (+6.67%)
./cn/struct_updates.error.c	0.03	0.04	+0.01 (+33.33%)
./cn/failing_postcond.error.c	0.14	0.15	+0.01 (+7.14%)
./cn/fun_ptr_known.c	1.44	1.51	+0.07 (+4.86%)
./cn/mod_return_sign.error.c	0.05	0.06	+0.01 (+20.00%)
./cn/block_type.c	0.22	0.23	+0.01 (+4.55%)

[github-actions]

Benchmark comparison for 72c2497d (PR) vs a09536a1 (baseline).

Added benchmarks: Total benchmark time

Benchmark comparison

Benchmark name	Baseline time (s)	New time (s)	Difference (s)
./cn/unsupported_union.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/duplicate_pattern_var.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/block_type.c	0.09	0.08	-0.01 (-11.11%)
./cn/gnu_ffs.c	0.11	0.11	+0.00 (+0.00%)
./cn/implies2.error.c	0.08	0.08	+0.00 (+0.00%)
./cn/extract_verbose.c	0.11	0.11	+0.00 (+0.00%)
./cn/builtin_ctz.c	0.37	0.39	+0.02 (+5.41%)
./cn/disj_nonnull.c	0.32	0.32	+0.00 (+0.00%)
./cn/gnu_types_compatible.c	0.11	0.11	+0.00 (+0.00%)
./cn/assert_on_toplevel.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/redundant_pattern.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/tree16/as_auto_mutual_dt/tree16.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/tree16/as_partial_map/tree16.c	2.69	2.65	-0.04 (-1.49%)
./cn/tree16/as_mutual_dt/tree16.c	8.54	8.38	-0.16 (-1.87%)
./cn/inconsistent3.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/inconsistent2.error.c	0.05	0.04	-0.01 (-20.00%)
./cn/fun_ptr_extern.c	0.48	0.46	-0.02 (-4.17%)
./cn/increments.c	0.19	0.18	-0.01 (-5.26%)
./cn/has_alloc_id_shift.c	0.16	0.14	-0.02 (-12.50%)
./cn/mod_return_sign.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/has_alloc_id_ptr_neq.c	0.15	0.15	+0.00 (+0.00%)
./cn/fun_ptr_three_opts.c	0.81	0.8	-0.01 (-1.23%)
./cn/spec_null_shift.c	0.06	0.06	+0.00 (+0.00%)
./cn/struct_updates.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/has_alloc_id_ptr_eq.error.c	0.1	0.1	+0.00 (+0.00%)
./cn/bad_record.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bad_record2.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/ptr_diff2.error.c	0.09	0.09	+0.00 (+0.00%)
./cn/ptr_diff.error.c	0.2	0.2	+0.00 (+0.00%)
./cn/bitwise_compl.c	0.07	0.07	+0.00 (+0.00%)
./cn/alloc_token.c	0.06	0.06	+0.00 (+0.00%)
./cn/pointer_to_char_cast.error.c	0.14	0.14	+0.00 (+0.00%)
./cn/implies_precedence.c	0.07	0.06	-0.01 (-14.29%)
./cn/list_literal_type.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/division_casting.c	0.08	0.08	+0.00 (+0.00%)
./cn/unary_negation.c	0.05	0.05	+0.00 (+0.00%)
./cn/reverse.c	0.58	0.58	+0.00 (+0.00%)
./cn/bitwise_compl_type.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/mask_ptr.c	0.16	0.17	+0.01 (+6.25%)
./cn/and_or_precedence.error.c	0.11	0.1	-0.01 (-9.09%)
./cn/division_return_sign.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/get_from_arr.c	0.11	0.11	+0.00 (+0.00%)
./cn/division_precedence.c	0.1	0.11	+0.01 (+10.00%)
./cn/match.c	0.08	0.08	+0.00 (+0.00%)
./cn/max_pipes.error.c	23.08	23.42	+0.34 (+1.47%)
./cn/pred_def03.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/cnfunction_mismatched_args3.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/bad_function_call.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/pred_def02.c	0.05	0.05	+0.00 (+0.00%)
./cn/max_min_consts.c	0.07	0.07	+0.00 (+0.00%)
./cn/enum_and_and.c	0.1	0.11	+0.01 (+10.00%)
./cn/gnu_case_ranges.c	0.09	0.09	+0.00 (+0.00%)
./cn/merging_arrays.error.c	0.17	0.16	-0.01 (-5.88%)
./cn/gnu_choose.c	0.09	0.09	+0.00 (+0.00%)
./cn/simplify_array_shift.c	0.34	0.33	-0.01 (-2.94%)
./cn/bad_recursion.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/split_case.c	0.34	0.33	-0.01 (-2.94%)
./cn/mod.c	0.09	0.09	+0.00 (+0.00%)
./cn/mod_by_0.error.c	0.1	0.09	-0.01 (-10.00%)
./cn/has_alloc_id_ptr_eq2.error.c	0.1	0.1	+0.00 (+0.00%)
./cn/implies3.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/arith_type.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/failing_postcond.error.c	0.08	0.08	+0.00 (+0.00%)
./cn/cnfunction_mismatched_args4.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/simplify_add_0.c	0.16	0.15	-0.01 (-6.25%)
./cn/tree_rev01.c	0.33	0.34	+0.01 (+3.03%)
./cn/b_or.c	0.07	0.07	+0.00 (+0.00%)
./cn/spec_after_curly_brace.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/simple_loop.c	0.07	0.07	+0.00 (+0.00%)
./cn/previously_inconsistent_assumptions1.c	0.05	0.05	+0.00 (+0.00%)
./cn/multifile/f.c	0.45	0.45	+0.00 (+0.00%)
./cn/multifile/g.c	0.32	0.32	+0.00 (+0.00%)
./cn/has_alloc_id_ptr_neq.error.c	0.11	0.1	-0.01 (-9.09%)
./cn/swap_pair.c	0.17	0.16	-0.01 (-5.88%)
./cn/missing_resource_indirect.error.c	0.08	0.08	+0.00 (+0.00%)
./cn/inconsistent.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/ghost_pointer_to_bitvec_cast.c	0.08	0.08	+0.00 (+0.00%)
./cn/pred_def04.c	0.05	0.05	+0.00 (+0.00%)
./cn/division_return_size.error.c	0.35	0.34	-0.01 (-2.86%)
./cn/list_rev01.c	0.35	0.35	+0.00 (+0.00%)
./cn/bitwise_and_type_left.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/append.c	1.7	1.75	+0.05 (+2.94%)
./cn/mod_with_constants.c	0.1	0.1	+0.00 (+0.00%)
./cn/pred_def01.c	0.05	0.05	+0.00 (+0.00%)
./cn/use_typedef.c	0.05	0.05	+0.00 (+0.00%)
./cn/alloc_create.c	0.08	0.07	-0.01 (-12.50%)
./cn/use_enum.c	0.05	0.05	+0.00 (+0.00%)
./cn/cnfunction_mismatched_args2.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/swap.c	0.16	0.15	-0.01 (-6.25%)
./cn/missing_resource.error.c	0.07	0.07	+0.00 (+0.00%)
./cn/bad_col.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/mergesort.c	3.12	3.06	-0.06 (-1.92%)
./cn/cnfunction_mismatched_args1.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/pointer_to_uintptr_t_cast.c	0.06	0.06	+0.00 (+0.00%)
./cn/has_alloc_id.c	0.1	0.09	-0.01 (-10.00%)
./cn/pointer_to_int_cast.error.c	0.06	0.06	+0.00 (+0.00%)
./cn/pointer_to_char_cast.c	0.1	0.1	+0.00 (+0.00%)
./cn/left_shift_const.c	0.1	0.1	+0.00 (+0.00%)
./cn/shift_diff_sz.c	0.08	0.08	+0.00 (+0.00%)
./cn/get_from_array.c	0.39	0.4	+0.01 (+2.56%)
./cn/memcpy.c	0.39	0.38	-0.01 (-2.56%)
./cn/void_star_arg.c	0.25	0.25	+0.00 (+0.00%)
./cn/previously_inconsistent_assumptions2.c	0.06	0.06	+0.00 (+0.00%)
./cn/pointer_to_unsigned_int_cast.error.c	0.07	0.07	+0.00 (+0.00%)
./cn/tag_defs.c	0.06	0.06	+0.00 (+0.00%)
./cn/bitwise_and.c	0.07	0.07	+0.00 (+0.00%)
./cn/duplicate_datatype_var.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/bad_constructor_user.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/bitwise_compl_precedence.c	0.05	0.05	+0.00 (+0.00%)
./cn/forloop_with_decl.c	0.12	0.12	+0.00 (+0.00%)
./cn/incomplete_match.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/has_alloc_id.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/cn_inline.c	0.18	0.17	-0.01 (-5.56%)
./cn/mod_return_size.error.c	2.27	2.28	+0.01 (+0.44%)
./cn/spec_null_shift.error.c	0.08	0.07	-0.01 (-12.50%)
./cn/map_set.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/implies.c	0.07	0.07	+0.00 (+0.00%)
./cn/unsupported_flexible_array_member.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/reverse.error.c	0.79	0.82	+0.03 (+3.80%)
./cn/unary_negation.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/copy_alloc_id.c	0.12	0.11	-0.01 (-8.33%)
./cn/failing_precond.error.c	0.03	0.03	+0.00 (+0.00%)
./cn/mod_casting.c	0.08	0.08	+0.00 (+0.00%)
./cn/type_synonym.c	0.06	0.06	+0.00 (+0.00%)
./cn/division_by_0.error.c	0.1	0.1	+0.00 (+0.00%)
./cn/magic_comment_not_closed.c	0.05	0.05	+0.00 (+0.00%)
./cn/struct_updates2.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/fun_addrs_cn_stmt.c	0.09	0.09	+0.00 (+0.00%)
./cn/lexer_hack_parse.error.c	0.02	0.02	+0.00 (+0.00%)
./cn/doubling.c	0.1	0.1	+0.00 (+0.00%)
./cn/copy_alloc_id.error.c	0.14	0.14	+0.00 (+0.00%)
./cn/gnu_ctz.c	0.07	0.07	+0.00 (+0.00%)
./cn/pointer_to_intptr_t_cast.c	0.06	0.07	+0.01 (+16.67%)
./cn/division_with_constants.c	0.1	0.1	+0.00 (+0.00%)
./cn/builtin_ctz_val.c	0.13	0.14	+0.01 (+7.69%)
./cn/ptr_diff.c	0.7	0.68	-0.02 (-2.86%)
./cn/ptr_diff2.c	0.08	0.08	+0.00 (+0.00%)
./cn/b_xor.c	0.07	0.07	+0.00 (+0.00%)
./cn/unconstrained_ptr_eq.error.c	0.09	0.09	+0.00 (+0.00%)
./cn/arrow_access.c	0.16	0.16	+0.00 (+0.00%)
./cn/ownership_at_negative_index.c	0.07	0.07	+0.00 (+0.00%)
./cn/division.c	0.08	0.08	+0.00 (+0.00%)
./cn/fun_ptr_known.c	0.34	0.35	+0.01 (+2.94%)
./cn/implies_associativity.c	0.05	0.05	+0.00 (+0.00%)
./cn/mod_precedence.c	0.12	0.11	-0.01 (-8.33%)
./cn/mutual_rec/mutual_rec.c	3.65	3.9	+0.25 (+6.85%)
./cn/bitwise_and_type_right.error.c	0.04	0.04	+0.00 (+0.00%)
./cn/unconstrained_ptr_eq2.error.c	0.09	0.1	+0.01 (+11.11%)
./cn/bad_resource_var.error.c	0.12	0.11	-0.01 (-8.33%)
Total benchmark time	-	62.35	-
Total runtime	62.11000000000005	124.7	+62.59 (+100.77%)