fork: python
ref: 3829104ab412a47bf3f3
machine: linux-aarch64
commit hash: 3829104
commit date: 2025-01-17
overall geometric mean: 1.135x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.09x slower
Memory change: 1.23x
Benchmarks with tag 'apps':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104
2to3
313 ms
392 ms: 1.25x slower
docutils
2.96 sec
3.43 sec: 1.16x slower
html5lib
65.6 ms
81.1 ms: 1.24x slower
sphinx
1.20 sec
1.41 sec: 1.17x slower
Geometric mean
(ref)
1.20x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104
async_tree_memoization_tg
663 ms
489 ms: 1.36x faster
async_tree_io_tg
1.16 sec
911 ms: 1.28x faster
async_tree_none_tg
484 ms
389 ms: 1.24x faster
async_tree_memoization
664 ms
536 ms: 1.24x faster
async_tree_io
1.14 sec
952 ms: 1.20x faster
async_tree_cpu_io_mixed_tg
801 ms
673 ms: 1.19x faster
async_tree_none
504 ms
434 ms: 1.16x faster
async_tree_cpu_io_mixed
789 ms
712 ms: 1.11x faster
async_generators
500 ms
539 ms: 1.08x slower
coroutines
29.4 ms
33.2 ms: 1.13x slower
Geometric mean
(ref)
1.13x faster
Benchmark hidden because not significant (1): asyncio_websockets
Benchmarks with tag 'math':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104
float
95.8 ms
104 ms: 1.08x slower
nbody
118 ms
182 ms: 1.54x slower
Geometric mean
(ref)
1.20x slower
Benchmark hidden because not significant (1): pidigits
Benchmarks with tag 'regex':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104
regex_effbot
5.10 ms
4.16 ms: 1.23x faster
regex_compile
134 ms
165 ms: 1.23x slower
Geometric mean
(ref)
1.00x slower
Benchmark hidden because not significant (2): regex_v8, regex_dna
Benchmarks with tag 'serialize':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104
xml_etree_iterparse
159 ms
130 ms: 1.22x faster
xml_etree_parse
203 ms
183 ms: 1.11x faster
json_loads
32.8 us
37.7 us: 1.15x slower
unpickle_pure_python
265 us
311 us: 1.18x slower
tomli_loads
2.67 sec
3.24 sec: 1.21x slower
json_dumps
14.2 ms
17.2 ms: 1.21x slower
xml_etree_generate
118 ms
146 ms: 1.24x slower
xml_etree_process
82.1 ms
102 ms: 1.24x slower
pickle_pure_python
374 us
489 us: 1.31x slower
Geometric mean
(ref)
1.13x slower
Benchmarks with tag 'startup':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104
python_startup
16.0 ms
20.0 ms: 1.24x slower
python_startup_no_site
8.79 ms
12.2 ms: 1.39x slower
Geometric mean
(ref)
1.31x slower
Benchmarks with tag 'template':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104
genshi_xml
61.6 ms
78.0 ms: 1.27x slower
genshi_text
28.6 ms
38.0 ms: 1.33x slower
django_template
39.4 ms
59.9 ms: 1.52x slower
mako
14.0 ms
23.3 ms: 1.67x slower
Geometric mean
(ref)
1.44x slower
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104
create_gc_cycles
3.39 ms
2.16 ms: 1.57x faster
async_tree_memoization_tg
663 ms
489 ms: 1.36x faster
async_tree_io_tg
1.16 sec
911 ms: 1.28x faster
async_tree_none_tg
484 ms
389 ms: 1.24x faster
async_tree_memoization
664 ms
536 ms: 1.24x faster
regex_effbot
5.10 ms
4.16 ms: 1.23x faster
xml_etree_iterparse
159 ms
130 ms: 1.22x faster
async_tree_io
1.14 sec
952 ms: 1.20x faster
async_tree_cpu_io_mixed_tg
801 ms
673 ms: 1.19x faster
async_tree_none
504 ms
434 ms: 1.16x faster
async_tree_cpu_io_mixed
789 ms
712 ms: 1.11x faster
xml_etree_parse
203 ms
183 ms: 1.11x faster
gc_traversal
5.92 ms
5.36 ms: 1.10x faster
sqlite_synth
4.08 us
3.82 us: 1.07x faster
pycparser
1.34 sec
1.43 sec: 1.07x slower
json
5.94 ms
6.35 ms: 1.07x slower
generators
40.3 ms
43.3 ms: 1.08x slower
async_generators
500 ms
539 ms: 1.08x slower
scimark_fft
463 ms
498 ms: 1.08x slower
k_core
2.99 sec
3.22 sec: 1.08x slower
float
95.8 ms
104 ms: 1.08x slower
go
164 ms
181 ms: 1.10x slower
mdp
3.45 sec
3.84 sec: 1.11x slower
scimark_sor
164 ms
183 ms: 1.12x slower
deepcopy_reduce
4.24 us
4.74 us: 1.12x slower
coroutines
29.4 ms
33.2 ms: 1.13x slower
pylint
345 ms
391 ms: 1.13x slower
telco
10.5 ms
11.9 ms: 1.14x slower
pyflate
582 ms
666 ms: 1.14x slower
json_loads
32.8 us
37.7 us: 1.15x slower
docutils
2.96 sec
3.43 sec: 1.16x slower
sphinx
1.20 sec
1.41 sec: 1.17x slower
unpickle_pure_python
265 us
311 us: 1.18x slower
sqlglot_optimize
65.2 ms
77.1 ms: 1.18x slower
sqlglot_normalize
131 ms
157 ms: 1.20x slower
logging_silent
135 ns
161 ns: 1.20x slower
tomli_loads
2.67 sec
3.24 sec: 1.21x slower
json_dumps
14.2 ms
17.2 ms: 1.21x slower
scimark_sparse_mat_mult
6.66 ms
8.11 ms: 1.22x slower
shortest_path
565 ms
689 ms: 1.22x slower
pprint_safe_repr
962 ms
1.17 sec: 1.22x slower
bpe_tokeniser
6.02 sec
7.35 sec: 1.22x slower
pprint_pformat
1.99 sec
2.43 sec: 1.23x slower
regex_compile
134 ms
165 ms: 1.23x slower
html5lib
65.6 ms
81.1 ms: 1.24x slower
xml_etree_generate
118 ms
146 ms: 1.24x slower
xml_etree_process
82.1 ms
102 ms: 1.24x slower
python_startup
16.0 ms
20.0 ms: 1.24x slower
logging_simple
7.25 us
9.07 us: 1.25x slower
2to3
313 ms
392 ms: 1.25x slower
thrift
1.01 ms
1.27 ms: 1.26x slower
nqueens
105 ms
132 ms: 1.26x slower
connected_components
547 ms
691 ms: 1.26x slower
coverage
106 ms
133 ms: 1.26x slower
sympy_sum
151 ms
191 ms: 1.27x slower
genshi_xml
61.6 ms
78.0 ms: 1.27x slower
scimark_lu
146 ms
187 ms: 1.28x slower
chaos
70.7 ms
90.7 ms: 1.28x slower
logging_format
8.10 us
10.4 us: 1.28x slower
hexiom
7.34 ms
9.46 ms: 1.29x slower
sympy_expand
472 ms
613 ms: 1.30x slower
pickle_pure_python
374 us
489 us: 1.31x slower
meteor_contest
117 ms
154 ms: 1.31x slower
sympy_integrate
21.4 ms
28.3 ms: 1.32x slower
scimark_monte_carlo
87.8 ms
116 ms: 1.33x slower
sqlglot_transpile
1.84 ms
2.44 ms: 1.33x slower
genshi_text
28.6 ms
38.0 ms: 1.33x slower
sqlalchemy_declarative
154 ms
209 ms: 1.36x slower
crypto_pyaes
84.9 ms
116 ms: 1.37x slower
sqlalchemy_imperative
16.1 ms
22.3 ms: 1.38x slower
python_startup_no_site
8.79 ms
12.2 ms: 1.39x slower
sympy_str
265 ms
368 ms: 1.39x slower
raytrace
310 ms
431 ms: 1.39x slower
fannkuch
478 ms
673 ms: 1.41x slower
richards_super
60.8 ms
85.7 ms: 1.41x slower
bench_thread_pool
1.34 ms
1.89 ms: 1.42x slower
many_optionals
626 us
891 us: 1.42x slower
comprehensions
20.8 us
29.6 us: 1.42x slower
typing_runtime_protocols
197 us
281 us: 1.42x slower
sqlglot_parse
1.43 ms
2.04 ms: 1.42x slower
richards
54.5 ms
78.7 ms: 1.44x slower
django_template
39.4 ms
59.9 ms: 1.52x slower
nbody
118 ms
182 ms: 1.54x slower
deltablue
3.97 ms
6.34 ms: 1.60x slower
subparsers
20.3 ms
32.8 ms: 1.61x slower
mako
14.0 ms
23.3 ms: 1.67x slower
bench_mp_pool
8.07 ms
57.3 ms: 7.10x slower
Geometric mean
(ref)
1.18x slower
Benchmark hidden because not significant (8): deepcopy, pathlib, spectral_norm, deepcopy_memo, regex_v8, regex_dna, asyncio_websockets, pidigits
Ignored benchmarks (5) of results/bm-20241007-3.13.0-60403a5/bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5.json: chameleon, djangocms, gevent_hub, gunicorn, tornado_http
Ignored benchmarks (1) of results/bm-20250117-3.14.0a4+-3829104-NOGIL/bm-20250117-arminc-aarch64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104.json: dulwich_log
Geometric mean (including insignificant results): 1.135x slower
Reliability score: 100.00% likely to be slow
90% likely to have a slowdown of 1.13x
95% likely to have a slowdown of 1.13x
99% likely to have a slowdown of 1.09x