Skip to content

Latest commit

 

History

History
195 lines (174 loc) · 22.7 KB

bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203-vs-3.10.4.md

File metadata and controls

195 lines (174 loc) · 22.7 KB

Results vs. 3.10.4

  • fork: python
  • ref: 7907203bc07387ff2d8e
  • machine: linux-x86_64
  • commit hash: 7907203
  • commit date: 2025-01-24
  • overall geometric mean: 1.433x faster
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.29x faster
  • Memory change: 1.70x

Benchmarks with tag 'apps':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203
2to3 348 ms 261 ms: 1.34x faster
docutils 3.30 sec 2.68 sec: 1.23x faster
html5lib 88.9 ms 62.4 ms: 1.43x faster
Geometric mean (ref) 1.33x faster

Benchmarks with tag 'asyncio':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203
async_tree_io 1.77 sec 614 ms: 2.88x faster
async_tree_none 728 ms 276 ms: 2.64x faster
async_tree_memoization 870 ms 341 ms: 2.55x faster
async_tree_cpu_io_mixed 1.02 sec 503 ms: 2.02x faster
Geometric mean (ref) 2.50x faster

Benchmarks with tag 'math':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203
float 117 ms 63.6 ms: 1.84x faster
nbody 154 ms 85.3 ms: 1.80x faster
pidigits 191 ms 188 ms: 1.02x faster
Geometric mean (ref) 1.50x faster

Benchmarks with tag 'regex':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203
regex_compile 188 ms 128 ms: 1.47x faster
regex_effbot 3.63 ms 2.93 ms: 1.24x faster
regex_dna 227 ms 197 ms: 1.15x faster
regex_v8 27.8 ms 24.1 ms: 1.15x faster
Geometric mean (ref) 1.25x faster

Benchmarks with tag 'serialize':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203
unpickle_pure_python 331 us 194 us: 1.70x faster
tomli_loads 3.14 sec 1.84 sec: 1.70x faster
pickle_pure_python 484 us 312 us: 1.55x faster
xml_etree_process 79.1 ms 55.0 ms: 1.44x faster
json_dumps 14.2 ms 11.1 ms: 1.28x faster
xml_etree_iterparse 115 ms 94.8 ms: 1.22x faster
xml_etree_generate 99.4 ms 81.7 ms: 1.22x faster
xml_etree_parse 168 ms 139 ms: 1.21x faster
json_loads 31.2 us 35.4 us: 1.13x slower
Geometric mean (ref) 1.33x faster

Benchmarks with tag 'startup':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203
python_startup 14.6 ms 12.8 ms: 1.14x faster
python_startup_no_site 5.93 ms 7.08 ms: 1.19x slower
Geometric mean (ref) 1.02x slower

Benchmarks with tag 'template':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203
mako 16.3 ms 9.88 ms: 1.65x faster
django_template 48.2 ms 34.3 ms: 1.40x faster
genshi_text 31.8 ms 23.8 ms: 1.34x faster
genshi_xml 66.0 ms 58.6 ms: 1.13x faster
Geometric mean (ref) 1.37x faster

All benchmarks:

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203
typing_runtime_protocols 544 us 168 us: 3.24x faster
async_tree_io 1.77 sec 614 ms: 2.88x faster
async_tree_none 728 ms 276 ms: 2.64x faster
async_tree_memoization 870 ms 341 ms: 2.55x faster
deltablue 7.91 ms 3.23 ms: 2.45x faster
generators 80.1 ms 37.0 ms: 2.17x faster
async_tree_cpu_io_mixed 1.02 sec 503 ms: 2.02x faster
chaos 115 ms 58.3 ms: 1.98x faster
richards_super 94.7 ms 48.0 ms: 1.97x faster
scimark_sor 220 ms 113 ms: 1.95x faster
deepcopy_memo 58.5 us 30.3 us: 1.93x faster
pylint 551 ms 288 ms: 1.91x faster
crypto_pyaes 128 ms 67.5 ms: 1.89x faster
scimark_monte_carlo 118 ms 62.7 ms: 1.89x faster
float 117 ms 63.6 ms: 1.84x faster
nbody 154 ms 85.3 ms: 1.80x faster
go 240 ms 134 ms: 1.80x faster
raytrace 507 ms 283 ms: 1.79x faster
richards 79.3 ms 44.6 ms: 1.78x faster
spectral_norm 170 ms 97.1 ms: 1.75x faster
logging_silent 190 ns 109 ns: 1.74x faster
deepcopy 479 us 278 us: 1.73x faster
sqlglot_parse 2.17 ms 1.27 ms: 1.71x faster
unpickle_pure_python 331 us 194 us: 1.70x faster
tomli_loads 3.14 sec 1.84 sec: 1.70x faster
comprehensions 28.8 us 17.3 us: 1.66x faster
mako 16.3 ms 9.88 ms: 1.65x faster
pyflate 716 ms 436 ms: 1.64x faster
sqlglot_transpile 2.57 ms 1.59 ms: 1.62x faster
pickle_pure_python 484 us 312 us: 1.55x faster
deepcopy_reduce 4.17 us 2.71 us: 1.54x faster
scimark_lu 176 ms 115 ms: 1.54x faster
coroutines 35.1 ms 23.3 ms: 1.51x faster
scimark_fft 466 ms 312 ms: 1.50x faster
regex_compile 188 ms 128 ms: 1.47x faster
hexiom 10.4 ms 7.14 ms: 1.46x faster
logging_format 9.09 us 6.28 us: 1.45x faster
logging_simple 8.30 us 5.76 us: 1.44x faster
xml_etree_process 79.1 ms 55.0 ms: 1.44x faster
scimark_sparse_mat_mult 6.47 ms 4.52 ms: 1.43x faster
html5lib 88.9 ms 62.4 ms: 1.43x faster
django_template 48.2 ms 34.3 ms: 1.40x faster
thrift 1.07 ms 766 us: 1.40x faster
pprint_safe_repr 1.02 sec 730 ms: 1.40x faster
pprint_pformat 2.10 sec 1.51 sec: 1.39x faster
sqlalchemy_imperative 23.3 ms 16.8 ms: 1.39x faster
fannkuch 532 ms 386 ms: 1.38x faster
genshi_text 31.8 ms 23.8 ms: 1.34x faster
2to3 348 ms 261 ms: 1.34x faster
pycparser 1.58 sec 1.19 sec: 1.32x faster
sqlalchemy_declarative 172 ms 132 ms: 1.31x faster
sqlglot_normalize 143 ms 110 ms: 1.30x faster
json_dumps 14.2 ms 11.1 ms: 1.28x faster
dulwich_log 84.3 ms 66.4 ms: 1.27x faster
sympy_sum 196 ms 155 ms: 1.27x faster
pathlib 20.5 ms 16.3 ms: 1.26x faster
sqlglot_optimize 69.2 ms 55.1 ms: 1.26x faster
sympy_integrate 25.8 ms 20.6 ms: 1.25x faster
regex_effbot 3.63 ms 2.93 ms: 1.24x faster
docutils 3.30 sec 2.68 sec: 1.23x faster
sympy_str 346 ms 283 ms: 1.22x faster
xml_etree_iterparse 115 ms 94.8 ms: 1.22x faster
xml_etree_generate 99.4 ms 81.7 ms: 1.22x faster
xml_etree_parse 168 ms 139 ms: 1.21x faster
nqueens 106 ms 88.5 ms: 1.20x faster
sympy_expand 566 ms 479 ms: 1.18x faster
regex_dna 227 ms 197 ms: 1.15x faster
regex_v8 27.8 ms 24.1 ms: 1.15x faster
python_startup 14.6 ms 12.8 ms: 1.14x faster
genshi_xml 66.0 ms 58.6 ms: 1.13x faster
sqlite_synth 3.02 us 2.70 us: 1.12x faster
mdp 2.85 sec 2.57 sec: 1.11x faster
bench_thread_pool 986 us 895 us: 1.10x faster
meteor_contest 120 ms 109 ms: 1.10x faster
async_generators 444 ms 406 ms: 1.09x faster
pidigits 191 ms 188 ms: 1.02x faster
asyncio_websockets 559 ms 551 ms: 1.01x faster
telco 7.27 ms 7.59 ms: 1.04x slower
json 5.69 ms 5.98 ms: 1.05x slower
json_loads 31.2 us 35.4 us: 1.13x slower
coverage 79.4 ms 90.3 ms: 1.14x slower
python_startup_no_site 5.93 ms 7.08 ms: 1.19x slower
gc_traversal 3.62 ms 4.98 ms: 1.37x slower
create_gc_cycles 1.62 ms 2.46 ms: 1.52x slower
bench_mp_pool 24.0 ms 81.1 ms: 3.38x slower
Geometric mean (ref) 1.41x faster
Ignored benchmarks (16) of results/bm-20220323-3.10.4-9d38120/bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, djangocms, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (11) of results/bm-20250124-3.14.0a4+-7907203-JIT/bm-20250124-linux-x86_64-python-7907203bc07387ff2d8e-3.14.0a4+-7907203.json: async_tree_cpu_io_mixed_tg, async_tree_io_tg, async_tree_memoization_tg, async_tree_none_tg, bpe_tokeniser, connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers
  • Geometric mean (including insignificant results): 1.433x faster

HPT report

  • Reliability score: 100.00% likely to be faster
  • 90% likely to have a speedup of 1.33x
  • 95% likely to have a speedup of 1.31x
  • 99% likely to have a speedup of 1.29x

Memory

  • memory change: 1.70x