Skip to content

Latest commit

 

History

History
195 lines (174 loc) · 24.5 KB

bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226-vs-3.12.0.md

File metadata and controls

195 lines (174 loc) · 24.5 KB

Results vs. 3.12.0

  • fork: python
  • ref: f18b2264929c56360c86
  • machine: linux-x86_64
  • commit hash: f18b226
  • commit date: 2025-01-21
  • overall geometric mean: 1.073x slower
  • HPT reliability: 99.96%
  • HPT 99th percentile: 1.04x slower
  • Memory change: 1.26x

Benchmarks with tag 'apps':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226
2to3 285 ms 338 ms: 1.19x slower
docutils 2.87 sec 2.97 sec: 1.03x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226
async_tree_io_tg 1.05 sec 575 ms: 1.83x faster
async_tree_none_tg 431 ms 250 ms: 1.73x faster
async_tree_io 1.04 sec 609 ms: 1.71x faster
async_tree_memoization_tg 540 ms 322 ms: 1.68x faster
async_tree_none 452 ms 289 ms: 1.56x faster
async_tree_memoization 544 ms 357 ms: 1.52x faster
async_tree_cpu_io_mixed_tg 697 ms 487 ms: 1.43x faster
async_tree_cpu_io_mixed 696 ms 525 ms: 1.33x faster
Geometric mean (ref) 1.59x faster

Benchmarks with tag 'math':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226
pidigits 265 ms 249 ms: 1.06x faster
float 76.6 ms 74.4 ms: 1.03x faster
nbody 88.0 ms 132 ms: 1.50x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'regex':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226
regex_effbot 3.57 ms 3.19 ms: 1.12x faster
regex_dna 239 ms 240 ms: 1.01x slower
regex_v8 23.6 ms 25.5 ms: 1.08x slower
regex_compile 144 ms 156 ms: 1.08x slower
Geometric mean (ref) 1.01x slower

Benchmarks with tag 'serialize':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226
xml_etree_iterparse 103 ms 88.9 ms: 1.16x faster
xml_etree_parse 144 ms 136 ms: 1.06x faster
tomli_loads 2.16 sec 2.42 sec: 1.12x slower
xml_etree_generate 86.1 ms 98.3 ms: 1.14x slower
json_loads 24.4 us 28.2 us: 1.16x slower
unpickle_pure_python 210 us 251 us: 1.20x slower
pickle_pure_python 318 us 390 us: 1.23x slower
xml_etree_process 58.4 ms 74.2 ms: 1.27x slower
json_dumps 10.2 ms 13.5 ms: 1.32x slower
Geometric mean (ref) 1.13x slower

Benchmarks with tag 'startup':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226
python_startup_no_site 8.64 ms 11.7 ms: 1.36x slower
python_startup 11.6 ms 18.6 ms: 1.60x slower
Geometric mean (ref) 1.48x slower

Benchmarks with tag 'template':

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226
django_template 38.2 ms 46.3 ms: 1.21x slower
mako 10.0 ms 18.0 ms: 1.80x slower
Geometric mean (ref) 1.48x slower

All benchmarks:

Benchmark bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226
async_tree_io_tg 1.05 sec 575 ms: 1.83x faster
async_tree_none_tg 431 ms 250 ms: 1.73x faster
async_tree_io 1.04 sec 609 ms: 1.71x faster
async_tree_memoization_tg 540 ms 322 ms: 1.68x faster
async_tree_none 452 ms 289 ms: 1.56x faster
async_tree_memoization 544 ms 357 ms: 1.52x faster
async_tree_cpu_io_mixed_tg 697 ms 487 ms: 1.43x faster
async_tree_cpu_io_mixed 696 ms 525 ms: 1.33x faster
generators 37.4 ms 31.6 ms: 1.18x faster
pathlib 18.9 ms 16.1 ms: 1.17x faster
xml_etree_iterparse 103 ms 88.9 ms: 1.16x faster
regex_effbot 3.57 ms 3.19 ms: 1.12x faster
deepcopy 368 us 337 us: 1.09x faster
sqlite_synth 2.77 us 2.57 us: 1.08x faster
pidigits 265 ms 249 ms: 1.06x faster
xml_etree_parse 144 ms 136 ms: 1.06x faster
coroutines 23.0 ms 22.0 ms: 1.04x faster
float 76.6 ms 74.4 ms: 1.03x faster
comprehensions 21.9 us 21.3 us: 1.03x faster
asyncio_websockets 387 ms 379 ms: 1.02x faster
go 150 ms 147 ms: 1.02x faster
regex_dna 239 ms 240 ms: 1.01x slower
deepcopy_memo 36.8 us 38.0 us: 1.03x slower
docutils 2.87 sec 2.97 sec: 1.03x slower
pycparser 1.23 sec 1.32 sec: 1.07x slower
deepcopy_reduce 3.37 us 3.59 us: 1.07x slower
dulwich_log 65.4 ms 69.8 ms: 1.07x slower
logging_silent 94.4 ns 101 ns: 1.07x slower
regex_v8 23.6 ms 25.5 ms: 1.08x slower
regex_compile 144 ms 156 ms: 1.08x slower
mdp 2.57 sec 2.78 sec: 1.08x slower
json 5.12 ms 5.57 ms: 1.09x slower
sympy_sum 162 ms 176 ms: 1.09x slower
logging_simple 6.71 us 7.32 us: 1.09x slower
scimark_sor 109 ms 119 ms: 1.09x slower
logging_format 7.48 us 8.21 us: 1.10x slower
sqlalchemy_declarative 159 ms 176 ms: 1.11x slower
chaos 64.0 ms 70.8 ms: 1.11x slower
spectral_norm 91.6 ms 102 ms: 1.11x slower
pyflate 439 ms 490 ms: 1.12x slower
sqlalchemy_imperative 18.7 ms 21.0 ms: 1.12x slower
tomli_loads 2.16 sec 2.42 sec: 1.12x slower
sympy_str 302 ms 340 ms: 1.12x slower
pprint_safe_repr 807 ms 911 ms: 1.13x slower
sqlglot_normalize 116 ms 131 ms: 1.13x slower
scimark_fft 301 ms 341 ms: 1.13x slower
sympy_integrate 23.9 ms 27.1 ms: 1.13x slower
pprint_pformat 1.65 sec 1.88 sec: 1.14x slower
xml_etree_generate 86.1 ms 98.3 ms: 1.14x slower
raytrace 298 ms 340 ms: 1.14x slower
sqlglot_optimize 57.5 ms 66.2 ms: 1.15x slower
crypto_pyaes 80.3 ms 92.7 ms: 1.15x slower
json_loads 24.4 us 28.2 us: 1.16x slower
sqlglot_parse 1.38 ms 1.61 ms: 1.17x slower
sqlglot_transpile 1.78 ms 2.08 ms: 1.17x slower
sympy_expand 484 ms 569 ms: 1.18x slower
2to3 285 ms 338 ms: 1.19x slower
async_generators 390 ms 467 ms: 1.20x slower
unpickle_pure_python 210 us 251 us: 1.20x slower
scimark_lu 98.8 ms 119 ms: 1.21x slower
meteor_contest 128 ms 155 ms: 1.21x slower
django_template 38.2 ms 46.3 ms: 1.21x slower
hexiom 5.96 ms 7.25 ms: 1.22x slower
pickle_pure_python 318 us 390 us: 1.23x slower
scimark_monte_carlo 69.0 ms 85.2 ms: 1.23x slower
nqueens 89.9 ms 113 ms: 1.26x slower
richards 45.7 ms 58.0 ms: 1.27x slower
xml_etree_process 58.4 ms 74.2 ms: 1.27x slower
create_gc_cycles 1.59 ms 2.03 ms: 1.28x slower
richards_super 51.3 ms 66.7 ms: 1.30x slower
telco 6.96 ms 9.15 ms: 1.31x slower
json_dumps 10.2 ms 13.5 ms: 1.32x slower
scimark_sparse_mat_mult 4.21 ms 5.62 ms: 1.34x slower
python_startup_no_site 8.64 ms 11.7 ms: 1.36x slower
fannkuch 350 ms 482 ms: 1.38x slower
deltablue 3.24 ms 4.50 ms: 1.39x slower
gc_traversal 3.48 ms 5.00 ms: 1.44x slower
nbody 88.0 ms 132 ms: 1.50x slower
coverage 66.7 ms 101 ms: 1.52x slower
typing_runtime_protocols 152 us 231 us: 1.52x slower
bench_thread_pool 950 us 1.46 ms: 1.54x slower
python_startup 11.6 ms 18.6 ms: 1.60x slower
mako 10.0 ms 18.0 ms: 1.80x slower
bench_mp_pool 4.76 ms 49.1 ms: 10.30x slower
Geometric mean (ref) 1.11x slower
Ignored benchmarks (14) of results/bm-20231002-3.12.0-0fb18b0/bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (12) of results/bm-20250121-3.14.0a4+-f18b226-NOGIL/bm-20250121-pythonperf2-x86_64-python-f18b2264929c56360c86-3.14.0a4+-f18b226.json: bpe_tokeniser, connected_components, genshi_text, genshi_xml, html5lib, k_core, many_optionals, pylint, shortest_path, sphinx, subparsers, thrift
  • Geometric mean (including insignificant results): 1.073x slower

HPT report

  • Reliability score: 99.96% likely to be slow
  • 90% likely to have a slowdown of 1.08x
  • 95% likely to have a slowdown of 1.08x
  • 99% likely to have a slowdown of 1.04x

Memory

  • memory change: 1.26x