- fork: python
- ref: 3829104ab412a47bf3f3
- machine: linux-x86_64
- commit hash: 3829104
- commit date: 2025-01-17
- overall geometric mean: 1.075x slower
- HPT reliability: 99.98%
- HPT 99th percentile: 1.05x slower
- Memory change: 1.25x
| Benchmark | bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 | bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104 |
|---|---|---|
| 2to3 | 285 ms | 338 ms: 1.18x slower |
| docutils | 2.87 sec | 2.98 sec: 1.04x slower |
| Geometric mean | (ref) | 1.11x slower |
| Benchmark | bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 | bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104 |
|---|---|---|
| async_tree_io_tg | 1.05 sec | 588 ms: 1.79x faster |
| async_tree_none_tg | 431 ms | 252 ms: 1.71x faster |
| async_tree_io | 1.04 sec | 625 ms: 1.67x faster |
| async_tree_memoization_tg | 540 ms | 327 ms: 1.65x faster |
| async_tree_none | 452 ms | 302 ms: 1.49x faster |
| async_tree_memoization | 544 ms | 372 ms: 1.46x faster |
| async_tree_cpu_io_mixed_tg | 697 ms | 489 ms: 1.43x faster |
| async_tree_cpu_io_mixed | 696 ms | 537 ms: 1.30x faster |
| Geometric mean | (ref) | 1.55x faster |
| Benchmark | bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 | bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104 |
|---|---|---|
| pidigits | 265 ms | 249 ms: 1.06x faster |
| float | 76.6 ms | 75.3 ms: 1.02x faster |
| nbody | 88.0 ms | 132 ms: 1.50x slower |
| Geometric mean | (ref) | 1.12x slower |
| Benchmark | bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 | bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104 |
|---|---|---|
| regex_effbot | 3.57 ms | 3.12 ms: 1.15x faster |
| regex_dna | 239 ms | 244 ms: 1.02x slower |
| regex_compile | 144 ms | 156 ms: 1.09x slower |
| regex_v8 | 23.6 ms | 25.9 ms: 1.10x slower |
| Geometric mean | (ref) | 1.02x slower |
| Benchmark | bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 | bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104 |
|---|---|---|
| xml_etree_iterparse | 103 ms | 89.2 ms: 1.15x faster |
| xml_etree_parse | 144 ms | 139 ms: 1.04x faster |
| tomli_loads | 2.16 sec | 2.42 sec: 1.12x slower |
| xml_etree_generate | 86.1 ms | 98.4 ms: 1.14x slower |
| unpickle_pure_python | 210 us | 240 us: 1.15x slower |
| json_loads | 24.4 us | 27.9 us: 1.15x slower |
| pickle_pure_python | 318 us | 388 us: 1.22x slower |
| xml_etree_process | 58.4 ms | 71.7 ms: 1.23x slower |
| json_dumps | 10.2 ms | 13.5 ms: 1.32x slower |
| Geometric mean | (ref) | 1.12x slower |
| Benchmark | bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 | bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104 |
|---|---|---|
| python_startup_no_site | 8.64 ms | 11.8 ms: 1.37x slower |
| python_startup | 11.6 ms | 18.7 ms: 1.61x slower |
| Geometric mean | (ref) | 1.48x slower |
| Benchmark | bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 | bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104 |
|---|---|---|
| django_template | 38.2 ms | 48.1 ms: 1.26x slower |
| mako | 10.0 ms | 17.9 ms: 1.79x slower |
| Geometric mean | (ref) | 1.50x slower |
| Benchmark | bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0 | bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104 |
|---|---|---|
| async_tree_io_tg | 1.05 sec | 588 ms: 1.79x faster |
| async_tree_none_tg | 431 ms | 252 ms: 1.71x faster |
| async_tree_io | 1.04 sec | 625 ms: 1.67x faster |
| async_tree_memoization_tg | 540 ms | 327 ms: 1.65x faster |
| async_tree_none | 452 ms | 302 ms: 1.49x faster |
| async_tree_memoization | 544 ms | 372 ms: 1.46x faster |
| async_tree_cpu_io_mixed_tg | 697 ms | 489 ms: 1.43x faster |
| async_tree_cpu_io_mixed | 696 ms | 537 ms: 1.30x faster |
| generators | 37.4 ms | 30.9 ms: 1.21x faster |
| xml_etree_iterparse | 103 ms | 89.2 ms: 1.15x faster |
| pathlib | 18.9 ms | 16.5 ms: 1.15x faster |
| regex_effbot | 3.57 ms | 3.12 ms: 1.15x faster |
| deepcopy | 368 us | 341 us: 1.08x faster |
| sqlite_synth | 2.77 us | 2.58 us: 1.07x faster |
| pidigits | 265 ms | 249 ms: 1.06x faster |
| coroutines | 23.0 ms | 22.1 ms: 1.04x faster |
| xml_etree_parse | 144 ms | 139 ms: 1.04x faster |
| float | 76.6 ms | 75.3 ms: 1.02x faster |
| comprehensions | 21.9 us | 21.6 us: 1.01x faster |
| asyncio_websockets | 387 ms | 382 ms: 1.01x faster |
| deepcopy_memo | 36.8 us | 37.0 us: 1.01x slower |
| regex_dna | 239 ms | 244 ms: 1.02x slower |
| go | 150 ms | 154 ms: 1.03x slower |
| docutils | 2.87 sec | 2.98 sec: 1.04x slower |
| pycparser | 1.23 sec | 1.29 sec: 1.05x slower |
| dulwich_log | 65.4 ms | 69.1 ms: 1.06x slower |
| mdp | 2.57 sec | 2.78 sec: 1.08x slower |
| sympy_sum | 162 ms | 176 ms: 1.09x slower |
| regex_compile | 144 ms | 156 ms: 1.09x slower |
| json | 5.12 ms | 5.57 ms: 1.09x slower |
| deepcopy_reduce | 3.37 us | 3.68 us: 1.09x slower |
| logging_format | 7.48 us | 8.17 us: 1.09x slower |
| logging_simple | 6.71 us | 7.34 us: 1.09x slower |
| regex_v8 | 23.6 ms | 25.9 ms: 1.10x slower |
| logging_silent | 94.4 ns | 104 ns: 1.10x slower |
| sqlalchemy_declarative | 159 ms | 176 ms: 1.11x slower |
| scimark_sor | 109 ms | 121 ms: 1.11x slower |
| spectral_norm | 91.6 ms | 102 ms: 1.12x slower |
| sqlalchemy_imperative | 18.7 ms | 20.9 ms: 1.12x slower |
| chaos | 64.0 ms | 71.7 ms: 1.12x slower |
| tomli_loads | 2.16 sec | 2.42 sec: 1.12x slower |
| sympy_str | 302 ms | 341 ms: 1.13x slower |
| pyflate | 439 ms | 495 ms: 1.13x slower |
| sqlglot_normalize | 116 ms | 131 ms: 1.13x slower |
| pprint_safe_repr | 807 ms | 918 ms: 1.14x slower |
| sympy_integrate | 23.9 ms | 27.3 ms: 1.14x slower |
| xml_etree_generate | 86.1 ms | 98.4 ms: 1.14x slower |
| pprint_pformat | 1.65 sec | 1.90 sec: 1.15x slower |
| unpickle_pure_python | 210 us | 240 us: 1.15x slower |
| json_loads | 24.4 us | 27.9 us: 1.15x slower |
| scimark_fft | 301 ms | 346 ms: 1.15x slower |
| raytrace | 298 ms | 343 ms: 1.15x slower |
| sqlglot_optimize | 57.5 ms | 66.6 ms: 1.16x slower |
| crypto_pyaes | 80.3 ms | 93.5 ms: 1.16x slower |
| sqlglot_transpile | 1.78 ms | 2.10 ms: 1.18x slower |
| 2to3 | 285 ms | 338 ms: 1.18x slower |
| sympy_expand | 484 ms | 573 ms: 1.18x slower |
| gc_traversal | 3.48 ms | 4.13 ms: 1.19x slower |
| async_generators | 390 ms | 471 ms: 1.21x slower |
| meteor_contest | 128 ms | 155 ms: 1.21x slower |
| scimark_lu | 98.8 ms | 120 ms: 1.21x slower |
| hexiom | 5.96 ms | 7.24 ms: 1.21x slower |
| pickle_pure_python | 318 us | 388 us: 1.22x slower |
| create_gc_cycles | 1.59 ms | 1.95 ms: 1.23x slower |
| xml_etree_process | 58.4 ms | 71.7 ms: 1.23x slower |
| nqueens | 89.9 ms | 111 ms: 1.23x slower |
| sqlglot_parse | 1.38 ms | 1.70 ms: 1.23x slower |
| django_template | 38.2 ms | 48.1 ms: 1.26x slower |
| richards | 45.7 ms | 58.6 ms: 1.28x slower |
| telco | 6.96 ms | 9.09 ms: 1.31x slower |
| scimark_monte_carlo | 69.0 ms | 90.2 ms: 1.31x slower |
| richards_super | 51.3 ms | 67.3 ms: 1.31x slower |
| json_dumps | 10.2 ms | 13.5 ms: 1.32x slower |
| scimark_sparse_mat_mult | 4.21 ms | 5.64 ms: 1.34x slower |
| fannkuch | 350 ms | 476 ms: 1.36x slower |
| python_startup_no_site | 8.64 ms | 11.8 ms: 1.37x slower |
| deltablue | 3.24 ms | 4.63 ms: 1.43x slower |
| typing_runtime_protocols | 152 us | 220 us: 1.45x slower |
| nbody | 88.0 ms | 132 ms: 1.50x slower |
| bench_thread_pool | 950 us | 1.46 ms: 1.54x slower |
| coverage | 66.7 ms | 103 ms: 1.55x slower |
| python_startup | 11.6 ms | 18.7 ms: 1.61x slower |
| mako | 10.0 ms | 17.9 ms: 1.79x slower |
| bench_mp_pool | 4.76 ms | 48.8 ms: 10.25x slower |
| Geometric mean | (ref) | 1.12x slower |
| Ignored benchmarks (14) of results/bm-20231002-3.12.0-0fb18b0/bm-20231002-pythonperf2-x86_64-python-v3.12.0-3.12.0-0fb18b0.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list | ||
| Ignored benchmarks (12) of results/bm-20250117-3.14.0a4+-3829104-NOGIL/bm-20250117-pythonperf2-x86_64-python-3829104ab412a47bf3f3-3.14.0a4+-3829104.json: bpe_tokeniser, connected_components, genshi_text, genshi_xml, html5lib, k_core, many_optionals, pylint, shortest_path, sphinx, subparsers, thrift |
- Geometric mean (including insignificant results): 1.075x slower
- Reliability score: 99.98% likely to be slow
- 90% likely to have a slowdown of 1.08x
- 95% likely to have a slowdown of 1.07x
- 99% likely to have a slowdown of 1.05x
- memory change: 1.25x