fork: python
ref: e256a7590a0149feadfe
machine: linux-x86_64
commit hash: e256a75
commit date: 2024-09-24
overall geometric mean: 1.06x faster
HPT reliability: 100.00%
HPT 99th percentile: 1.03x faster
Memory change: 1.00x
Benchmarks with tag 'apps':
Benchmark
bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17
bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75
2to3
274 ms
254 ms: 1.08x faster
docutils
2.83 sec
2.65 sec: 1.07x faster
html5lib
67.2 ms
63.7 ms: 1.06x faster
tornado_http
94.6 ms
90.6 ms: 1.05x faster
Geometric mean
(ref)
1.06x faster
Benchmarks with tag 'asyncio':
Benchmark
bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17
bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75
async_tree_none
378 ms
309 ms: 1.22x faster
async_tree_memoization
463 ms
392 ms: 1.18x faster
async_tree_memoization_tg
444 ms
388 ms: 1.14x faster
async_tree_none_tg
336 ms
305 ms: 1.10x faster
async_tree_io
939 ms
857 ms: 1.10x faster
async_tree_cpu_io_mixed
611 ms
560 ms: 1.09x faster
async_tree_io_tg
936 ms
869 ms: 1.08x faster
async_tree_cpu_io_mixed_tg
587 ms
552 ms: 1.06x faster
Geometric mean
(ref)
1.12x faster
Benchmarks with tag 'math':
Benchmark
bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17
bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75
nbody
88.3 ms
84.6 ms: 1.04x faster
float
78.9 ms
76.0 ms: 1.04x faster
pidigits
191 ms
186 ms: 1.03x faster
Geometric mean
(ref)
1.04x faster
Benchmarks with tag 'regex':
Benchmark
bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17
bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75
regex_compile
137 ms
127 ms: 1.07x faster
regex_v8
25.1 ms
25.0 ms: 1.00x faster
regex_dna
221 ms
220 ms: 1.00x faster
regex_effbot
3.67 ms
3.70 ms: 1.01x slower
Geometric mean
(ref)
1.02x faster
Benchmarks with tag 'serialize':
Benchmark
bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17
bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75
json_loads
28.9 us
27.1 us: 1.07x faster
xml_etree_process
61.2 ms
58.4 ms: 1.05x faster
pickle_dict
34.8 us
33.5 us: 1.04x faster
xml_etree_generate
87.4 ms
84.2 ms: 1.04x faster
json_dumps
10.7 ms
10.3 ms: 1.04x faster
xml_etree_parse
162 ms
156 ms: 1.04x faster
tomli_loads
2.12 sec
2.06 sec: 1.03x faster
xml_etree_iterparse
107 ms
104 ms: 1.03x faster
unpickle_pure_python
218 us
212 us: 1.03x faster
unpickle_list
5.34 us
5.24 us: 1.02x faster
pickle_pure_python
305 us
301 us: 1.01x faster
pickle
11.5 us
11.7 us: 1.02x slower
unpickle
15.1 us
17.4 us: 1.15x slower
Geometric mean
(ref)
1.02x faster
Benchmark hidden because not significant (1): pickle_list
Benchmarks with tag 'startup':
Benchmark
bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17
bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75
python_startup
10.8 ms
10.6 ms: 1.02x faster
python_startup_no_site
7.11 ms
7.03 ms: 1.01x faster
Geometric mean
(ref)
1.01x faster
Benchmarks with tag 'template':
Benchmark
bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17
bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75
genshi_text
23.7 ms
21.5 ms: 1.10x faster
genshi_xml
51.6 ms
49.6 ms: 1.04x faster
django_template
34.8 ms
34.0 ms: 1.02x faster
mako
11.2 ms
11.3 ms: 1.01x slower
Geometric mean
(ref)
1.04x faster
Benchmark
bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17
bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75
deepcopy
367 us
254 us: 1.45x faster
deepcopy_memo
39.7 us
29.5 us: 1.34x faster
deepcopy_reduce
3.35 us
2.63 us: 1.27x faster
go
145 ms
118 ms: 1.23x faster
async_tree_none
378 ms
309 ms: 1.22x faster
async_tree_memoization
463 ms
392 ms: 1.18x faster
async_tree_memoization_tg
444 ms
388 ms: 1.14x faster
gc_traversal
3.98 ms
3.55 ms: 1.12x faster
async_tree_none_tg
336 ms
305 ms: 1.10x faster
mdp
2.79 sec
2.53 sec: 1.10x faster
richards_super
57.4 ms
52.2 ms: 1.10x faster
genshi_text
23.7 ms
21.5 ms: 1.10x faster
async_tree_io
939 ms
857 ms: 1.10x faster
richards
50.9 ms
46.5 ms: 1.10x faster
async_tree_cpu_io_mixed
611 ms
560 ms: 1.09x faster
scimark_fft
392 ms
362 ms: 1.08x faster
scimark_lu
122 ms
112 ms: 1.08x faster
2to3
274 ms
254 ms: 1.08x faster
crypto_pyaes
77.5 ms
71.7 ms: 1.08x faster
scimark_sparse_mat_mult
5.27 ms
4.89 ms: 1.08x faster
async_tree_io_tg
936 ms
869 ms: 1.08x faster
pprint_pformat
1.56 sec
1.45 sec: 1.08x faster
regex_compile
137 ms
127 ms: 1.07x faster
pprint_safe_repr
758 ms
708 ms: 1.07x faster
asyncio_tcp
508 ms
474 ms: 1.07x faster
sympy_sum
156 ms
146 ms: 1.07x faster
json_loads
28.9 us
27.1 us: 1.07x faster
thrift
823 us
772 us: 1.07x faster
docutils
2.83 sec
2.65 sec: 1.07x faster
generators
29.6 ms
27.8 ms: 1.06x faster
async_tree_cpu_io_mixed_tg
587 ms
552 ms: 1.06x faster
pathlib
17.3 ms
16.3 ms: 1.06x faster
sympy_str
282 ms
266 ms: 1.06x faster
chaos
61.3 ms
57.9 ms: 1.06x faster
bench_thread_pool
834 us
788 us: 1.06x faster
sympy_integrate
20.5 ms
19.4 ms: 1.06x faster
html5lib
67.2 ms
63.7 ms: 1.06x faster
bpe_tokeniser
5.02 sec
4.77 sec: 1.05x faster
sqlglot_optimize
55.5 ms
52.9 ms: 1.05x faster
sympy_expand
473 ms
450 ms: 1.05x faster
create_gc_cycles
1.82 ms
1.73 ms: 1.05x faster
sqlite_synth
2.99 us
2.85 us: 1.05x faster
xml_etree_process
61.2 ms
58.4 ms: 1.05x faster
sqlglot_normalize
110 ms
105 ms: 1.05x faster
tornado_http
94.6 ms
90.6 ms: 1.05x faster
coverage
93.1 ms
89.1 ms: 1.04x faster
typing_runtime_protocols
165 us
158 us: 1.04x faster
nbody
88.3 ms
84.6 ms: 1.04x faster
dulwich_log
67.2 ms
64.5 ms: 1.04x faster
logging_format
6.47 us
6.22 us: 1.04x faster
genshi_xml
51.6 ms
49.6 ms: 1.04x faster
sqlglot_transpile
1.63 ms
1.57 ms: 1.04x faster
json
5.31 ms
5.11 ms: 1.04x faster
float
78.9 ms
76.0 ms: 1.04x faster
pickle_dict
34.8 us
33.5 us: 1.04x faster
xml_etree_generate
87.4 ms
84.2 ms: 1.04x faster
json_dumps
10.7 ms
10.3 ms: 1.04x faster
xml_etree_parse
162 ms
156 ms: 1.04x faster
pyflate
484 ms
468 ms: 1.03x faster
sqlglot_parse
1.32 ms
1.28 ms: 1.03x faster
tomli_loads
2.12 sec
2.06 sec: 1.03x faster
meteor_contest
110 ms
106 ms: 1.03x faster
asyncio_tcp_ssl
1.84 sec
1.79 sec: 1.03x faster
xml_etree_iterparse
107 ms
104 ms: 1.03x faster
scimark_monte_carlo
69.2 ms
67.1 ms: 1.03x faster
scimark_sor
127 ms
124 ms: 1.03x faster
unpickle_pure_python
218 us
212 us: 1.03x faster
logging_silent
105 ns
102 ns: 1.03x faster
hexiom
6.30 ms
6.13 ms: 1.03x faster
pidigits
191 ms
186 ms: 1.03x faster
pycparser
1.16 sec
1.13 sec: 1.03x faster
logging_simple
5.74 us
5.61 us: 1.02x faster
raytrace
267 ms
260 ms: 1.02x faster
nqueens
81.4 ms
79.5 ms: 1.02x faster
deltablue
3.25 ms
3.18 ms: 1.02x faster
django_template
34.8 ms
34.0 ms: 1.02x faster
spectral_norm
116 ms
114 ms: 1.02x faster
unpickle_list
5.34 us
5.24 us: 1.02x faster
python_startup
10.8 ms
10.6 ms: 1.02x faster
async_generators
442 ms
434 ms: 1.02x faster
asyncio_websockets
567 ms
558 ms: 1.02x faster
pickle_pure_python
305 us
301 us: 1.01x faster
comprehensions
16.6 us
16.4 us: 1.01x faster
python_startup_no_site
7.11 ms
7.03 ms: 1.01x faster
telco
8.41 ms
8.33 ms: 1.01x faster
regex_v8
25.1 ms
25.0 ms: 1.00x faster
regex_dna
221 ms
220 ms: 1.00x faster
bench_mp_pool
23.9 ms
24.0 ms: 1.00x slower
regex_effbot
3.67 ms
3.70 ms: 1.01x slower
mako
11.2 ms
11.3 ms: 1.01x slower
pickle
11.5 us
11.7 us: 1.02x slower
unpickle
15.1 us
17.4 us: 1.15x slower
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (4): fannkuch, coroutines, pickle_list, pylint
Ignored benchmarks (7) of results/bm-20240605-3.13.0b2-3a83b17/bm-20240605-linux-x86_64-python-v3.13.0b2-3.13.0b2-3a83b17.json: aiohttp, chameleon, dask, djangocms, flaskblogging, gunicorn, mypy2
Ignored benchmarks (1) of results/bm-20240924-3.14.0a0-e256a75/bm-20240924-linux-x86_64-python-e256a7590a0149feadfe-3.14.0a0-e256a75.json: unpack_sequence
Reliability score: 100.00% likely to be faster
90% likely to have a speedup of 1.04x
95% likely to have a speedup of 1.04x
99% likely to have a speedup of 1.03x