[Perf] Linux/x64: 13 Regressions on 12/11/2023 8:56:10 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_SubstringFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	3.30 μs	3.81 μs	1.16	0.41	False
TryGetValue_True_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	573.60 μs	647.82 μs	1.13	0.28	False
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	366.06 ns	431.97 ns	1.18	0.54	False
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	406.21 μs	447.10 μs	1.10	0.33	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SubstringFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_DefaultFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	54.34 μs	57.15 μs	1.05	0.36	False
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	584.38 μs	627.63 μs	1.07	0.38	False
TryGetValue_True_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	815.61 μs	942.03 μs	1.16	0.24	False
ToFrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	27.45 μs	29.64 μs	1.08	0.12	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_DefaultFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.ToFrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionaryOptimized - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	25.81 μs	29.88 μs	1.16	0.34	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse<String, String>*'

Payloads

Baseline
Compare

System.Collections.TryGetValueFalse<String, String>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsFalse<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenSet - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	23.23 μs	27.50 μs	1.18	0.39	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse<String>*'

Payloads

Baseline
Compare

System.Collections.ContainsFalse<String>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionaryOptimized - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	33.76 μs	39.96 μs	1.18	0.38	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue<String, String>*'

Payloads

Baseline
Compare

System.Collections.TryGetValueTrue<String, String>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_SingleCharFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_True_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	39.80 μs	43.85 μs	1.10	0.35	False
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	26.89 μs	29.56 μs	1.10	0.56	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SingleCharFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

dotnet/runtime@6de7549...c28bec4

duplicate of #26198