Skip to content

Latest commit

 

History

History
459 lines (438 loc) · 31.3 KB

File metadata and controls

459 lines (438 loc) · 31.3 KB

Benchmark Report

Job Properties

Commits: JuliaLang/julia@43c2ea04aae59c8d34dbcd2ca65909b505a57597 vs JuliaLang/julia@5544a0fab7648cfa61fe79cd557a7504a92ec1b5

Comparison Diff: link

Triggered By: link

Tag Predicate: ALL

Results

Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.

Below is a table of this job's results, obtained by running the benchmarks found in JuliaCI/BaseBenchmarks.jl. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.

The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["array", "accumulate", ("accumulate!", "Int")] 1.23 (5%) ❌ 1.00 (1%)
["array", "accumulate", ("accumulate", "Int")] 1.05 (5%) ❌ 1.00 (1%)
["array", "cat", "4467"] 1.21 (5%) ❌ 1.00 (1%)
["array", "cat", ("catnd", 5)] 1.94 (5%) ❌ 1.00 (1%)
["array", "cat", ("catnd_setind", 5)] 1.05 (5%) ❌ 1.00 (1%)
["array", "cat", ("hcat", 5)] 0.83 (5%) ✅ 1.00 (1%)
["array", "equality", ("==", "UnitRange{Int64}")] 1.09 (5%) ❌ 1.00 (1%)
["array", "equality", ("isequal", "UnitRange{Int64}")] 0.82 (5%) ✅ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Int64}")] 0.93 (5%) ✅ 1.00 (1%)
["array", "reverse", "rev_load_fast!"] 0.91 (5%) ✅ 1.00 (1%)
["array", "reverse", "rev_load_slow!"] 0.93 (5%) ✅ 1.00 (1%)
["array", "setindex!", ("setindex!", 2)] 1.07 (5%) ❌ 1.00 (1%)
["array", "setindex!", ("setindex!", 5)] 1.07 (5%) ❌ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (10, "tup_tup")] 0.20 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (3, "scal_tup")] 0.84 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "scal_tup")] 1.10 (5%) ❌ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "scal_tup_x3")] 1.09 (5%) ❌ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "tup_tup")] 0.91 (5%) ✅ 1.00 (1%)
["collection", "deletion", ("Set", "Int", "filter!")] 0.60 (25%) ✅ 1.00 (1%)
["collection", "optimizations", ("Vector", "concrete", "Nothing")] 4.19 (25%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Float32}")] 0.92 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{Float32}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{UInt8}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.99", "Vector{Float32}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "10-90")] 1.15 (5%) ❌ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "50-50")] 1.09 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float32}")] 1.08 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float64}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{UInt64}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{UInt8}")] 1.09 (5%) ❌ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{UInt64}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findprev", ("ispos", "Vector{Int8}")] 0.95 (5%) ✅ 1.00 (1%)
["inference", "abstract interpretation", "Base.init_stdio(::Ptr{Cvoid})"] 1.04 (5%) 1.02 (1%) ❌
["inference", "abstract interpretation", "REPL.REPLCompletions.completions"] 1.03 (5%) 1.02 (1%) ❌
["inference", "abstract interpretation", "abstract_call_gf_by_type"] 1.06 (5%) ❌ 1.01 (1%) ❌
["inference", "abstract interpretation", "broadcast"] 1.04 (5%) 1.02 (1%) ❌
["inference", "abstract interpretation", "construct_ssa!"] 1.07 (5%) ❌ 1.01 (1%) ❌
["inference", "abstract interpretation", "domsort_ssa!"] 1.05 (5%) 1.01 (1%) ❌
["inference", "abstract interpretation", "println(::QuoteNode)"] 1.04 (5%) 1.01 (1%) ❌
["inference", "abstract interpretation", "sin(42)"] 1.12 (5%) ❌ 1.01 (1%) ❌
["inference", "optimization", "Base.init_stdio(::Ptr{Cvoid})"] 1.10 (5%) ❌ 1.00 (1%)
["inference", "optimization", "REPL.REPLCompletions.completions"] 1.06 (5%) ❌ 1.00 (1%)
["inference", "optimization", "sin(42)"] 0.94 (5%) ✅ 1.00 (1%)
["io", "read", "readstring"] 1.05 (5%) ❌ 1.00 (1%)
["io", "serialization", ("serialize", "Matrix{Float64}")] 1.06 (5%) ❌ 1.00 (1%)
["linalg", "small exp #29116"] 0.89 (5%) ✅ 1.00 (1%)
["micro", "parseint"] 1.05 (5%) ❌ 1.00 (1%)
["misc", "23042", "ComplexF32"] 0.93 (5%) ✅ 1.00 (1%)
["misc", "foldl", "foldl(+, filter(...); init = 0.0)"] 0.27 (5%) ✅ 1.00 (1%)
["problem", "monte carlo", "euro_option_devec"] 1.99 (5%) ❌ 1.00 (1%)
["problem", "monte carlo", "euro_option_vec"] 1.33 (5%) ❌ 1.00 (1%)
["problem", "simplex", "simplex"] 0.92 (5%) ✅ 1.00 (1%)
["problem", "stockcorr", "stockcorr"] 1.24 (5%) ❌ 1.00 (1%)
["problem", "ziggurat", "ziggurat"] 0.58 (5%) ✅ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "Float16")] 1.26 (25%) ❌ 1.00 (1%)
["scalar", "acos", ("0.5 <= abs(x) < 1", "negative argument", "Float32")] 0.82 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("0.975 <= abs(x) < 1.0", "negative argument", "Float64")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very large", "negative argument", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "negative argument", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very large", "positive argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "negative argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "negative argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "positive argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "positive argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("zero", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("zero", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y infinite", "y negative", "x finite", "x negative", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y negative", "x negative", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) small", "y positive", "x positive", "Float64")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("x one", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("x zero", "y negative", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("x zero", "y positive", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("y finite", "y positive", "x infinite", "x negative", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("y finite", "y positive", "x infinite", "x positive", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("y infinite", "y negative", "x finite", "x positive", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("y infinite", "y positive", "x finite", "x negative", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("y zero", "y negative", "x positive", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("y zero", "y positive", "x positive", "Float64")] 0.90 (5%) ✅ 1.00 (1%)
["scalar", "atanh", ("one", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 6π/4", "positive argument", "Float32", "sin_kernel")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 6π/4", "positive argument", "Float64", "sin_kernel")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 7π/4", "positive argument", "Float32", "cos_kernel")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 7π/4", "positive argument", "Float64", "cos_kernel")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "zero", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "zero", "Float64")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("2.7755602085408512e-17 <= abs(x) < 22.0", "negative argument", "Float64")] 1.26 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("2.7755602085408512e-17 <= abs(x) < 22.0", "positive argument", "Float64")] 1.26 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("22.0 <= abs(x) < 709.7822265633563", "negative argument", "Float64")] 1.26 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("22.0 <= abs(x) < 709.7822265633563", "positive argument", "Float64")] 1.26 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("very large", "negative argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("very large", "positive argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("very small", "negative argument", "Float32")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("very small", "positive argument", "Float32")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("2pow1023", "negative argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("2pow1023", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("2pow3", "negative argument", "Float64")] 1.20 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("2pow3", "positive argument", "Float64")] 1.25 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("2pow35", "negative argument", "Float64")] 1.14 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("2pow35", "positive argument", "Float64")] 1.23 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("one", "Float64")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("small", "negative argument", "Float64")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("small", "positive argument", "Float64")] 1.20 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("zero", "Float64")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("arg reduction I", "negative argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("arg reduction I", "positive argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("arg reduction II", "negative argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("arg reduction II", "positive argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("huge", "positive argument", "Float64")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("large", "negative argument", "Float64")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("large", "positive argument", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("medium", "negative argument", "Float64")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("medium", "positive argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("one", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("small", "negative argument", "Float64")] 1.13 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("small", "positive argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("zero", "Float64")] 1.14 (5%) ❌ 1.00 (1%)
["scalar", "rem_pio2", ("argument reduction (easy) abs(x) < 3π/4", "positive argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "rem_pio2", ("argument reduction (easy) abs(x) < 5π/4", "negative argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "rem_pio2", ("argument reduction (easy) abs(x) < 6π/4", "positive argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2π/4", "positive argument", "Float32", "cos_kernel")] 1.11 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 3π/4", "positive argument", "Float32", "cos_kernel")] 1.15 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("argument reduction (hard) abs(x) < 2π/4", "positive argument", "Float32", "cos_kernel")] 1.15 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("no reduction", "zero", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("no reduction", "zero", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 4π/4", "negative argument", "Float32")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 4π/4", "negative argument", "Float64")] 0.85 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 4π/4", "positive argument", "Float64")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 5π/4", "negative argument", "Float32")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 5π/4", "negative argument", "Float64")] 0.86 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 5π/4", "positive argument", "Float32")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 5π/4", "positive argument", "Float64")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "negative argument", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "sinh", ("2.0^-28 <= abs(x) < 22.0", "negative argument", "Float64")] 1.19 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("2.0^-28 <= abs(x) < 22.0", "positive argument", "Float64")] 1.19 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("22.0 <= abs(x) < 709.7822265633563", "negative argument", "Float64")] 1.20 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("22.0 <= abs(x) < 709.7822265633563", "positive argument", "Float64")] 1.19 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("very large", "negative argument", "Float64")] 1.20 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("very large", "positive argument", "Float64")] 1.20 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("large", "positive argument", "Float32")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("medium", "positive argument", "Float64")] 0.81 (5%) ✅ 1.00 (1%)
["scalar", "tanh", ("0 <= abs(x) < 2f0^-12", "negative argument", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("0 <= abs(x) < 2f0^-12", "positive argument", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "tanh", ("1.0 <= abs(x) < 22.0", "negative argument", "Float64")] 1.26 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("1.0 <= abs(x) < 22.0", "positive argument", "Float64")] 1.25 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("2f0^-12 <= abs(x) < 1f0", "negative argument", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "tanh", ("2f0^-12 <= abs(x) < 1f0", "positive argument", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("very large", "negative argument", "Float32")] 1.17 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("very large", "negative argument", "Float64")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("very large", "positive argument", "Float32")] 1.17 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("very large", "positive argument", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("zero", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["shootout", "binary_trees"] 1.06 (5%) ❌ 1.00 (1%)
["simd", ("Cartesian", "axpy!", "Float32", 3, 31)] 1.29 (20%) ❌ 1.00 (1%)
["simd", ("CartesianPartition", "conditional_loop!", "Int32", 2, 63)] 0.64 (20%) ✅ 1.00 (1%)
["simd", ("CartesianPartition", "conditional_loop!", "Int32", 3, 63)] 0.66 (20%) ✅ 1.00 (1%)
["simd", ("CartesianPartition", "conditional_loop!", "Int32", 4, 31)] 1.56 (20%) ❌ 1.00 (1%)
["simd", ("Linear", "inner_aliased", "Float32", 4095)] 0.80 (20%) ✅ 1.00 (1%)
["simd", ("Linear", "inner_aliased", "Float32", 4096)] 0.76 (20%) ✅ 1.00 (1%)
["sparse", "constructors", ("IV", 100)] 0.92 (5%) ✅ 1.00 (1%)
["sparse", "constructors", ("SymTridiagonal", 100)] 1.05 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("Tridiagonal", 100)] 1.07 (5%) ❌ 1.00 (1%)
["sparse", "matmul", ("A_mul_B", "sparse 500x500, dense 500x5 -> dense 500x5")] 1.34 (30%) ❌ 1.00 (1%)
["sparse", "matmul", ("A_mul_B", "sparse 50x500, dense 500x5 -> dense 50x5")] 1.44 (30%) ❌ 1.00 (1%)
["sparse", "matmul", ("A_mul_Bt", "sparse 50x500, dense 5x500 -> dense 50x5")] 1.40 (30%) ❌ 1.00 (1%)
["sparse", "matmul", ("Ac_mul_B", "dense 50x5, sparse 50x500 -> dense 5x500")] 1.34 (30%) ❌ 1.00 (1%)
["sparse", "sparse matvec", "adjoint"] 1.22 (5%) ❌ 1.00 (1%)
["sparse", "sparse matvec", "non-adjoint"] 1.23 (5%) ❌ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "different"] 0.94 (5%) ✅ 1.00 (1%)
["string", "repeat", "repeat str len 16"] 1.06 (5%) ❌ 1.00 (1%)
["tuple", "linear algebra", ("matmat", "(16, 16)", "(16, 16)")] 0.74 (5%) ✅ 1.00 (1%)
["tuple", "linear algebra", ("matmat", "(4, 4)", "(4, 4)")] 0.70 (5%) ✅ 1.00 (1%)
["tuple", "linear algebra", ("matmat", "(8, 8)", "(8, 8)")] 1.10 (5%) ❌ 1.00 (1%)
["tuple", "linear algebra", ("matvec", "(16, 16)", "(16,)")] 1.07 (5%) ❌ 1.00 (1%)
["tuple", "linear algebra", ("matvec", "(4, 4)", "(4,)")] 1.18 (5%) ❌ 1.00 (1%)
["tuple", "linear algebra", ("matvec", "(8, 8)", "(8,)")] 1.07 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("minimum", "(2,)")] 1.07 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sum", "(2, 2)")] 0.93 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sum", "(2,)")] 0.93 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sum", "(4, 4)")] 0.88 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sum", "(8, 8)")] 0.80 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(2, 2)")] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Bool", "(false, false)")] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Bool", "(false, true)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Bool", "(true, true)")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int64", "(false, true)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int8", "(false, true)")] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int8", "(true, true)")] 1.12 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "BigFloat", 1)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Bool", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Float32", 1)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Int64", 0)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Int64", 1)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Int8", 1)] 1.26 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Bool", 1)] 0.82 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "BigFloat", 1)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "abs", "Int8", 1)] 1.28 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "BigFloat", 1)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "BigInt")] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "Int8")] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_simplecopy", "Bool", 1)] 1.39 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "Float32", 0)] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_simplecopy", "Float32", 1)] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_simplecopy", "Int8", 1)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum", "BigFloat", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum", "BigFloat", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum", "BigInt", 0)] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum", "Float32", 1)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum", "Float64", 1)] 0.80 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum2", "BigFloat", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum2", "BigFloat", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum2", "Float32", 1)] 1.42 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum2", "Float64", 1)] 0.73 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "BigFloat", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "BigFloat", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "ComplexF64", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "Float32", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "Int8", 0)] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum4", "ComplexF64", 1)] 1.31 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "BigFloat", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Bool", 0)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Int8", 0)] 1.12 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Bool}", 1)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, ComplexF64}", 1)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Int64}", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Nothing, BigFloat}", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "BigInt", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Missing, BigFloat}", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Missing, BigInt}", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Missing, ComplexF64}", 1)] 1.25 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Missing, Float32}", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Missing, Float64}", 1)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Nothing, BigInt}", 0)] 0.95 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["alloc"]
  • ["array", "accumulate"]
  • ["array", "any/all"]
  • ["array", "bool"]
  • ["array", "cat"]
  • ["array", "comprehension"]
  • ["array", "convert"]
  • ["array", "equality"]
  • ["array", "growth"]
  • ["array", "index"]
  • ["array", "reductions"]
  • ["array", "reverse"]
  • ["array", "setindex!"]
  • ["array", "subarray"]
  • ["broadcast"]
  • ["broadcast", "dotop"]
  • ["broadcast", "fusion"]
  • ["broadcast", "mix_scalar_tuple"]
  • ["broadcast", "sparse"]
  • ["broadcast", "typeargs"]
  • ["collection", "deletion"]
  • ["collection", "initialization"]
  • ["collection", "iteration"]
  • ["collection", "optimizations"]
  • ["collection", "queries & updates"]
  • ["collection", "set operations"]
  • ["dates", "accessor"]
  • ["dates", "arithmetic"]
  • ["dates", "construction"]
  • ["dates", "conversion"]
  • ["dates", "parse"]
  • ["dates", "query"]
  • ["dates", "string"]
  • ["find", "findall"]
  • ["find", "findnext"]
  • ["find", "findprev"]
  • ["frontend"]
  • ["inference", "abstract interpretation"]
  • ["inference", "allinference"]
  • ["inference", "optimization"]
  • ["io", "array_limit"]
  • ["io", "read"]
  • ["io", "serialization"]
  • ["io"]
  • ["linalg", "arithmetic"]
  • ["linalg", "blas"]
  • ["linalg", "factorization"]
  • ["linalg"]
  • ["micro"]
  • ["misc"]
  • ["misc", "23042"]
  • ["misc", "afoldl"]
  • ["misc", "allocation elision view"]
  • ["misc", "bitshift"]
  • ["misc", "foldl"]
  • ["misc", "issue 12165"]
  • ["misc", "iterators"]
  • ["misc", "julia"]
  • ["misc", "parse"]
  • ["misc", "repeat"]
  • ["misc", "splatting"]
  • ["problem", "chaosgame"]
  • ["problem", "fem"]
  • ["problem", "go"]
  • ["problem", "grigoriadis khachiyan"]
  • ["problem", "imdb"]
  • ["problem", "json"]
  • ["problem", "laplacian"]
  • ["problem", "monte carlo"]
  • ["problem", "raytrace"]
  • ["problem", "seismic"]
  • ["problem", "simplex"]
  • ["problem", "spellcheck"]
  • ["problem", "stockcorr"]
  • ["problem", "ziggurat"]
  • ["random", "collections"]
  • ["random", "randstring"]
  • ["random", "ranges"]
  • ["random", "sequences"]
  • ["random", "types"]
  • ["scalar", "acos"]
  • ["scalar", "acosh"]
  • ["scalar", "arithmetic"]
  • ["scalar", "asin"]
  • ["scalar", "asinh"]
  • ["scalar", "atan"]
  • ["scalar", "atan2"]
  • ["scalar", "atanh"]
  • ["scalar", "cbrt"]
  • ["scalar", "cos"]
  • ["scalar", "cosh"]
  • ["scalar", "exp2"]
  • ["scalar", "expm1"]
  • ["scalar", "fastmath"]
  • ["scalar", "floatexp"]
  • ["scalar", "intfuncs"]
  • ["scalar", "iteration"]
  • ["scalar", "mod2pi"]
  • ["scalar", "predicate"]
  • ["scalar", "rem_pio2"]
  • ["scalar", "sin"]
  • ["scalar", "sincos"]
  • ["scalar", "sinh"]
  • ["scalar", "tan"]
  • ["scalar", "tanh"]
  • ["shootout"]
  • ["simd"]
  • ["sort", "insertionsort"]
  • ["sort", "issorted"]
  • ["sort", "mergesort"]
  • ["sort", "quicksort"]
  • ["sparse", "arithmetic"]
  • ["sparse", "constructors"]
  • ["sparse", "index"]
  • ["sparse", "matmul"]
  • ["sparse", "sparse matvec"]
  • ["sparse", "sparse solves"]
  • ["sparse", "transpose"]
  • ["string", "==(::AbstractString, ::AbstractString)"]
  • ["string", "==(::SubString, ::String)"]
  • ["string", "findfirst"]
  • ["string"]
  • ["string", "readuntil"]
  • ["string", "repeat"]
  • ["tuple", "index"]
  • ["tuple", "linear algebra"]
  • ["tuple", "misc"]
  • ["tuple", "reduction"]
  • ["union", "array"]

Version Info

Primary Build

Julia Version 1.8.0
Commit 43c2ea04aa (2022-08-30 20:21 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.4 LTS
  uname: Linux 5.4.0-122-generic #138-Ubuntu SMP Wed Jun 22 15:00:31 UTC 2022 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
              speed         user         nice          sys         idle          irq
       #1  3264 MHz      32432 s         73 s      10692 s   18563121 s          0 s
       #2  3070 MHz     880304 s         34 s      39188 s   17698796 s          0 s
       #3  3192 MHz      34938 s         25 s       9309 s   18572840 s          0 s
       #4  2850 MHz      28542 s         48 s       9103 s   18567947 s          0 s
       #5  2926 MHz      31333 s         22 s       9069 s   18470518 s          0 s
       #6  2675 MHz      29663 s         33 s       9007 s   18574620 s          0 s
       #7  3247 MHz      34589 s         63 s       9274 s   18574247 s          0 s
       #8  2892 MHz      31329 s         77 s       8972 s   18569813 s          0 s
  Memory: 31.320838928222656 GB (19645.140625 MB free)
  Uptime: 1.86340308e6 sec
  Load Avg:  1.03  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, haswell)
  Threads: 1 on 8 virtual cores

Comparison Build

Julia Version 1.8.0
Commit 5544a0fab7 (2022-08-17 13:38 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.4 LTS
  uname: Linux 5.4.0-122-generic #138-Ubuntu SMP Wed Jun 22 15:00:31 UTC 2022 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
              speed         user         nice          sys         idle          irq
       #1  3594 MHz      33061 s         73 s      10950 s   18696843 s          0 s
       #2  2675 MHz    1008167 s         34 s      44425 s   17700739 s          0 s
       #3  2937 MHz      35401 s         25 s       9332 s   18707371 s          0 s
       #4  2959 MHz      28562 s         48 s       9117 s   18702831 s          0 s
       #5  2961 MHz      31918 s         22 s       9091 s   18604714 s          0 s
       #6  2590 MHz      30058 s         33 s       9021 s   18709251 s          0 s
       #7  3011 MHz      34606 s         63 s       9285 s   18709249 s          0 s
       #8  2914 MHz      31372 s         77 s       8982 s   18704780 s          0 s
  Memory: 31.320838928222656 GB (18009.0546875 MB free)
  Uptime: 1.87690756e6 sec
  Load Avg:  1.05  1.05  1.01
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, haswell)
  Threads: 1 on 8 virtual cores