feat: 10k contexts

[astuyve]

What does this PR do?

We had merged this earlier than upstreaming it into libdatadog, so it was missed: DataDog/datadog-lambda-extension#380

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.13%. Comparing base (40ca981) to head (ef9f5df).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #615      +/-   ##
==========================================
+ Coverage   73.06%   73.13%   +0.06%     
==========================================
  Files         252      252              
  Lines       35959    35959              
==========================================
+ Hits        26274    26299      +25     
+ Misses       9685     9660      -25     

Components	Coverage Δ
crashtracker	20.48% <ø> (ø)
datadog-alloc	98.73% <ø> (ø)
data-pipeline	90.12% <ø> (ø)
data-pipeline-ffi	0.00% <ø> (ø)
ddcommon	83.08% <ø> (ø)
ddcommon-ffi	69.52% <ø> (ø)
ddtelemetry	59.10% <ø> (ø)
ipc	83.63% <ø> (ø)
profiling	84.26% <ø> (+0.69%)	⬆️
profiling-ffi	77.42% <ø> (ø)
serverless	0.00% <ø> (ø)
sidecar	40.12% <ø> (ø)
sidecar-ffi	0.00% <ø> (ø)
spawn-worker	50.36% <ø> (ø)
tinybytes	91.66% <ø> (ø)
trace-mini-agent	70.88% <ø> (ø)
trace-normalization	98.25% <ø> (ø)
trace-obfuscation	95.73% <ø> (ø)
trace-protobuf	77.67% <ø> (ø)
trace-utils	92.86% <ø> (ø)

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2024-09-09 19:13:35

Comparing candidate commit ef9f5df in PR branch aj/bump-contexts with baseline commit 40ca981 in branch main.

Found 4 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005

• 🟩 execution_time [-9.538µs; -9.250µs] or [-9.472%; -9.186%]
• 🟩 throughput [+1006296.815op/s; +1037148.032op/s] or [+10.133%; +10.443%]

scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて

• 🟩 execution_time [-14.496µs; -14.369µs] or [-3.025%; -2.998%]
• 🟩 throughput [+64509.687op/s; +65082.263op/s] or [+3.091%; +3.119%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	578.499µs	579.556µs ± 0.288µs	579.585µs ± 0.186µs	579.758µs	580.000µs	580.116µs	580.223µs	0.11%	-0.540	0.590	0.05%	0.020µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1723476.213op/s	1725458.662op/s ± 856.499op/s	1725373.395op/s ± 552.970op/s	1725946.502op/s	1726949.202op/s	1727943.961op/s	1728610.711op/s	0.19%	0.544	0.598	0.05%	60.564op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	463.901µs	464.786µs ± 0.347µs	464.761µs ± 0.209µs	464.991µs	465.389µs	465.571µs	466.745µs	0.43%	1.140	4.649	0.07%	0.025µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2142498.959op/s	2151527.388op/s ± 1605.193op/s	2151641.340op/s ± 967.874op/s	2152530.461op/s	2153807.790op/s	2154585.211op/s	2155634.545op/s	0.19%	-1.128	4.584	0.07%	113.504op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	183.976µs	184.254µs ± 0.137µs	184.265µs ± 0.088µs	184.353µs	184.462µs	184.541µs	184.685µs	0.23%	-0.091	-0.330	0.07%	0.010µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5414616.839op/s	5427306.772op/s ± 4049.789op/s	5426957.762op/s ± 2580.597op/s	5429535.290op/s	5434204.966op/s	5435326.614op/s	5435502.665op/s	0.16%	0.095	-0.333	0.07%	286.363op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	45.983µs	46.339µs ± 0.230µs	46.234µs ± 0.106µs	46.561µs	46.727µs	46.832µs	46.884µs	1.40%	0.690	-0.931	0.50%	0.016µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	21329380.087op/s	21580720.920op/s ± 106863.186op/s	21628876.853op/s ± 49611.677op/s	21661114.022op/s	21701638.748op/s	21732561.833op/s	21746982.953op/s	0.55%	-0.682	-0.943	0.49%	7556.368op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	44.201µs	44.835µs ± 0.274µs	44.847µs ± 0.214µs	45.045µs	45.280µs	45.363µs	45.406µs	1.25%	-0.016	-0.717	0.61%	0.019µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	22023413.335op/s	22304799.353op/s ± 136516.897op/s	22298030.135op/s ± 106268.922op/s	22412695.580op/s	22504340.573op/s	22607966.928op/s	22623700.740op/s	1.46%	0.040	-0.709	0.61%	9653.202op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[579.516µs; 579.596µs] or [-0.007%; +0.007%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1725339.960op/s; 1725577.365op/s] or [-0.007%; +0.007%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[464.738µs; 464.834µs] or [-0.010%; +0.010%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2151304.924op/s; 2151749.852op/s] or [-0.010%; +0.010%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[184.234µs; 184.273µs] or [-0.010%; +0.010%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5426745.510op/s; 5427868.034op/s] or [-0.010%; +0.010%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[46.307µs; 46.371µs] or [-0.069%; +0.069%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[21565910.710op/s; 21595531.130op/s] or [-0.069%; +0.069%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[44.797µs; 44.873µs] or [-0.085%; +0.085%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[22285879.424op/s; 22323719.281op/s] or [-0.085%; +0.085%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.205µs	22.756µs ± 13.783µs	17.385µs ± 0.077µs	17.535µs	49.275µs	53.280µs	120.378µs	592.41%	3.915	20.812	60.42%	0.975µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[20.846µs; 24.666µs] or [-8.394%; +8.394%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	291.969ns	303.362ns ± 15.192ns	297.037ns ± 3.590ns	303.364ns	342.075ns	350.024ns	351.315ns	18.27%	1.831	2.168	5.00%	1.074ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[301.256ns; 305.467ns] or [-0.694%; +0.694%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.403µs	2.977µs ± 1.448µs	2.813µs ± 0.027µs	2.837µs	3.051µs	12.901µs	16.745µs	495.37%	8.016	64.917	48.52%	0.102µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[2.776µs; 3.177µs] or [-6.742%; +6.742%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	8.884ms	8.917ms ± 0.014ms	8.915ms ± 0.008ms	8.924ms	8.939ms	8.962ms	8.988ms	0.82%	1.116	3.516	0.16%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[8.915ms; 8.919ms] or [-0.022%; +0.022%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	35.105µs	35.774µs ± 1.075µs	35.306µs ± 0.111µs	35.450µs	38.093µs	38.180µs	38.466µs	8.95%	1.680	0.889	3.00%	0.076µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[35.625µs; 35.923µs] or [-0.416%; +0.416%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	280.703µs	281.350µs ± 0.550µs	281.200µs ± 0.173µs	281.439µs	282.579µs	283.734µs	284.167µs	1.06%	2.765	8.815	0.20%	0.039µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	3519057.029op/s	3554311.266op/s ± 6916.793op/s	3556188.421op/s ± 2189.980op/s	3558061.195op/s	3560020.241op/s	3561912.545op/s	3562487.255op/s	0.18%	-2.746	8.699	0.19%	489.091op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	27.381µs	27.655µs ± 0.137µs	27.656µs ± 0.100µs	27.751µs	27.855µs	27.994µs	28.062µs	1.47%	0.166	-0.195	0.49%	0.010µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	35635846.030op/s	36160983.414op/s ± 178842.893op/s	36158790.329op/s ± 131109.570op/s	36294788.330op/s	36467093.445op/s	36504485.239op/s	36521637.865op/s	1.00%	-0.139	-0.226	0.49%	12646.102op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	16.826µs	16.871µs ± 0.022µs	16.869µs ± 0.017µs	16.890µs	16.902µs	16.909µs	16.938µs	0.41%	-0.007	-0.798	0.13%	0.002µs	1	200
normalization/normalize_name/normalize_name/good	throughput	59039872.752op/s	59272301.653op/s ± 77177.012op/s	59279436.094op/s ± 61155.856op/s	59333317.877op/s	59411330.076op/s	59427166.660op/s	59432158.191op/s	0.26%	0.011	-0.800	0.13%	5457.239op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[281.273µs; 281.426µs] or [-0.027%; +0.027%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[3553352.665op/s; 3555269.867op/s] or [-0.027%; +0.027%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[27.636µs; 27.674µs] or [-0.069%; +0.069%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[36136197.509op/s; 36185769.319op/s] or [-0.069%; +0.069%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[16.868µs; 16.874µs] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[59261605.661op/s; 59282997.645op/s] or [-0.018%; +0.018%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.170µs	1.343µs ± 0.058µs	1.360µs ± 0.039µs	1.392µs	1.418µs	1.436µs	1.437µs	5.62%	-0.656	0.047	4.28%	0.004µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.335µs; 1.351µs] or [-0.594%; +0.594%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.639µs	2.697µs ± 0.023µs	2.701µs ± 0.008µs	2.708µs	2.739µs	2.750µs	2.751µs	1.87%	-0.512	0.715	0.86%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.694µs; 2.700µs] or [-0.119%; +0.119%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	137.706µs	138.204µs ± 0.303µs	138.149µs ± 0.141µs	138.313µs	138.689µs	139.371µs	140.182µs	1.47%	2.589	11.442	0.22%	0.021µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[138.162µs; 138.246µs] or [-0.030%; +0.030%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	73.380µs	73.541µs ± 0.168µs	73.507µs ± 0.044µs	73.555µs	73.785µs	73.877µs	75.035µs	2.08%	5.634	42.690	0.23%	0.012µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[73.518µs; 73.565µs] or [-0.032%; +0.032%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	ef9f5df	1725908595	aj/bump-contexts

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	1.212µs	1.213µs ± 0.003µs	1.212µs ± 0.000µs	1.213µs	1.213µs	1.213µs	1.252µs	3.23%	13.650	187.831	0.23%	0.000µs	1	200
credit_card/is_card_number/	throughput	799016070.995op/s	824638643.272op/s ± 1838867.938op/s	824791298.459op/s ± 204051.370op/s	824975575.427op/s	825115961.655op/s	825175667.830op/s	825217642.649op/s	0.05%	-13.625	187.377	0.22%	130027.599op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	108.100µs	109.419µs ± 0.750µs	109.274µs ± 0.489µs	109.928µs	110.673µs	111.712µs	112.539µs	2.99%	1.085	1.670	0.68%	0.053µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	8885817.058op/s	9139597.740op/s ± 62223.666op/s	9151347.366op/s ± 40740.624op/s	9184854.176op/s	9216705.760op/s	9238290.427op/s	9250667.757op/s	1.09%	-1.035	1.483	0.68%	4399.878op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	102.274µs	103.300µs ± 0.867µs	103.048µs ± 0.324µs	103.525µs	104.632µs	106.506µs	109.499µs	6.26%	2.945	13.964	0.84%	0.061µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	9132499.194op/s	9681166.977op/s ± 79390.378op/s	9704189.305op/s ± 30515.732op/s	9726718.333op/s	9756327.573op/s	9771325.735op/s	9777646.244op/s	0.76%	-2.772	12.331	0.82%	5613.747op/s	1	200
credit_card/is_card_number/37828224631	execution_time	1.212µs	1.213µs ± 0.002µs	1.212µs ± 0.000µs	1.213µs	1.213µs	1.213µs	1.246µs	2.79%	13.575	186.437	0.20%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	802442429.280op/s	824687941.922op/s ± 1599466.027op/s	824810598.830op/s ± 190118.708op/s	825007963.883op/s	825126052.689op/s	825205666.252op/s	825347535.555op/s	0.07%	-13.550	185.972	0.19%	113099.327op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	98.633µs	99.748µs ± 0.741µs	99.620µs ± 0.401µs	100.072µs	101.048µs	102.409µs	103.114µs	3.51%	1.400	2.938	0.74%	0.052µs	1	200
credit_card/is_card_number/378282246310005	throughput	9697959.453op/s	10025839.767op/s ± 73777.763op/s	10038139.978op/s ± 40544.113op/s	10076215.597op/s	10118987.176op/s	10129531.924op/s	10138578.304op/s	1.00%	-1.335	2.658	0.73%	5216.876op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	100.040µs	100.370µs ± 0.959µs	100.214µs ± 0.076µs	100.334µs	100.539µs	103.288µs	109.530µs	9.30%	8.855	80.635	0.95%	0.068µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	9129915.410op/s	9963929.485op/s ± 87811.480op/s	9978688.017op/s ± 7598.692op/s	9983918.403op/s	9988253.315op/s	9990204.066op/s	9996045.564op/s	0.17%	-8.735	78.864	0.88%	6209.209op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	19.196µs	19.481µs ± 0.127µs	19.481µs ± 0.087µs	19.552µs	19.644µs	19.895µs	20.044µs	2.89%	0.740	2.531	0.65%	0.009µs	1	200
credit_card/is_card_number/x371413321323331	throughput	49889472.666op/s	51334365.792op/s ± 333331.739op/s	51332535.263op/s ± 228851.516op/s	51581512.326op/s	51844212.821op/s	52023237.945op/s	52094264.874op/s	1.48%	-0.663	2.272	0.65%	23570.113op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	1.212µs	1.212µs ± 0.000µs	1.212µs ± 0.000µs	1.213µs	1.213µs	1.214µs	1.214µs	0.12%	0.646	0.385	0.03%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	823821653.302op/s	824756498.871op/s ± 256990.523op/s	824781699.452op/s ± 192134.188op/s	824961167.999op/s	825098355.285op/s	825195619.604op/s	825253435.670op/s	0.06%	-0.644	0.380	0.03%	18171.974op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	89.303µs	91.304µs ± 0.669µs	91.324µs ± 0.325µs	91.646µs	92.142µs	92.812µs	96.419µs	5.58%	2.167	16.585	0.73%	0.047µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	10371437.965op/s	10953028.745op/s ± 79098.249op/s	10949989.250op/s ± 38954.704op/s	10989996.637op/s	11074478.822op/s	11106105.351op/s	11197791.063op/s	2.26%	-1.878	14.208	0.72%	5593.091op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	83.018µs	85.061µs ± 0.485µs	85.058µs ± 0.262µs	85.332µs	85.685µs	85.957µs	87.919µs	3.36%	0.921	8.132	0.57%	0.034µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	11374116.675op/s	11756600.351op/s ± 66728.507op/s	11756695.974op/s ± 36241.593op/s	11790440.956op/s	11855259.928op/s	11903620.846op/s	12045538.669op/s	2.46%	-0.766	7.567	0.57%	4718.418op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	1.212µs	1.213µs ± 0.003µs	1.212µs ± 0.000µs	1.213µs	1.213µs	1.213µs	1.256µs	3.63%	13.784	190.314	0.26%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	795903682.145op/s	824646900.194op/s ± 2055847.950op/s	824780287.753op/s ± 199708.645op/s	824998288.339op/s	825096184.778op/s	825144901.493op/s	825224082.656op/s	0.05%	-13.766	189.976	0.25%	145370.403op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	79.868µs	81.068µs ± 0.558µs	81.063µs ± 0.354µs	81.378µs	81.891µs	82.412µs	83.793µs	3.37%	0.913	2.840	0.69%	0.039µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	11934192.935op/s	12335873.491op/s ± 84390.813op/s	12336069.556op/s ± 54152.711op/s	12395691.878op/s	12457620.901op/s	12495291.843op/s	12520679.316op/s	1.50%	-0.833	2.489	0.68%	5967.332op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	100.063µs	100.365µs ± 0.497µs	100.302µs ± 0.119µs	100.422µs	100.610µs	101.228µs	105.972µs	5.65%	8.902	90.198	0.49%	0.035µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	9436450.460op/s	9963818.553op/s ± 47325.662op/s	9969883.972op/s ± 11847.464op/s	9981622.585op/s	9987932.081op/s	9990263.160op/s	9993722.943op/s	0.24%	-8.713	87.055	0.47%	3346.430op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	19.235µs	19.288µs ± 0.086µs	19.248µs ± 0.009µs	19.308µs	19.420µs	19.648µs	19.784µs	2.78%	2.726	9.347	0.44%	0.006µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	50546186.115op/s	51845906.912op/s ± 228225.296op/s	51952927.044op/s ± 24560.995op/s	51970287.215op/s	51983583.624op/s	51986902.242op/s	51989296.816op/s	0.07%	-2.675	8.939	0.44%	16137.965op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[1.212µs; 1.213µs] or [-0.032%; +0.032%]	None	None	None
credit_card/is_card_number/	throughput	[824383793.861op/s; 824893492.683op/s] or [-0.031%; +0.031%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[109.315µs; 109.523µs] or [-0.095%; +0.095%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[9130974.139op/s; 9148221.342op/s] or [-0.094%; +0.094%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[103.180µs; 103.421µs] or [-0.116%; +0.116%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[9670164.234op/s; 9692169.720op/s] or [-0.114%; +0.114%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[1.212µs; 1.213µs] or [-0.028%; +0.028%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[824466271.314op/s; 824909612.531op/s] or [-0.027%; +0.027%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[99.645µs; 99.850µs] or [-0.103%; +0.103%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[10015614.879op/s; 10036064.656op/s] or [-0.102%; +0.102%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[100.238µs; 100.503µs] or [-0.132%; +0.132%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[9951759.658op/s; 9976099.311op/s] or [-0.122%; +0.122%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[19.463µs; 19.499µs] or [-0.090%; +0.090%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[51288169.219op/s; 51380562.365op/s] or [-0.090%; +0.090%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[1.212µs; 1.213µs] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[824720882.457op/s; 824792115.286op/s] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[91.211µs; 91.396µs] or [-0.102%; +0.102%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[10942066.489op/s; 10963991.002op/s] or [-0.100%; +0.100%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[84.994µs; 85.129µs] or [-0.079%; +0.079%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[11747352.421op/s; 11765848.280op/s] or [-0.079%; +0.079%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[1.212µs; 1.213µs] or [-0.036%; +0.036%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[824361979.440op/s; 824931820.948op/s] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[80.991µs; 81.146µs] or [-0.095%; +0.095%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[12324177.736op/s; 12347569.246op/s] or [-0.095%; +0.095%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[100.297µs; 100.434µs] or [-0.069%; +0.069%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[9957259.671op/s; 9970377.435op/s] or [-0.066%; +0.066%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[19.276µs; 19.300µs] or [-0.062%; +0.062%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[51814277.081op/s; 51877536.743op/s] or [-0.061%; +0.061%]	None	None	None

Baseline

Omitted due to size.