5+%15+%25+%35+%45+%03611
Comparing 95 results out of 19 benchmark classes for 'run1' and 'run2' on metric 'Score'.
Ignoring deviations below 5%
  • 50%
  • 20%
  • 10%
  • 5%
  • 0%
15101622283440465258647076828894-40040
scoreDifferrorDiff

Improved Benchmarks (14)

#BenchmarkParamsMode/UnitScoreError
0NoOpStrategyBenchmark - nullCheck 32%thrpt in ops/ms
220,419
291,734
59,888
6,033
1PullPushBenchmark - push 25%avgt in ms/op
214
171
85
3
2PullPushBenchmark - pull 16%avgt in ms/op
284
244
103
16
3ListCreationBenchmark - immutableList 14%thrpt in ops/s
2,981,815
3,386,679
531,678
140,766
4StringConstantBenchmark - buildStringWithSeperatorAsCharConstant 14%thrpt in ops/s
6,821,354
7,752,287
620,758
65,980
5NoOpStrategyBenchmark - noOpImplementation 13%thrpt in ops/ms
265,221
298,820
45,171
4,912
6StringConstantBenchmark - buildStringWithCharSeperator 11%thrpt in ops/s
7,076,940
7,870,497
320,159
141,378
7PullPushBenchmark - pullWithoutJit 11%avgt in ms/op
267
240
54
2
8NullIndexBenchmark - bitSet 9%avgt in ms/op
162
148
45
2
9SwitchVsPolymorphismBenchmark - polymorphic 8%thrpt in ops/ms
263,912
284,167
17,586
4,598
10StringConstantBenchmark - buildStringWithSeperatorAsStringConstant 8%thrpt in ops/s
5,744,394
6,205,068
395,051
67,230
11StringConstantBenchmark - buildStringWithStringSeperator 7%thrpt in ops/s
5,816,122
6,197,189
291,876
134,102
12ListCreationBenchmark - arrayList_preSized_reUsed 6%thrpt in ops/s
4,361,609
4,639,756
939,443
106,763
13ConcatenatedStringBenchmark - pluses 5%thrpt in ops/ms
1,175
1,233
103
16

Declined Benchmarks (2)

#BenchmarkParamsMode/UnitScoreError
0ListCreationBenchmark - arrayList -23%thrpt in ops/s
3,467,631
2,657,004
98,563
1,316,876
1ListCreationBenchmark - arrayList_preSized -11%thrpt in ops/s
4,434,114
3,927,975
162,358
419,868

Unchanged Benchmarks (79)

#BenchmarkParamsMode/UnitScoreError
0SwitchVsPolymorphismBenchmark - coupled 4%thrpt in ops/ms
217,695
227,400
17,936
4,826
1ThreeParamsSingleMethodBenchmark - sleep 4%a_milis=10:b_micros=100:c_nanos=3000avgt in us/op
11,783
11,304
1,241
2,525
2TwoParamsMultiMethodBenchmark - timer 4%a_milis=10:b_micros=100avgt in us/op
11,728
11,307
1,553
284
3ConcatenatedStringBenchmark - stringBuffer 4%thrpt in ops/ms
2,391
2,482
80
43
4ThreeParamsMultiMethodBenchmark - sleep 3%a_milis=10:b_micros=500:c_nanos=1000avgt in us/op
11,632
11,252
1,285
3,183
5ThreeParamsMultiMethodBenchmark - sleep 3%a_milis=10:b_micros=1000:c_nanos=1000avgt in us/op
12,854
12,520
2,161
2,283
6ThreeParamsMultiMethodBenchmark - timer 3%a_milis=10:b_micros=500:c_nanos=1000avgt in us/op
11,711
11,408
994
2,029
7ThreeParamsMultiMethodBenchmark - timer 3%a_milis=20:b_micros=100:c_nanos=1000avgt in us/op
23,436
22,819
2,266
1,880
8ThreeParamsSingleMethodBenchmark - sleep 3%a_milis=10:b_micros=500:c_nanos=3000avgt in us/op
11,743
11,428
3,046
3,108
9TwoParamsMultiMethodBenchmark - timer 3%a_milis=10:b_micros=500avgt in us/op
11,616
11,269
1,041
1,719
10TwoParamsMultiMethodBenchmark - timer 3%a_milis=10:b_micros=1000avgt in us/op
12,754
12,402
1,418
2,365
11PullPushBenchmark - pushWithoutJit 3%avgt in ms/op
10,706
10,442
503
122
12NoOpStrategyBenchmark - optional 2%thrpt in ops/ms
286,896
291,445
20,108
17,906
13SwitchVsPolymorphismBenchmark - switchStyle 2%thrpt in ops/ms
218,200
223,649
7,932
3,915
14MultithreadedBenchmark - with1Thread 2%thrpt in ops/us
98
100
64
64
15MultithreadedBenchmark - with2Threads 2%thrpt in ops/us
96
98
44
46
16ThreeParamsMultiMethodBenchmark - sleep 2%a_milis=10:b_micros=100:c_nanos=1000avgt in us/op
11,615
11,354
1,681
3,369
17ThreeParamsMultiMethodBenchmark - sleep 2%a_milis=10:b_micros=100:c_nanos=3000avgt in us/op
11,645
11,444
2,094
2,494
18ThreeParamsMultiMethodBenchmark - sleep 2%a_milis=10:b_micros=500:c_nanos=3000avgt in us/op
11,600
11,350
1,472
2,323
19ThreeParamsMultiMethodBenchmark - timer 2%a_milis=10:b_micros=100:c_nanos=1000avgt in us/op
11,610
11,426
845
867
20ThreeParamsSingleMethodBenchmark - sleep 2%a_milis=10:b_micros=500:c_nanos=1000avgt in us/op
11,554
11,328
2,748
3,058
21ThreeParamsSingleMethodBenchmark - sleep 2%a_milis=10:b_micros=1000:c_nanos=1000avgt in us/op
12,850
12,654
2,231
6,888
22ThreeParamsSingleMethodBenchmark - sleep 2%a_milis=10:b_micros=1000:c_nanos=3000avgt in us/op
12,830
12,574
1,731
6,070
23TwoParamsMultiMethodBenchmark - timer 2%a_milis=20:b_micros=500avgt in us/op
23,224
22,827
5,307
3,591
24TwoParamsSingleMethodBenchmark - sleep 2%a_milis=10:b_micros=100avgt in us/op
11,593
11,337
2,206
4,649
25ConcatenatedStringBenchmark - stringBuilder 2%thrpt in ops/ms
2,524
2,577
31
55
26OneParamMultiMethodBenchmark - sleep 1%a_milis=10avgt in us/op
11,576
11,441
782
2,515
27OneParamMultiMethodBenchmark - sleep 1%a_milis=20avgt in us/op
22,894
22,559
3,820
5,416
28ThreeParamsMultiMethodBenchmark - timer 1%a_milis=10:b_micros=100:c_nanos=3000avgt in us/op
11,688
11,559
2,515
1,106
29ThreeParamsMultiMethodBenchmark - timer 1%a_milis=10:b_micros=500:c_nanos=3000avgt in us/op
11,684
11,516
1,225
2,465
30ThreeParamsMultiMethodBenchmark - timer 1%a_milis=10:b_micros=1000:c_nanos=1000avgt in us/op
12,902
12,755
1,546
3,487
31ThreeParamsMultiMethodBenchmark - timer 1%a_milis=20:b_micros=1000:c_nanos=1000avgt in us/op
24,199
23,922
6,582
8,263
32TwoParamsSingleMethodBenchmark - sleep 1%a_milis=10:b_micros=500avgt in us/op
11,695
11,536
1,390
5,721
33QuickBenchmark - sleep100Milliseconds 0.9803921568627451%avgt in ms/op
103
102
NaN
NaN
34ThreeParamsMultiMethodBenchmark - timer 0.9384820698265098%a_milis=20:b_micros=100:c_nanos=3000avgt in us/op
23,447
23,229
3,452
4,827
35OneParamMultiMethodBenchmark - timer 0.7469244288224955%a_milis=10avgt in us/op
11,465
11,380
1,870
1,787
36TwoParamsMultiMethodBenchmark - sleep 0.6162273194111606%a_milis=10:b_micros=500avgt in us/op
11,756
11,684
2,476
2,523
37OneParamMultiMethodBenchmark - timer 0.59630815100627%a_milis=20avgt in us/op
22,943
22,807
4,485
4,502
38TwoParamsMultiMethodBenchmark - timer 0.5348523720485281%a_milis=20:b_micros=100avgt in us/op
23,120
22,997
3,526
1,155
39OneParamSingleMethodBenchmark - sleep 0.44592113316429133%a_milis=10avgt in us/op
11,488
11,437
3,094
3,562
40ThreeParamsMultiMethodBenchmark - timer 0.43453700082562036%a_milis=20:b_micros=500:c_nanos=3000avgt in us/op
23,113
23,013
6,464
1,769
41ThreeParamsSingleMethodBenchmark - sleep 0.43201256763833135%a_milis=20:b_micros=100:c_nanos=3000avgt in us/op
23,015
22,916
3,115
6,494
42TwoParamsSingleMethodBenchmark - sleep 0.38480635551142006%a_milis=20:b_micros=1000avgt in us/op
24,261
24,168
5,944
3,306
43ThreeParamsMultiMethodBenchmark - timer 0.3766478342749529%a_milis=10:b_micros=1000:c_nanos=3000avgt in us/op
12,792
12,744
269
4,471
44OneParamSingleMethodBenchmark - sleep 0.35651408450704225%a_milis=20avgt in us/op
22,801
22,720
1,119
6,051
45TwoParamsMultiMethodBenchmark - sleep 0.27445001089087345%a_milis=20:b_micros=100avgt in us/op
23,018
22,955
1,623
3,458
46TwoParamsMultiMethodBenchmark - sleep 0.22270742358078602%a_milis=20:b_micros=500avgt in us/op
22,951
22,900
5,389
3,459
47ThreeParamsMultiMethodBenchmark - sleep 0.18317935648295636%a_milis=10:b_micros=1000:c_nanos=3000avgt in us/op
12,579
12,556
1,269
2,552
48TwoParamsSingleMethodBenchmark - sleep 0.07392911502500543%a_milis=20:b_micros=500avgt in us/op
23,012
22,995
6,209
5,477
49ThreeParamsSingleMethodBenchmark - sleep 0.03469812630117974%a_milis=10:b_micros=100:c_nanos=1000avgt in us/op
11,532
11,528
1,122
2,110
50ThroughputBenchmark - sleep100Milliseconds 0%thrpt in ops/s
10
10
0.041
0.035
51ThroughputBenchmark - sleep100MillisecondsRandom 0%thrpt in ops/s
13
13
0.497
0.555
52ThroughputBenchmark - sleep50Milliseconds 0%thrpt in ops/s
19
19
0.103
0.092
53AvgTimeBenchmark - sleep100Milliseconds 0%avgt in ms/op
103
103
0.506
0.438
54AvgTimeBenchmark - sleep100MillisecondsRandom 0%avgt in ms/op
79
79
3
3
55AvgTimeBenchmark - sleep50Milliseconds 0%avgt in ms/op
53
53
0.286
0.269
56TwoParamsMultiMethodBenchmark - sleep -0.07875876191226273%a_milis=10:b_micros=1000avgt in us/op
12,687
12,697
2,316
5,565
57TwoParamsMultiMethodBenchmark - sleep -0.1119724375538329%a_milis=10:b_micros=100avgt in us/op
11,597
11,610
993
130
58ThreeParamsMultiMethodBenchmark - timer -0.2019369462188337%a_milis=20:b_micros=1000:c_nanos=3000avgt in us/op
24,216
24,265
5,636
8,541
59ThreeParamsSingleMethodBenchmark - sleep -0.2527673668613266%a_milis=20:b_micros=100:c_nanos=1000avgt in us/op
22,888
22,946
1,940
3,576
60ThreeParamsSingleMethodBenchmark - sleep -0.3195285915843638%a_milis=20:b_micros=1000:c_nanos=3000avgt in us/op
24,021
24,098
4,774
6,669
61ThreeParamsSingleMethodBenchmark - sleep -0.3993402205052522%a_milis=20:b_micros=500:c_nanos=1000avgt in us/op
22,946
23,038
4,398
3,234
62ThreeParamsMultiMethodBenchmark - sleep -0.4865876481597005%a_milis=20:b_micros=1000:c_nanos=3000avgt in us/op
23,928
24,045
9,974
10,707
63TwoParamsMultiMethodBenchmark - timer -0.5988271248038325%a_milis=20:b_micros=1000avgt in us/op
24,069
24,214
1,545
3,439
64TwoParamsSingleMethodBenchmark - sleep -0.7851142341210646%a_milis=10:b_micros=1000avgt in us/op
12,637
12,737
3,530
1,286
65ThreeParamsMultiMethodBenchmark - sleep -0.8064516129032258%a_milis=20:b_micros=100:c_nanos=1000avgt in us/op
22,755
22,940
4,169
6,046
66MultithreadedBenchmark - with4Threads -0.9523809523809524%thrpt in ops/us
105
104
36
35
67TwoParamsMultiMethodBenchmark - sleep -1%a_milis=20:b_micros=1000avgt in us/op
24,089
24,400
2,697
5,411
68ThreeParamsMultiMethodBenchmark - sleep -2%a_milis=20:b_micros=100:c_nanos=3000avgt in us/op
22,767
23,163
4,987
3,863
69ThreeParamsMultiMethodBenchmark - sleep -2%a_milis=20:b_micros=500:c_nanos=1000avgt in us/op
22,514
22,874
2,845
1,907
70ThreeParamsMultiMethodBenchmark - sleep -2%a_milis=20:b_micros=500:c_nanos=3000avgt in us/op
22,864
23,346
527
15,457
71ThreeParamsMultiMethodBenchmark - sleep -2%a_milis=20:b_micros=1000:c_nanos=1000avgt in us/op
23,818
24,224
4,732
3,369
72ThreeParamsMultiMethodBenchmark - timer -2%a_milis=20:b_micros=500:c_nanos=1000avgt in us/op
23,231
23,602
4,505
9,231
73ThreeParamsSingleMethodBenchmark - sleep -2%a_milis=20:b_micros=500:c_nanos=3000avgt in us/op
22,563
22,950
9,463
6,231
74TwoParamsSingleMethodBenchmark - sleep -2%a_milis=20:b_micros=100avgt in us/op
22,876
23,270
6,583
3,151
75QuickBenchmark - sleep50Milliseconds -2%avgt in ms/op
52
53
NaN
NaN
76ThreeParamsSingleMethodBenchmark - sleep -3%a_milis=20:b_micros=1000:c_nanos=1000avgt in us/op
23,408
24,103
11,300
8,960
77NullIndexBenchmark - arrayWithBooleans -3%avgt in ms/op
29
30
1
0.5
78NullIndexBenchmark - arrayWithNullIndices -3%avgt in ms/op
89
92
4
7