criterion performance measurements

overview

want to understand this report?

simple/nub [1]

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.9538390253704944e-8 2.9964289607149126e-8 3.049422150601968e-8
Standard deviation 1.2228424295283835e-9 1.6537579521149485e-9 2.688271554313723e-9

Outlying measurements have severe (0.7629970099533102%) effect on estimated standard deviation.

simple/nub [1..10]

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.511432705377696e-7 7.787022447786168e-7 8.266747170021263e-7
Standard deviation 7.131980728772985e-8 1.1061784143287854e-7 1.5577990401028333e-7

Outlying measurements have severe (0.9458451414056624%) effect on estimated standard deviation.

simple/nub [1..100]

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.567972800850474e-5 5.613755836968684e-5 5.661046053202799e-5
Standard deviation 1.2200897837010467e-6 1.5646670518414983e-6 2.1997987489500883e-6

Outlying measurements have moderate (0.26692696131705534%) effect on estimated standard deviation.

simple/nub [1..1000]

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.439433981450696e-3 5.508532249809967e-3 5.600609135128561e-3
Standard deviation 1.755482283341841e-4 2.487271640035093e-4 3.396214739401419e-4

Outlying measurements have moderate (0.2434905822245984%) effect on estimated standard deviation.

simple/nub (replicate 1000 1)

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7326690008090104e-5 1.83354305725363e-5 2.015291599559573e-5
Standard deviation 3.3466618248452475e-6 4.453111998806906e-6 5.854833231406101e-6

Outlying measurements have severe (0.9722142087440901%) effect on estimated standard deviation.

simple/ordNub [1]

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.8401959815955664e-8 2.8674653737739312e-8 2.8906693445690893e-8
Standard deviation 7.489470444250034e-10 8.841425536733371e-10 1.0799975584914536e-9

Outlying measurements have moderate (0.49879045742729045%) effect on estimated standard deviation.

simple/ordNub [1..10]

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.536338316040531e-7 7.95255663993442e-7 8.645543391747882e-7
Standard deviation 1.2168332681644128e-7 1.6848460101828196e-7 2.2027903237139612e-7

Outlying measurements have severe (0.9753139918646819%) effect on estimated standard deviation.

simple/ordNub [1..100]

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.550823334179018e-5 1.6002165592980053e-5 1.6794639727111873e-5
Standard deviation 1.1582271013772047e-6 2.032559800903987e-6 3.2797820177797584e-6

Outlying measurements have severe (0.903893525256634%) effect on estimated standard deviation.

simple/ordNub [1..1000]

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.9507860165089165e-4 3.0252207557022705e-4 3.132857851222624e-4
Standard deviation 2.3226606725932086e-5 2.93968833832837e-5 3.721997203903868e-5

Outlying measurements have severe (0.7786173475992616%) effect on estimated standard deviation.

simple/ordNub (replicate 1000 1)

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.579641844290436e-6 8.795976932962145e-6 9.125767956244074e-6
Standard deviation 5.722440899409726e-7 8.733662470005119e-7 1.414509388773075e-6

Outlying measurements have severe (0.8611089288193822%) effect on estimated standard deviation.

benchmarks:

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 9.368034191824593e-9 9.472011884555776e-9 9.594809069076618e-9
Standard deviation 2.917412824922963e-10 3.8186536849388024e-10 5.462828648695488e-10

Outlying measurements have severe (0.6506680760399949%) effect on estimated standard deviation.

100 nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.861032041169505e-3 7.1153818544269515e-3 7.3579505820914725e-3
Standard deviation 6.171644671984009e-4 7.63526292881621e-4 9.42690530222363e-4

Outlying measurements have severe (0.6235032113705147%) effect on estimated standard deviation.

50 nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.0203155561867646e-3 3.11637478961015e-3 3.2316172046950456e-3
Standard deviation 2.843959224970372e-4 3.404972226158986e-4 3.9976305494663635e-4

Outlying measurements have severe (0.7064297692737438%) effect on estimated standard deviation.

10 nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.255308687546898e-4 7.356095117370262e-4 7.606518965840378e-4
Standard deviation 3.241600413154997e-5 5.1409452107608914e-5 8.138079054741058e-5

Outlying measurements have severe (0.5773477561446417%) effect on estimated standard deviation.

5 nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.453151703881649e-4 4.613911436442041e-4 4.908285691154193e-4
Standard deviation 4.4579132111828226e-5 7.239875986739578e-5 1.268435579451944e-4

Outlying measurements have severe (0.8906886183894176%) effect on estimated standard deviation.

1 nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.677065029092447e-4 1.7461689343178414e-4 1.8559998269232465e-4
Standard deviation 1.8718104413134076e-5 2.8014243371077624e-5 4.575267503232129e-5

Outlying measurements have severe (0.9196331147137038%) effect on estimated standard deviation.

100 localNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.426608992720998e-3 5.477455234936536e-3 5.525373032419898e-3
Standard deviation 1.1695193383643923e-4 1.440556072009873e-4 1.786782418502069e-4

Outlying measurements have slight (9.647092931509078e-2%) effect on estimated standard deviation.

50 localNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.9484473470235747e-3 3.0485437753680145e-3 3.18656613940096e-3
Standard deviation 2.6017955879683745e-4 3.7535675105607885e-4 4.8059112210545226e-4

Outlying measurements have severe (0.748093787903916%) effect on estimated standard deviation.

10 localNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.285766821830511e-4 7.35264505059553e-4 7.420105964536344e-4
Standard deviation 1.8554128088997788e-5 2.2164331068263007e-5 2.6503691048058414e-5

Outlying measurements have moderate (0.20989434097188123%) effect on estimated standard deviation.

5 localNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.704256968015178e-4 4.977096375594316e-4 5.408902038384916e-4
Standard deviation 8.231694230586793e-5 1.0981078702679003e-4 1.3756075359491765e-4

Outlying measurements have severe (0.9489149868904114%) effect on estimated standard deviation.

1 localNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6433980773698851e-4 1.7456798362268795e-4 1.8959058105907638e-4
Standard deviation 2.8650936630667897e-5 3.889412873244639e-5 5.227519350580179e-5

Outlying measurements have severe (0.959514586707331%) effect on estimated standard deviation.

100 ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.3571939361809727e-4 3.7860176541825574e-4 4.4117917605037056e-4
Standard deviation 1.2554797196911917e-4 1.6404400091516352e-4 2.1561530226303012e-4

Outlying measurements have severe (0.9882453520004018%) effect on estimated standard deviation.

50 ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.0898715331882305e-4 2.1296991306845957e-4 2.1826560343251938e-4
Standard deviation 1.0118189436474813e-5 1.5273614391434458e-5 2.2275099379830116e-5

Outlying measurements have severe (0.6596332230125448%) effect on estimated standard deviation.

10 ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.5592994501456903e-4 1.601397368627151e-4 1.6848671178183657e-4
Standard deviation 1.357439774502115e-5 1.9320850991267672e-5 3.064914980563319e-5

Outlying measurements have severe (0.8615804299122175%) effect on estimated standard deviation.

5 ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.2925019935095824e-4 1.3136237683952627e-4 1.3471799080924928e-4
Standard deviation 6.159504456420941e-6 8.469790604035951e-6 1.3205779060985472e-5

Outlying measurements have severe (0.6375293650095084%) effect on estimated standard deviation.

1 ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.829336919724145e-5 9.160479140458591e-5 9.830705351639724e-5
Standard deviation 9.245923625401076e-6 1.4677577918835248e-5 2.387593815219693e-5

Outlying measurements have severe (0.9199996405711989%) effect on estimated standard deviation.

100 ordNubState

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.352280865280298e-3 3.395516018161514e-3 3.447137712547552e-3
Standard deviation 1.2729504614248616e-4 1.5724994742627444e-4 1.9866296957469216e-4

Outlying measurements have moderate (0.2787549813008253%) effect on estimated standard deviation.

50 ordNubState

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.0038936028490104e-3 3.0330091637194145e-3 3.0651991966370237e-3
Standard deviation 8.1382647618494e-5 1.0095535206325737e-4 1.3399561807237202e-4

Outlying measurements have moderate (0.17086131345212915%) effect on estimated standard deviation.

10 ordNubState

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.392331244070471e-3 3.663438742318631e-3 3.996922943931282e-3
Standard deviation 7.863679664706304e-4 9.803566507070411e-4 1.2690573679595498e-3

Outlying measurements have severe (0.9321016457473263%) effect on estimated standard deviation.

5 ordNubState

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.736840781611404e-3 2.827909006247689e-3 3.2536326382475445e-3
Standard deviation 1.0481914882636502e-4 5.121631924979408e-4 1.1323126600039015e-3

Outlying measurements have severe (0.8750810284261892%) effect on estimated standard deviation.

1 ordNubState

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.6818446655145853e-3 2.7970914553785086e-3 3.165341331483668e-3
Standard deviation 1.9940421639270918e-4 5.788392184528385e-4 1.2192808983907896e-3

Outlying measurements have severe (0.8961407895051099%) effect on estimated standard deviation.

100 ordNubStateLazy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.050635404503416e-3 2.1335514995513612e-3 2.246879343287903e-3
Standard deviation 2.636088934923806e-4 3.2909385726396834e-4 4.063089237302643e-4

Outlying measurements have severe (0.8485268682913212%) effect on estimated standard deviation.

50 ordNubStateLazy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.8504589867159838e-3 1.8736609220677443e-3 1.912963075340934e-3
Standard deviation 7.107660200940256e-5 1.0068094965372446e-4 1.4474570831020145e-4

Outlying measurements have moderate (0.3916030827478962%) effect on estimated standard deviation.

10 ordNubStateLazy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.8128291844588332e-3 1.9337413539485247e-3 2.150498122014708e-3
Standard deviation 2.9373024219545203e-4 5.299012026817268e-4 9.458656719543616e-4

Outlying measurements have severe (0.9440920737045846%) effect on estimated standard deviation.

5 ordNubStateLazy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.122843124574581e-3 2.2929015062451755e-3 2.5007415966167034e-3
Standard deviation 4.945033359771851e-4 6.27638210218712e-4 7.994897862249737e-4

Outlying measurements have severe (0.9430930807384138%) effect on estimated standard deviation.

1 ordNubStateLazy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.887888844106105e-3 2.0524022350711752e-3 2.3297578143052925e-3
Standard deviation 4.6093156676179557e-4 7.118836992512218e-4 1.1300503840631203e-3

Outlying measurements have severe (0.9627908556224303%) effect on estimated standard deviation.

100 ordNubStateDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.28575155490763e-4 5.396869742676937e-4 5.536216711673901e-4
Standard deviation 3.0095844196162017e-5 4.186301345754467e-5 5.980559427453519e-5

Outlying measurements have severe (0.6489122698286274%) effect on estimated standard deviation.

50 ordNubStateDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.2750764969639666e-4 4.499113348368132e-4 4.892969087720771e-4
Standard deviation 6.65111979512009e-5 9.717800198864023e-5 1.5547824420980048e-4

Outlying measurements have severe (0.9391088789111254%) effect on estimated standard deviation.

10 ordNubStateDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.8227742806216503e-4 2.933158506210654e-4 3.1974998906381623e-4
Standard deviation 2.8874678194390368e-5 5.521493643367e-5 1.010610814243553e-4

Outlying measurements have severe (0.9334630882266249%) effect on estimated standard deviation.

5 ordNubStateDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.4290185874175266e-4 2.5008541977949463e-4 2.6234319127132116e-4
Standard deviation 2.0636782367942367e-5 3.0297312397370062e-5 4.29137861606895e-5

Outlying measurements have severe (0.849161644047337%) effect on estimated standard deviation.

1 ordNubStateDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.823294689651195e-4 3.224480841492207e-4 3.827927453018867e-4
Standard deviation 1.1287109238200328e-4 1.574700628787995e-4 2.2559376141255638e-4

Outlying measurements have severe (0.9887984902992001%) effect on estimated standard deviation.

100 ordNubStateLazyDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.484763211313228e-4 6.186179620746247e-4 8.125930578281224e-4
Standard deviation 1.0811766053741374e-4 3.595733875591746e-4 6.971168439274698e-4

Outlying measurements have severe (0.9872545540206765%) effect on estimated standard deviation.

50 ordNubStateLazyDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.0811786952279084e-4 4.1251584570692275e-4 4.1731131811361793e-4
Standard deviation 1.1550612674403947e-5 1.4541683349777118e-5 1.835946365498344e-5

Outlying measurements have moderate (0.2829815544401141%) effect on estimated standard deviation.

10 ordNubStateLazyDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.714065124723912e-4 2.74505923206693e-4 2.7762688207905384e-4
Standard deviation 8.724260479977397e-6 1.056796588276486e-5 1.324645894076839e-5

Outlying measurements have moderate (0.3466745758765781%) effect on estimated standard deviation.

5 ordNubStateLazyDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.3743425177726813e-4 2.4015355301317768e-4 2.43505241900999e-4
Standard deviation 7.934807214664425e-6 9.93368082666888e-6 1.2955669144324162e-5

Outlying measurements have moderate (0.3889815454929892%) effect on estimated standard deviation.

1 ordNubStateLazyDlist

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.864327462139226e-4 1.891408258059789e-4 1.9267449887292e-4
Standard deviation 7.950806440468816e-6 1.0115524577448404e-5 1.3758372376721908e-5

Outlying measurements have severe (0.5232318926020159%) effect on estimated standard deviation.

100 MiniSet.ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3358460491470392e-3 1.3559508863484429e-3 1.3793975162175762e-3
Standard deviation 5.328977241600435e-5 7.236654225191159e-5 1.0713357886547119e-4

Outlying measurements have moderate (0.4151086345124085%) effect on estimated standard deviation.

50 MiniSet.ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1480255588321936e-3 1.164041205223554e-3 1.1840120324771014e-3
Standard deviation 4.8874464934765505e-5 6.115228629827206e-5 8.16230445970462e-5

Outlying measurements have moderate (0.41132798321735314%) effect on estimated standard deviation.

10 MiniSet.ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.238425253907093e-4 6.423995925658101e-4 6.716600194317927e-4
Standard deviation 5.438609781099865e-5 7.593463687001307e-5 1.0973122285992847e-4

Outlying measurements have severe (0.8132019281756572%) effect on estimated standard deviation.

5 MiniSet.ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.599494454971948e-4 7.014715957528401e-4 7.438782644622545e-4
Standard deviation 1.2222665780194087e-4 1.3936375880099864e-4 1.6599307509274923e-4

Outlying measurements have severe (0.9323122029155394%) effect on estimated standard deviation.

1 MiniSet.ordNub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.8492469614945e-4 2.9066492124490116e-4 3.0098241213665584e-4
Standard deviation 1.7245440545063474e-5 2.4885409896319106e-5 3.7148817497174654e-5

Outlying measurements have severe (0.7274377417855757%) effect on estimated standard deviation.

100 MiniSet.ordNubStrictAcc

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4586820715172537e-3 1.5322372784499461e-3 1.6445967060755551e-3
Standard deviation 2.0562197276153228e-4 2.75802666694062e-4 3.628094193281202e-4

Outlying measurements have severe (0.8968801561072566%) effect on estimated standard deviation.

50 MiniSet.ordNubStrictAcc

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1764675131224944e-3 1.2137664417124594e-3 1.270283806942402e-3
Standard deviation 1.0141160020119936e-4 1.5149461146499407e-4 2.364861096999264e-4

Outlying measurements have severe (0.7962458342618802%) effect on estimated standard deviation.

10 MiniSet.ordNubStrictAcc

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.871149354723279e-4 7.297603063846669e-4 7.972548322995881e-4
Standard deviation 1.2140974334875998e-4 1.735053877835064e-4 2.856190376395536e-4

Outlying measurements have severe (0.9455283635633789%) effect on estimated standard deviation.

5 MiniSet.ordNubStrictAcc

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.762731165979603e-4 4.856657882695247e-4 4.983051013084419e-4
Standard deviation 2.792295480519784e-5 3.504173287458941e-5 4.844784914248168e-5

Outlying measurements have severe (0.6210428123973718%) effect on estimated standard deviation.

1 MiniSet.ordNubStrictAcc

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.702836662551869e-4 2.749982840204266e-4 2.8661430973072846e-4
Standard deviation 1.240208186757855e-5 2.2535879851514563e-5 4.294369849505698e-5

Outlying measurements have severe (0.7062296797108977%) effect on estimated standard deviation.

100 nubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.9359557717394213e-3 1.9619331838214987e-3 2.009920032111786e-3
Standard deviation 6.673291356621245e-5 1.14340741881443e-4 2.1544459763037864e-4

Outlying measurements have moderate (0.42307112367769734%) effect on estimated standard deviation.

50 nubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1777566512064341e-3 1.2158473005398204e-3 1.2643346879772383e-3
Standard deviation 1.2589090140041875e-4 1.468253105685582e-4 1.807165498750778e-4

Outlying measurements have severe (0.7985155182445735%) effect on estimated standard deviation.

10 nubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.3736102341054406e-4 3.4343177448407453e-4 3.521399644672782e-4
Standard deviation 1.9242866650025537e-5 2.6079977625446026e-5 3.7433808744171166e-5

Outlying measurements have severe (0.6709722753448122%) effect on estimated standard deviation.

5 nubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7430409377677095e-4 1.7792290835718923e-4 1.8542811736855456e-4
Standard deviation 8.94343087849086e-6 1.6982207885367897e-5 3.169796989904224e-5

Outlying measurements have severe (0.7895459124449026%) effect on estimated standard deviation.

1 nubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1341891995228472e-4 1.1483891213090678e-4 1.1695684331444071e-4
Standard deviation 3.569421922201355e-6 5.940116653975877e-6 9.86196181384917e-6

Outlying measurements have severe (0.5287074020692035%) effect on estimated standard deviation.

100 ordNubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.657916377844172e-4 4.7475995515501725e-4 4.899706241879229e-4
Standard deviation 2.9436633470195052e-5 4.048756608262966e-5 6.128622429543701e-5

Outlying measurements have severe (0.7079461020571106%) effect on estimated standard deviation.

50 ordNubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.916686348452903e-4 3.9979888005007034e-4 4.081479602122784e-4
Standard deviation 2.2453858440060027e-5 2.8491119438301635e-5 3.502442389779507e-5

Outlying measurements have severe (0.6262698428590477%) effect on estimated standard deviation.

10 ordNubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.9936996271381043e-4 3.031031007694194e-4 3.088826638162759e-4
Standard deviation 1.117304104688507e-5 1.4883661585164476e-5 1.9840520722104883e-5

Outlying measurements have moderate (0.4583791369160011%) effect on estimated standard deviation.

5 ordNubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.702855146434247e-4 2.76434572888138e-4 2.8462534467412376e-4
Standard deviation 1.916913449085262e-5 2.4787471534984956e-5 3.317442040572897e-5

Outlying measurements have severe (0.7512268671832103%) effect on estimated standard deviation.

1 ordNubBy

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.4212983005887493e-4 2.604347201682326e-4 3.045888905107626e-4
Standard deviation 4.367564121344902e-5 8.291554060957447e-5 1.523532376788737e-4

Outlying measurements have severe (0.9780824165400722%) effect on estimated standard deviation.

other/nub yitz 1

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.5656270873819612e-3 1.5990407758594476e-3 1.654214911373341e-3
Standard deviation 9.172172884399035e-5 1.3806721244737387e-4 2.1277314116868495e-4

Outlying measurements have severe (0.6409640324196367%) effect on estimated standard deviation.

other/ordNub yitz 1

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.2601576796285304e-3 1.284825290224741e-3 1.3409975572639824e-3
Standard deviation 6.956817956552106e-5 1.181484193808948e-4 2.145056131977897e-4

Outlying measurements have severe (0.6833697816542236%) effect on estimated standard deviation.

other/nub yitz 2

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.583603381908511e-3 2.6118568390821398e-3 2.640095455941541e-3
Standard deviation 8.074113086120575e-5 9.416903875690297e-5 1.1205402450507123e-4

Outlying measurements have moderate (0.2011947159971146%) effect on estimated standard deviation.

other/ordNub yitz 2

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0861849982099314e-3 1.095974472775208e-3 1.1057756692386897e-3
Standard deviation 2.9117887510893068e-5 3.309539114180267e-5 3.853185099597455e-5

Outlying measurements have moderate (0.1926751668978184%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.