criterion performance measurements

overview

want to understand this report?

dups/strict/10/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.474544650129206e-6 5.959693093900324e-6 6.733444930358829e-6
Standard deviation 1.7288931420419897e-6 2.5501035593315705e-6 3.936080260354494e-6

Outlying measurements have severe (0.9943222584398813%) effect on estimated standard deviation.

dups/strict/10/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.517418015831088e-6 6.064948213854591e-6 6.991420468436517e-6
Standard deviation 1.8051495889916488e-6 2.5021183522245377e-6 3.6035905687907986e-6

Outlying measurements have severe (0.9941667159358449%) effect on estimated standard deviation.

dups/strict/10/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 9.138201017699102e-7 1.037929526357093e-6 1.1829843356314736e-6
Standard deviation 4.094557919219202e-7 5.248192078994e-7 6.646527186146878e-7

Outlying measurements have severe (0.9953483400215476%) effect on estimated standard deviation.

dups/strict/10/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0786505875939964e-6 1.1796080385653662e-6 1.3529733485089619e-6
Standard deviation 4.375173588415336e-7 5.805736639399646e-7 8.777114443867155e-7

Outlying measurements have severe (0.9952714175731048%) effect on estimated standard deviation.

dups/strict/10/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.9014103604841583e-6 2.0240487668665093e-6 2.2985263851964816e-6
Standard deviation 3.858501079143428e-7 7.099131385947315e-7 1.0888440960518102e-6

Outlying measurements have severe (0.9900251645809441%) effect on estimated standard deviation.

dups/strict/10/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.36537362925521e-6 1.4450359955138502e-6 1.583245147876277e-6
Standard deviation 2.6689074232617033e-7 4.295130824064795e-7 6.365513274313976e-7

Outlying measurements have severe (0.990074692196904%) effect on estimated standard deviation.

dups/strict/10/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.9109507341005496e-4 2.154519174645241e-4 2.7584721995952023e-4
Standard deviation 6.986702048348531e-5 1.332562739950385e-4 2.3349330626365225e-4

Outlying measurements have severe (0.9911098257987896%) effect on estimated standard deviation.

dups/strict/20/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.168823270958943e-6 7.700638537740377e-6 8.507880897384088e-6
Standard deviation 1.736844065078071e-6 2.6466830309073155e-6 3.9819424818522526e-6

Outlying measurements have severe (0.9884895781860452%) effect on estimated standard deviation.

dups/strict/20/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.257894734767775e-6 6.364971676745059e-6 6.4976055805294e-6
Standard deviation 3.529587651134728e-7 4.753525965138611e-7 6.283985389498419e-7

Outlying measurements have severe (0.798769832968918%) effect on estimated standard deviation.

dups/strict/20/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.071473644529301e-6 2.0974407388421767e-6 2.120856224002051e-6
Standard deviation 8.242716160379407e-8 9.676950905420948e-8 1.1875965038498565e-7

Outlying measurements have severe (0.6238629717932688%) effect on estimated standard deviation.

dups/strict/20/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.5057770044765194e-6 2.5977587891465115e-6 2.7865771222554172e-6
Standard deviation 3.061148503608149e-7 4.999625123920164e-7 9.264841704328994e-7

Outlying measurements have severe (0.9686402634899289%) effect on estimated standard deviation.

dups/strict/20/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.222290580897776e-6 5.354678912412136e-6 5.502273629284784e-6
Standard deviation 4.3543428696786687e-7 5.560261587119455e-7 7.034467886063701e-7

Outlying measurements have severe (0.8892067682179327%) effect on estimated standard deviation.

dups/strict/20/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.4522739491589667e-6 3.596808156197886e-6 3.734989177946532e-6
Standard deviation 4.5563218084856335e-7 5.435502541485853e-7 6.742740354032849e-7

Outlying measurements have severe (0.947175111043326%) effect on estimated standard deviation.

dups/strict/20/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.040474271057844e-4 5.316128594333664e-4 5.772205281266932e-4
Standard deviation 7.065153789817932e-5 1.2758757598496867e-4 2.1303036730870012e-4

Outlying measurements have severe (0.9566370092366165%) effect on estimated standard deviation.

dups/strict/50/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0285704264654478e-5 1.1606697453357812e-5 1.4211900802950949e-5
Standard deviation 4.283378744197547e-6 6.660127419848645e-6 1.0759913040145996e-5

Outlying measurements have severe (0.9941512558126204%) effect on estimated standard deviation.

dups/strict/50/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 9.782528787148519e-6 1.0538047550270062e-5 1.1566218626438577e-5
Standard deviation 2.4612209112792494e-6 3.1985498258797472e-6 4.140829429308333e-6

Outlying measurements have severe (0.9878325094189947%) effect on estimated standard deviation.

dups/strict/50/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1216442457787328e-5 1.1375124705494028e-5 1.1576669961245612e-5
Standard deviation 5.301029315336894e-7 7.018072200626337e-7 8.960850188126412e-7

Outlying measurements have severe (0.7149366059691389%) effect on estimated standard deviation.

dups/strict/50/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.2187568275047015e-5 1.2329800941390624e-5 1.2477414697067599e-5
Standard deviation 4.926586419741728e-7 5.615026800298741e-7 6.674787531968839e-7

Outlying measurements have severe (0.5713276449314679%) effect on estimated standard deviation.

dups/strict/50/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0120146103084744e-5 1.0406648769366566e-5 1.0839409517954397e-5
Standard deviation 1.042041954777311e-6 1.3816782236416494e-6 1.7610284853322561e-6

Outlying measurements have severe (0.9226873552942831%) effect on estimated standard deviation.

dups/strict/50/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.161579034618813e-6 8.451521011623197e-6 8.927688278655433e-6
Standard deviation 1.0693854269754723e-6 1.4098464208762377e-6 1.8528028269215985e-6

Outlying measurements have severe (0.9532240768874557%) effect on estimated standard deviation.

dups/strict/50/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1609475656832028e-3 1.1922946114889161e-3 1.2473883904056387e-3
Standard deviation 1.2255781182965393e-4 1.5999126468867585e-4 2.2215370147331536e-4

Outlying measurements have severe (0.856196689326488%) effect on estimated standard deviation.

dups/strict/100/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.530964017092935e-5 1.566276864787441e-5 1.6265947671651985e-5
Standard deviation 1.3665817586053864e-6 1.8289796786184685e-6 2.671701527937305e-6

Outlying measurements have severe (0.8997681663374048%) effect on estimated standard deviation.

dups/strict/100/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3891052587471752e-5 1.4286341991318635e-5 1.4736067909074954e-5
Standard deviation 1.3329640306853542e-6 1.5877594053044229e-6 1.977115986734869e-6

Outlying measurements have severe (0.8888145850657215%) effect on estimated standard deviation.

dups/strict/100/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.8197956146859893e-5 2.8642385735557517e-5 2.9335461877661913e-5
Standard deviation 1.563269202329354e-6 2.1799514793166478e-6 3.5116265261520588e-6

Outlying measurements have severe (0.7728942614421981%) effect on estimated standard deviation.

dups/strict/100/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.511420019494728e-5 2.61435750250793e-5 2.7712078916815406e-5
Standard deviation 3.214305700041064e-6 4.92812446706726e-6 7.142133376521665e-6

Outlying measurements have severe (0.9594495732940348%) effect on estimated standard deviation.

dups/strict/100/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7502880904425853e-5 1.821163985901349e-5 2.0080259627098446e-5
Standard deviation 2.096473656045583e-6 4.451549168319411e-6 9.212886150800553e-6

Outlying measurements have severe (0.9744032334829713%) effect on estimated standard deviation.

dups/strict/100/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.539808659315679e-5 1.5778209484635805e-5 1.635616102822798e-5
Standard deviation 1.4749094523545248e-6 1.7965512861334598e-6 2.2763791476779446e-6

Outlying measurements have severe (0.8936395132185024%) effect on estimated standard deviation.

dups/strict/100/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.981466242006055e-3 2.055415915132948e-3 2.2157091302651413e-3
Standard deviation 2.5926505479643324e-4 3.940999595612071e-4 6.663165079260535e-4

Outlying measurements have severe (0.9079084776213543%) effect on estimated standard deviation.

dups/strict/500/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.794580236447846e-5 6.967640980418085e-5 7.245893879253419e-5
Standard deviation 5.975184375047648e-6 8.394434647827302e-6 1.1267761976355702e-5

Outlying measurements have severe (0.885923111645022%) effect on estimated standard deviation.

dups/strict/500/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.462702850620882e-5 5.572338386753653e-5 5.7650733421580885e-5
Standard deviation 3.5288152309116882e-6 5.588066192408643e-6 7.801023273108958e-6

Outlying measurements have severe (0.8452385473442316%) effect on estimated standard deviation.

dups/strict/500/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.7021660346092796e-4 4.941504344630471e-4 5.362730496254283e-4
Standard deviation 7.363447438230741e-5 1.0983072792104108e-4 1.5547275056739185e-4

Outlying measurements have severe (0.9570850364317613%) effect on estimated standard deviation.

dups/strict/500/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.5169851552446692e-4 1.5415965483155187e-4 1.5705688005989785e-4
Standard deviation 8.749714107662702e-6 1.085920523669341e-5 1.4688518291189937e-5

Outlying measurements have severe (0.6920922815453859%) effect on estimated standard deviation.

dups/strict/500/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.648818914984625e-5 8.895604828377714e-5 9.464090089378348e-5
Standard deviation 9.243499300076842e-6 1.3931586435609257e-5 2.2631948834040835e-5

Outlying measurements have severe (0.9286989166070133%) effect on estimated standard deviation.

dups/strict/500/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.068709511000212e-5 8.156587182153864e-5 8.314704036429996e-5
Standard deviation 3.2528760109375446e-6 4.592040745646802e-6 7.788960076818538e-6

Outlying measurements have severe (0.6151531797480044%) effect on estimated standard deviation.

dups/strict/500/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.363840199601742e-3 4.445739596148177e-3 4.5269429606071936e-3
Standard deviation 2.3389799228256948e-4 2.8374004143060986e-4 3.4031648618913356e-4

Outlying measurements have moderate (0.4571416040566999%) effect on estimated standard deviation.

dubFree/strict/10/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.2261628877232795e-6 5.4630902016169625e-6 5.769936653627016e-6
Standard deviation 8.210263869075577e-7 1.041028761386874e-6 1.2724196517079426e-6

Outlying measurements have severe (0.9664728270167993%) effect on estimated standard deviation.

dubFree/strict/10/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.1838416789533475e-6 5.360831174019645e-6 5.665680891625669e-6
Standard deviation 5.150746468647466e-7 8.841958088909187e-7 1.5072198991077104e-6

Outlying measurements have severe (0.9555859494722447%) effect on estimated standard deviation.

dubFree/strict/10/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.00666129068711e-7 7.164021575856451e-7 7.345071800357287e-7
Standard deviation 4.9832820723040654e-8 6.749101098413787e-8 9.130174670245973e-8

Outlying measurements have severe (0.8862002425830744%) effect on estimated standard deviation.

dubFree/strict/10/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 9.260995503870448e-7 9.536432217408014e-7 9.92606281834311e-7
Standard deviation 9.066311331157434e-8 1.1978817561399154e-7 1.6021800478921985e-7

Outlying measurements have severe (0.9341973338993241%) effect on estimated standard deviation.

dubFree/strict/10/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6529436832364726e-6 1.6806307230586833e-6 1.7218478012640043e-6
Standard deviation 7.622046742036476e-8 1.233389472828558e-7 2.0725686674125646e-7

Outlying measurements have severe (0.8141105698672306%) effect on estimated standard deviation.

dubFree/strict/10/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3137806948419235e-6 1.3401112304097193e-6 1.3860196289060694e-6
Standard deviation 7.92435170975966e-8 1.3679344574681675e-7 2.2513833928796812e-7

Outlying measurements have severe (0.8985124102895204%) effect on estimated standard deviation.

dubFree/strict/10/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6730102175300157e-4 1.7169704742702618e-4 1.7729648806561458e-4
Standard deviation 1.5474470528969054e-5 1.865656729310397e-5 2.3072564108333445e-5

Outlying measurements have severe (0.8420321929724579%) effect on estimated standard deviation.

dubFree/strict/20/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.18272693743176e-6 6.3259525250193764e-6 6.546381872269191e-6
Standard deviation 4.4324880513744926e-7 6.547454614709724e-7 1.0463427477275314e-6

Outlying measurements have severe (0.8874215848499757%) effect on estimated standard deviation.

dubFree/strict/20/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.484625530393358e-6 6.633538746946634e-6 6.904199735338216e-6
Standard deviation 5.701775381153763e-7 7.915662416955116e-7 1.190578259073541e-6

Outlying measurements have severe (0.9095316452518679%) effect on estimated standard deviation.

dubFree/strict/20/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.0919962317157725e-6 2.132401270409407e-6 2.1928851620427154e-6
Standard deviation 1.2855647823568924e-7 1.7281500511792273e-7 2.6458259406991494e-7

Outlying measurements have severe (0.8394799339360389%) effect on estimated standard deviation.

dubFree/strict/20/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.539242885956867e-6 2.6034866068376597e-6 2.6755938987827033e-6
Standard deviation 2.1463779459847556e-7 2.8719073976437063e-7 3.5876003234742854e-7

Outlying measurements have severe (0.9074297272964665%) effect on estimated standard deviation.

dubFree/strict/20/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.03710195780896e-6 4.154754759674464e-6 4.412881003939527e-6
Standard deviation 3.629169111045065e-7 6.233876418908489e-7 1.0739832379559178e-6

Outlying measurements have severe (0.9460640520718353%) effect on estimated standard deviation.

dubFree/strict/20/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.8847422154983696e-6 2.973906865936049e-6 3.199750284510415e-6
Standard deviation 2.291519717689774e-7 5.23184135885561e-7 1.095120125187115e-6

Outlying measurements have severe (0.9631988345434567%) effect on estimated standard deviation.

dubFree/strict/20/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.957889126604071e-4 5.108706632658829e-4 5.318339299052637e-4
Standard deviation 4.9358599232134207e-5 7.46861255620002e-5 1.0937790711255595e-4

Outlying measurements have severe (0.8919439956038157%) effect on estimated standard deviation.

dubFree/strict/50/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.914569925989733e-6 9.08726341253625e-6 9.476117300946682e-6
Standard deviation 5.736115215801024e-7 9.73782805841872e-7 1.6270475362632277e-6

Outlying measurements have severe (0.8883966601447751%) effect on estimated standard deviation.

dubFree/strict/50/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.821246174707197e-6 9.010625968348197e-6 9.310030396858452e-6
Standard deviation 6.60887419307144e-7 9.208107749292447e-7 1.421168021313568e-6

Outlying measurements have severe (0.8768474982865124%) effect on estimated standard deviation.

dubFree/strict/50/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1707515203203062e-5 1.2122830419610292e-5 1.2766894377207346e-5
Standard deviation 1.3689914620091512e-6 2.197337063633963e-6 3.1996387160204678e-6

Outlying measurements have severe (0.957495395589313%) effect on estimated standard deviation.

dubFree/strict/50/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.227261310563347e-5 1.2534278465523908e-5 1.2888978130737578e-5
Standard deviation 9.004383710896816e-7 1.2241333473651894e-6 1.6818773972597156e-6

Outlying measurements have severe (0.8656183584297297%) effect on estimated standard deviation.

dubFree/strict/50/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 9.711529583550982e-6 1.0001734189452807e-5 1.033712735085223e-5
Standard deviation 9.322509443681498e-7 1.3348544692025423e-6 1.936320928093538e-6

Outlying measurements have severe (0.9231596674841086%) effect on estimated standard deviation.

dubFree/strict/50/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.624749949389581e-6 7.826336956479706e-6 8.155395961577697e-6
Standard deviation 6.404310561826388e-7 1.005310925465664e-6 1.5115608583520944e-6

Outlying measurements have severe (0.9190840389397374%) effect on estimated standard deviation.

dubFree/strict/50/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1020017408610598e-3 1.1275748982968318e-3 1.1772588285900412e-3
Standard deviation 7.683096260263082e-5 1.3383166960213402e-4 2.3934286040297676e-4

Outlying measurements have severe (0.8177916158810291%) effect on estimated standard deviation.

dubFree/strict/100/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6721468260305352e-5 1.8306825453598074e-5 2.182954159730801e-5
Standard deviation 3.8575115828138375e-6 9.403370697877584e-6 1.6786146233362975e-5

Outlying measurements have severe (0.9936992944930221%) effect on estimated standard deviation.

dubFree/strict/100/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3655694643074074e-5 1.3968334746681045e-5 1.428297664933945e-5
Standard deviation 9.904782297451952e-7 1.249653116785118e-6 1.7325859055408775e-6

Outlying measurements have severe (0.8406591414056223%) effect on estimated standard deviation.

dubFree/strict/100/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.8007599744433574e-5 2.8419754447999334e-5 2.9118305153821846e-5
Standard deviation 1.3066318176500324e-6 1.9262267449832565e-6 2.978110012909432e-6

Outlying measurements have severe (0.7331914620129995%) effect on estimated standard deviation.

dubFree/strict/100/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.4143399555092705e-5 2.448509457868315e-5 2.5007165018704735e-5
Standard deviation 1.084243146420212e-6 1.6071605600090642e-6 2.5964636730983662e-6

Outlying measurements have severe (0.7191296031204023%) effect on estimated standard deviation.

dubFree/strict/100/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.723389223907058e-5 1.7935644979511484e-5 2.0011993008742042e-5
Standard deviation 1.7284861838253947e-6 4.262216256558047e-6 8.246532877570476e-6

Outlying measurements have severe (0.9744695340499022%) effect on estimated standard deviation.

dubFree/strict/100/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.5018099413174913e-5 1.54522674366378e-5 1.6120957578216504e-5
Standard deviation 1.4475481340557096e-6 2.1261964793740905e-6 3.165855169393208e-6

Outlying measurements have severe (0.9252183764131182%) effect on estimated standard deviation.

dubFree/strict/100/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.886689578318841e-3 1.9306955524737478e-3 2.04500852833417e-3
Standard deviation 1.3228453825101828e-4 2.5450575401976533e-4 4.687253672074674e-4

Outlying measurements have severe (0.8222404811367953%) effect on estimated standard deviation.

dubFree/strict/500/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.503524393955221e-5 6.616721316387398e-5 6.809345476422697e-5
Standard deviation 3.6349559200458725e-6 5.937268966393382e-6 1.0713007285181389e-5

Outlying measurements have severe (0.8120757242238705%) effect on estimated standard deviation.

dubFree/strict/500/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.284886823091425e-5 5.359665015052836e-5 5.4717973537052377e-5
Standard deviation 2.6330979985806377e-6 3.2912386212399527e-6 4.9840136541986265e-6

Outlying measurements have severe (0.6672282838097958%) effect on estimated standard deviation.

dubFree/strict/500/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.350008297187199e-4 4.4627506112942205e-4 4.657894855801483e-4
Standard deviation 3.6462011848065705e-5 5.410588807856778e-5 7.570231696145868e-5

Outlying measurements have severe (0.8521379988109327%) effect on estimated standard deviation.

dubFree/strict/500/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.504735000688871e-4 1.5314460419728495e-4 1.57131137583045e-4
Standard deviation 8.970764671894232e-6 1.2821307213060565e-5 2.1009322623437407e-5

Outlying measurements have severe (0.769447376002828%) effect on estimated standard deviation.

dubFree/strict/500/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.41759342478236e-5 8.701095402749688e-5 9.169135667122082e-5
Standard deviation 6.571363930622299e-6 1.4988255906185153e-5 2.345014446254718e-5

Outlying measurements have severe (0.9442313238389469%) effect on estimated standard deviation.

dubFree/strict/500/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.981700116431905e-5 8.093636810884981e-5 8.242182861447463e-5
Standard deviation 4.0882371810290526e-6 5.114153791410587e-6 6.806903284588227e-6

Outlying measurements have severe (0.6680187175073012%) effect on estimated standard deviation.

dubFree/strict/500/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.278148833210208e-3 4.345981702723468e-3 4.4513051530376485e-3
Standard deviation 2.2159002557519607e-4 2.994366492873778e-4 4.4635223867218543e-4

Outlying measurements have severe (0.5020949070939633%) effect on estimated standard deviation.

lazy-dubs/10/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.1561609051479914e-6 3.226411784000388e-6 3.3827683949917904e-6
Standard deviation 2.6065717753156927e-7 3.9964750464494296e-7 6.191152172497045e-7

Outlying measurements have severe (0.9214220692790542%) effect on estimated standard deviation.

lazy-dubs/10/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.3889120321921345e-6 3.4848505092121244e-6 3.622779106763442e-6
Standard deviation 3.659081646382948e-7 4.722634315961286e-7 6.038660327108816e-7

Outlying measurements have severe (0.9362412329934388%) effect on estimated standard deviation.

lazy-dubs/10/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6233778051801352e-8 1.7026036226497915e-8 1.803285720078496e-8
Standard deviation 2.514021179948925e-9 3.3895008945939018e-9 4.6538546029317405e-9

Outlying measurements have severe (0.9794221295946383%) effect on estimated standard deviation.

lazy-dubs/10/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4793023810927959e-8 1.528852899956783e-8 1.6180506733056785e-8
Standard deviation 1.751453201141652e-9 2.664192212203246e-9 3.882416590354887e-9

Outlying measurements have severe (0.9727932918316323%) effect on estimated standard deviation.

lazy-dubs/10/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1211096533630387e-7 1.1446732972762828e-7 1.1751749511929015e-7
Standard deviation 9.434705259991794e-9 1.1386331944425427e-8 1.4498126617859404e-8

Outlying measurements have severe (0.910249251122842%) effect on estimated standard deviation.

lazy-dubs/10/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1363734267859564e-6 1.1582655492096746e-6 1.1869788190481832e-6
Standard deviation 7.906275692101222e-8 9.679968950653563e-8 1.243748368307954e-7

Outlying measurements have severe (0.8529010927741806%) effect on estimated standard deviation.

lazy-dubs/10/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.155556252521048e-5 3.261535744314623e-5 3.41724102013797e-5
Standard deviation 3.4390002840850393e-6 4.777368749205908e-6 6.4991417055156975e-6

Outlying measurements have severe (0.9313721115836396%) effect on estimated standard deviation.

lazy-dubs/20/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.125007801054321e-6 4.204445319807058e-6 4.303386096130666e-6
Standard deviation 2.6435791613629314e-7 3.4087139376280715e-7 4.3215646083465255e-7

Outlying measurements have severe (0.8282433620503634%) effect on estimated standard deviation.

lazy-dubs/20/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.654205344080508e-6 4.978702569607583e-6 5.5553170397161965e-6
Standard deviation 7.461634189092055e-7 1.6573277802697294e-6 2.7355825144135516e-6

Outlying measurements have severe (0.9889787989548772%) effect on estimated standard deviation.

lazy-dubs/20/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6742560016536765e-8 1.7434216477292622e-8 1.842615637052634e-8
Standard deviation 2.755204936085596e-9 3.4146314142681197e-9 4.306195581638827e-9

Outlying measurements have severe (0.9793150269503029%) effect on estimated standard deviation.

lazy-dubs/20/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3903175719380518e-8 1.4381297075213475e-8 1.506251369945401e-8
Standard deviation 1.4878443573517489e-9 2.1120480021458345e-9 2.910959214970934e-9

Outlying measurements have severe (0.9625824752232034%) effect on estimated standard deviation.

lazy-dubs/20/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1328424469858629e-7 1.1698583523058692e-7 1.2329825077133118e-7
Standard deviation 1.3265736731571462e-8 1.7252199448165137e-8 2.702938903124857e-8

Outlying measurements have severe (0.9568107267115944%) effect on estimated standard deviation.

lazy-dubs/20/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.452473979194945e-6 2.5392254622552733e-6 2.704428985617988e-6
Standard deviation 1.822680488854114e-7 4.4297379617582e-7 8.106687459537659e-7

Outlying measurements have severe (0.9638682313511184%) effect on estimated standard deviation.

lazy-dubs/20/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.9184534564219232e-5 2.9750615437125878e-5 3.0823604500616026e-5
Standard deviation 1.7800439220872143e-6 2.9220034148042968e-6 5.183146023385577e-6

Outlying measurements have severe (0.8513133442364275%) effect on estimated standard deviation.

lazy-dubs/50/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.4475351591859425e-6 5.561377998465985e-6 5.757482654318107e-6
Standard deviation 4.059729196579828e-7 5.781232829844773e-7 8.942324762971328e-7

Outlying measurements have severe (0.8886445464069966%) effect on estimated standard deviation.

lazy-dubs/50/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.278301935687456e-6 6.394136854036207e-6 6.556160516476691e-6
Standard deviation 4.049566931184516e-7 5.161913944495485e-7 7.995434932820355e-7

Outlying measurements have severe (0.8200685260656554%) effect on estimated standard deviation.

lazy-dubs/50/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6940650481160477e-8 1.7598512072738485e-8 1.8499578036053826e-8
Standard deviation 2.2758773562196577e-9 2.9652704329967634e-9 3.737275352705809e-9

Outlying measurements have severe (0.9724199772568345%) effect on estimated standard deviation.

lazy-dubs/50/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4414332543185977e-8 1.4984048562147917e-8 1.5674360000272815e-8
Standard deviation 1.7718461474880424e-9 2.305322195226007e-9 3.1920328262000052e-9

Outlying measurements have severe (0.9658574277530656%) effect on estimated standard deviation.

lazy-dubs/50/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1282097185731946e-7 1.1560989723378472e-7 1.2038216893952198e-7
Standard deviation 1.0738734307929698e-8 1.4441536470123789e-8 1.9777637318342845e-8

Outlying measurements have severe (0.9411363924877838%) effect on estimated standard deviation.

lazy-dubs/50/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.565088594540815e-6 6.702923059278965e-6 7.010087052055971e-6
Standard deviation 4.561708949196725e-7 7.794635128450809e-7 1.3524831686542232e-6

Outlying measurements have severe (0.9092716709795872%) effect on estimated standard deviation.

lazy-dubs/50/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.255247720297822e-5 3.3849657012018243e-5 3.5807365768682714e-5
Standard deviation 6.393377181933068e-6 7.364706891995478e-6 8.641237197056399e-6

Outlying measurements have severe (0.9657475685709488%) effect on estimated standard deviation.

lazy-dubs/100/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.37825954824772e-6 8.932065136583842e-6 1.0476802287928162e-5
Standard deviation 1.5069547786668165e-6 3.275716697778086e-6 6.452318075167977e-6

Outlying measurements have severe (0.9938403622571307%) effect on estimated standard deviation.

lazy-dubs/100/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0656436733266141e-5 1.0937975017527393e-5 1.1527338398412714e-5
Standard deviation 8.518841129201613e-7 1.5689873637014063e-6 2.7101443810591255e-6

Outlying measurements have severe (0.9340795464258184%) effect on estimated standard deviation.

lazy-dubs/100/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.5945510489704136e-8 1.682460535670561e-8 1.837735168849429e-8
Standard deviation 2.652251637044004e-9 4.220543464203432e-9 6.118811712434368e-9

Outlying measurements have severe (0.9895370471404086%) effect on estimated standard deviation.

lazy-dubs/100/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4441993532832174e-8 1.5078625379655687e-8 1.6492772851457296e-8
Standard deviation 1.3325416073963394e-9 3.4001010184804348e-9 5.419626640252765e-9

Outlying measurements have severe (0.9862196500641085%) effect on estimated standard deviation.

lazy-dubs/100/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0818033677738504e-7 1.1029168673907867e-7 1.1310692641912551e-7
Standard deviation 6.797235657286887e-9 9.535372453661013e-9 1.54626610976617e-8

Outlying measurements have severe (0.886837825181387%) effect on estimated standard deviation.

lazy-dubs/100/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3171378512542163e-5 1.3404437521847744e-5 1.4060302383093385e-5
Standard deviation 6.918706027286823e-7 1.3436100433462013e-6 2.4634794643559692e-6

Outlying measurements have severe (0.8709384770310155%) effect on estimated standard deviation.

lazy-dubs/100/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.0104671550728395e-5 3.092336091530013e-5 3.2674356647379346e-5
Standard deviation 2.8228750238555798e-6 4.40737146193084e-6 6.94652629392332e-6

Outlying measurements have severe (0.9247491011645799%) effect on estimated standard deviation.

lazy-dubs/500/blog_Spence

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.130593180801891e-5 3.236648952368862e-5 3.500702083903502e-5
Standard deviation 2.0022984117216997e-6 6.685818786028929e-6 1.3734551118530104e-5

Outlying measurements have severe (0.9655294040791964%) effect on estimated standard deviation.

lazy-dubs/500/blog_gspia

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.9344467552775136e-5 5.082612923123156e-5 5.4252086538416e-5
Standard deviation 2.8607738206591434e-6 8.27583766663545e-6 1.3837655620016957e-5

Outlying measurements have severe (0.9411992518608389%) effect on estimated standard deviation.

lazy-dubs/500/nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.726481848873294e-8 1.8406164951301127e-8 2.428698133175081e-8
Standard deviation 2.4819761925198448e-9 7.498485652712443e-9 1.757210919064547e-8

Outlying measurements have severe (0.9964610449218338%) effect on estimated standard deviation.

lazy-dubs/500/nubOrd

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4141716480447468e-8 1.4640607941827183e-8 1.5245849840760305e-8
Standard deviation 1.6987417616075375e-9 2.170237275124253e-9 2.9277021300532108e-9

Outlying measurements have severe (0.9627412577301089%) effect on estimated standard deviation.

lazy-dubs/500/rel_hash

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1194009316851328e-7 1.19076320372807e-7 1.297765059505768e-7
Standard deviation 1.8917569732073463e-8 3.195101047696471e-8 4.3736906593730815e-8

Outlying measurements have severe (0.9880587088564499%) effect on estimated standard deviation.

lazy-dubs/500/rel_unstable

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.64185531364985e-5 9.277513878538719e-5 1.030889347137007e-4
Standard deviation 1.6508868833247838e-5 2.7595444174280055e-5 4.3774277290886106e-5

Outlying measurements have severe (0.983425528201624%) effect on estimated standard deviation.

lazy-dubs/500/dd_nub

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.664823179901435e-5 4.1372057817002674e-5 4.855397108254485e-5
Standard deviation 1.5763250216298783e-5 2.233569858500987e-5 3.1205533756647635e-5

Outlying measurements have severe (0.993027145749279%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.