index.html 10 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279
  1. <!DOCTYPE html>
  2. <html>
  3. <head>
  4. <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  5. <title>async/mpsc_integer/ThingBuf/10 - Criterion.rs</title>
  6. <style type="text/css">
  7. body {
  8. font: 14px Helvetica Neue;
  9. text-rendering: optimizelegibility;
  10. }
  11. .body {
  12. width: 960px;
  13. margin: auto;
  14. }
  15. th {
  16. font-weight: 200
  17. }
  18. th,
  19. td {
  20. padding-right: 3px;
  21. padding-bottom: 3px;
  22. }
  23. a:link {
  24. color: #1F78B4;
  25. text-decoration: none;
  26. }
  27. th.ci-bound {
  28. opacity: 0.6
  29. }
  30. td.ci-bound {
  31. opacity: 0.5
  32. }
  33. .stats {
  34. width: 80%;
  35. margin: auto;
  36. display: flex;
  37. }
  38. .additional_stats {
  39. flex: 0 0 60%
  40. }
  41. .additional_plots {
  42. flex: 1
  43. }
  44. h2 {
  45. font-size: 36px;
  46. font-weight: 300;
  47. }
  48. h3 {
  49. font-size: 24px;
  50. font-weight: 300;
  51. }
  52. #footer {
  53. height: 40px;
  54. background: #888;
  55. color: white;
  56. font-size: larger;
  57. font-weight: 300;
  58. }
  59. #footer a {
  60. color: white;
  61. text-decoration: underline;
  62. }
  63. #footer p {
  64. text-align: center
  65. }
  66. </style>
  67. </head>
  68. <body>
  69. <div class="body">
  70. <h2>async/mpsc_integer/ThingBuf/10</h2>
  71. <div class="absolute">
  72. <section class="plots">
  73. <table width="100%">
  74. <tbody>
  75. <tr>
  76. <td>
  77. <a href="pdf.svg">
  78. <img src="pdf_small.svg" alt="PDF of Slope" width="450" height="300" />
  79. </a>
  80. </td>
  81. <td>
  82. <a href="regression.svg">
  83. <img src="regression_small.svg" alt="Regression" width="450" height="300" />
  84. </a>
  85. </td>
  86. </tr>
  87. </tbody>
  88. </table>
  89. </section>
  90. <section class="stats">
  91. <div class="additional_stats">
  92. <h4>Additional Statistics:</h4>
  93. <table>
  94. <thead>
  95. <tr>
  96. <th></th>
  97. <th title="0.95 confidence level" class="ci-bound">Lower bound</th>
  98. <th>Estimate</th>
  99. <th title="0.95 confidence level" class="ci-bound">Upper bound</th>
  100. </tr>
  101. </thead>
  102. <tbody>
  103. <tr>
  104. <td>Slope</td>
  105. <td class="ci-bound">214.94 us</td>
  106. <td>219.99 us</td>
  107. <td class="ci-bound">224.86 us</td>
  108. </tr>
  109. <tr>
  110. <td>R&#xb2;</td>
  111. <td class="ci-bound">0.5166887</td>
  112. <td>0.5311648</td>
  113. <td class="ci-bound">0.5176506</td>
  114. </tr>
  115. <tr>
  116. <td>Mean</td>
  117. <td class="ci-bound">213.73 us</td>
  118. <td>218.06 us</td>
  119. <td class="ci-bound">222.39 us</td>
  120. </tr>
  121. <tr>
  122. <td title="Standard Deviation">Std. Dev.</td>
  123. <td class="ci-bound">19.911 us</td>
  124. <td>22.194 us</td>
  125. <td class="ci-bound">24.266 us</td>
  126. </tr>
  127. <tr>
  128. <td>Median</td>
  129. <td class="ci-bound">213.40 us</td>
  130. <td>223.89 us</td>
  131. <td class="ci-bound">229.06 us</td>
  132. </tr>
  133. <tr>
  134. <td title="Median Absolute Deviation">MAD</td>
  135. <td class="ci-bound">15.322 us</td>
  136. <td>23.462 us</td>
  137. <td class="ci-bound">31.754 us</td>
  138. </tr>
  139. </tbody>
  140. </table>
  141. </div>
  142. <div class="additional_plots">
  143. <h4>Additional Plots:</h4>
  144. <ul>
  145. <li>
  146. <a href="typical.svg">Typical</a>
  147. </li>
  148. <li>
  149. <a href="mean.svg">Mean</a>
  150. </li>
  151. <li>
  152. <a href="SD.svg">Std. Dev.</a>
  153. </li>
  154. <li>
  155. <a href="median.svg">Median</a>
  156. </li>
  157. <li>
  158. <a href="MAD.svg">MAD</a>
  159. </li>
  160. <li>
  161. <a href="slope.svg">Slope</a>
  162. </li>
  163. </ul>
  164. </div>
  165. </section>
  166. <section class="explanation">
  167. <h4>Understanding this report:</h4>
  168. <p>The plot on the left displays the average time per iteration for this benchmark. The shaded region
  169. shows the estimated probability of an iteration taking a certain amount of time, while the line
  170. shows the mean. Click on the plot for a larger view showing the outliers.</p>
  171. <p>The plot on the right shows the linear regression calculated from the measurements. Each point
  172. represents a sample, though here it shows the total time for the sample rather than time per
  173. iteration. The line is the line of best fit for these measurements.</p>
  174. <p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#additional-statistics">the
  175. documentation</a> for more details on the additional statistics.</p>
  176. </section>
  177. </div>
  178. <section class="plots">
  179. <h3>Change Since Previous Benchmark</h3>
  180. <div class="relative">
  181. <table width="100%">
  182. <tbody>
  183. <tr>
  184. <td>
  185. <a href="both/pdf.svg">
  186. <img src="relative_pdf_small.svg" alt="PDF Comparison" width="450"
  187. height="300" />
  188. </a>
  189. </td>
  190. <td>
  191. <a href="both/regression.svg">
  192. <img src="relative_regression_small.svg" alt="Regression Comparison" width="450"
  193. height="300" />
  194. </a>
  195. </td>
  196. </tr>
  197. </tbody>
  198. </table>
  199. </div>
  200. </section>
  201. <section class="stats">
  202. <div class="additional_stats">
  203. <h4>Additional Statistics:</h4>
  204. <table>
  205. <thead>
  206. <tr>
  207. <th></th>
  208. <th title="0.95 confidence level" class="ci-bound">Lower bound</th>
  209. <th>Estimate</th>
  210. <th title="0.95 confidence level" class="ci-bound">Upper bound</th>
  211. <th></th>
  212. </tr>
  213. </thead>
  214. <tbody>
  215. <tr>
  216. <td>Change in time</td>
  217. <td class="ci-bound">-0.7707%</td>
  218. <td>+2.2556%</td>
  219. <td class="ci-bound">+5.4521%</td>
  220. <td>(p = 0.16 &gt;
  221. 0.05)</td>
  222. </tr>
  223. </tbody>
  224. </table>
  225. No change in performance detected.
  226. </div>
  227. <div class="additional_plots">
  228. <h4>Additional Plots:</h4>
  229. <ul>
  230. <li>
  231. <a href="change/mean.svg">Change in mean</a>
  232. </li>
  233. <li>
  234. <a href="change/median.svg">Change in median</a>
  235. </li>
  236. <li>
  237. <a href="change/t-test.svg">T-Test</a>
  238. </li>
  239. </ul>
  240. </div>
  241. </section>
  242. <section class="explanation">
  243. <h4>Understanding this report:</h4>
  244. <p>The plot on the left shows the probability of the function taking a certain amount of time. The red
  245. curve represents the saved measurements from the last time this benchmark was run, while the blue curve
  246. shows the measurements from this run. The lines represent the mean time per iteration. Click on the
  247. plot for a larger view.</p>
  248. <p>The plot on the right shows the two regressions. Again, the red line represents the previous measurement
  249. while the blue line shows the current measurement.</p>
  250. <p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#change">the
  251. documentation</a> for more details on the additional statistics.</p>
  252. </section>
  253. </div>
  254. <div id="footer">
  255. <p>This report was generated by
  256. <a href="https://github.com/bheisler/criterion.rs">Criterion.rs</a>, a statistics-driven benchmarking
  257. library in Rust.</p>
  258. </div>
  259. </body>
  260. </html>