llogiq/newlinebench

newlinebench's Issues

2.4GHz Core 2 Duo on Windows 10

I'm sitting on a Lenovo T400 laptop with a 2.4GHz Core 2 Duo CPU (P8600) on Windows 10 (v1607, build 14393.187). The benchmark is compiled on the nightly available on 2016/09/14 and I get the following results:

running 16 tests
test check ... ignored
test test_fast_newlines          ... bench:       9,999 ns/iter (+/- 658)
test test_fast_nonewlines        ... bench:       9,992 ns/iter (+/- 209)
test test_fast_somenewlines      ... bench:          46 ns/iter (+/- 3)
test test_faster_newlines        ... bench:      11,579 ns/iter (+/- 813)
test test_faster_nonewlines      ... bench:      11,080 ns/iter (+/- 620)
test test_faster_somenewlines    ... bench:          52 ns/iter (+/- 3)
test test_fastest_newlines       ... bench:       4,483 ns/iter (+/- 250)
test test_fastest_nonewlines     ... bench:       4,711 ns/iter (+/- 360)
test test_fastest_somenewlines   ... bench:          29 ns/iter (+/- 3)
test test_screaming_newlines     ... bench:       4,206 ns/iter (+/- 295)
test test_screaming_nonewlines   ... bench:       4,207 ns/iter (+/- 320)
test test_screaming_somenewlines ... bench:          28 ns/iter (+/- 1)
test test_slow_newlines          ... bench:      16,722 ns/iter (+/- 1,077)
test test_slow_nonewlines        ... bench:       8,423 ns/iter (+/- 689)
test test_slow_somenewlines      ... bench:         174 ns/iter (+/- 33)

test result: ok. 0 passed; 0 failed; 1 ignored; 15 measured

Linux, Intel Celeron CPU N3050 @ 1.60GHz

test test_fast_newlines               ... bench:       9,504 ns/iter (+/- 483)
test test_fast_nonewlines             ... bench:       9,896 ns/iter (+/- 892)
test test_fast_random                 ... bench:     144,005 ns/iter (+/- 40,040)
test test_fast_somenewlines           ... bench:          89 ns/iter (+/- 3)
test test_faster_newlines             ... bench:       9,550 ns/iter (+/- 410)
test test_faster_nonewlines           ... bench:       9,568 ns/iter (+/- 3,559)
test test_faster_random               ... bench:     150,654 ns/iter (+/- 105,967)
test test_faster_somenewlines         ... bench:          93 ns/iter (+/- 4)
test test_fastest_newlines            ... bench:       3,722 ns/iter (+/- 8,838)
test test_fastest_nonewlines          ... bench:       3,698 ns/iter (+/- 35)
test test_fastest_random              ... bench:      62,515 ns/iter (+/- 4,865)
test test_fastest_somenewlines        ... bench:          44 ns/iter (+/- 8)
test test_hyperscreaming_newlines     ... bench:       4,065 ns/iter (+/- 54)
test test_hyperscreaming_nonewlines   ... bench:       4,075 ns/iter (+/- 147)
test test_hyperscreaming_random       ... bench:      61,697 ns/iter (+/- 8,033)
test test_hyperscreaming_somenewlines ... bench:          56 ns/iter (+/- 36)
test test_screaming_newlines          ... bench:       3,295 ns/iter (+/- 94)
test test_screaming_nonewlines        ... bench:       3,300 ns/iter (+/- 255)
test test_screaming_random            ... bench:      52,230 ns/iter (+/- 6,284)
test test_screaming_somenewlines      ... bench:          35 ns/iter (+/- 15)
test test_slow_newlines               ... bench:      23,708 ns/iter (+/- 334)
test test_slow_nonewlines             ... bench:      12,348 ns/iter (+/- 232)
test test_slow_random                 ... bench:     193,149 ns/iter (+/- 102,913)
test test_slow_somenewlines           ... bench:         158 ns/iter (+/- 16)

MacBook Pro (Early 2015), 2.7 GHz Intel Core i5

test test_fast_newlines          ... bench:       2,351 ns/iter (+/- 673)
test test_fast_nonewlines        ... bench:       2,326 ns/iter (+/- 613)
test test_fast_somenewlines      ... bench:          21 ns/iter (+/- 2)
test test_faster_newlines        ... bench:       3,411 ns/iter (+/- 2,687)
test test_faster_nonewlines      ... bench:       2,992 ns/iter (+/- 428)
test test_faster_somenewlines    ... bench:          26 ns/iter (+/- 5)
test test_fastest_newlines       ... bench:       1,351 ns/iter (+/- 437)
test test_fastest_nonewlines     ... bench:       1,309 ns/iter (+/- 197)
test test_fastest_somenewlines   ... bench:          16 ns/iter (+/- 2)
test test_screaming_newlines     ... bench:       1,982 ns/iter (+/- 328)
test test_screaming_nonewlines   ... bench:       1,924 ns/iter (+/- 526)
test test_screaming_somenewlines ... bench:          11 ns/iter (+/- 2)
test test_slow_newlines          ... bench:       5,896 ns/iter (+/- 784)
test test_slow_nonewlines        ... bench:       3,675 ns/iter (+/- 609)
test test_slow_somenewlines      ... bench:          31 ns/iter (+/- 4)

Windows 10 with Core i7-5930K @ 4GHz

test test_fast_newlines          ... bench:       1,928 ns/iter (+/- 412)
test test_fast_nonewlines        ... bench:       1,937 ns/iter (+/- 15)
test test_fast_somenewlines      ... bench:          16 ns/iter (+/- 5)
test test_faster_newlines        ... bench:       2,263 ns/iter (+/- 1,255)
test test_faster_nonewlines      ... bench:       2,370 ns/iter (+/- 316)
test test_faster_somenewlines    ... bench:          21 ns/iter (+/- 13)
test test_fastest_newlines       ... bench:       1,065 ns/iter (+/- 1,046)
test test_fastest_nonewlines     ... bench:       1,063 ns/iter (+/- 9)
test test_fastest_somenewlines   ... bench:          14 ns/iter (+/- 7)
test test_screaming_newlines     ... bench:         951 ns/iter (+/- 7)
test test_screaming_nonewlines   ... bench:         952 ns/iter (+/- 8)
test test_screaming_somenewlines ... bench:          10 ns/iter (+/- 1)
test test_slow_newlines          ... bench:       5,024 ns/iter (+/- 31)
test test_slow_nonewlines        ... bench:       3,255 ns/iter (+/- 23)
test test_slow_somenewlines      ... bench:          24 ns/iter (+/- 8)

Windows 8.1 with AMD FX-8350 @ 4GHz

running 16 tests
test check ... ignored
test test_fast_newlines          ... bench:       2,964 ns/iter (+/- 79)
test test_fast_nonewlines        ... bench:       2,968 ns/iter (+/- 60)
test test_fast_somenewlines      ... bench:          27 ns/iter (+/- 0)
test test_faster_newlines        ... bench:       3,866 ns/iter (+/- 80)
test test_faster_nonewlines      ... bench:       3,866 ns/iter (+/- 101)
test test_faster_somenewlines    ... bench:          29 ns/iter (+/- 1)
test test_fastest_newlines       ... bench:       1,590 ns/iter (+/- 46)
test test_fastest_nonewlines     ... bench:       1,587 ns/iter (+/- 33)
test test_fastest_somenewlines   ... bench:          17 ns/iter (+/- 0)
test test_screaming_newlines     ... bench:       1,423 ns/iter (+/- 25)
test test_screaming_nonewlines   ... bench:       1,423 ns/iter (+/- 45)
test test_screaming_somenewlines ... bench:          13 ns/iter (+/- 0)
test test_slow_newlines          ... bench:      12,632 ns/iter (+/- 219)
test test_slow_nonewlines        ... bench:      10,148 ns/iter (+/- 408)
test test_slow_somenewlines      ... bench:          70 ns/iter (+/- 3)

test result: ok. 0 passed; 0 failed; 1 ignored; 15 measured

Linux i7-4710HQ CPU @ 2.50GHz

Bench against b7a20b2

running 25 tests
test check ... ignored
test test_fast_newlines               ... bench:       2,041 ns/iter (+/- 49)
test test_fast_nonewlines             ... bench:       2,045 ns/iter (+/- 21)
test test_fast_random                 ... bench:      30,513 ns/iter (+/- 202)
test test_fast_somenewlines           ... bench:          15 ns/iter (+/- 14)
test test_faster_newlines             ... bench:       2,752 ns/iter (+/- 17)
test test_faster_nonewlines           ... bench:       2,750 ns/iter (+/- 189)
test test_faster_random               ... bench:      41,100 ns/iter (+/- 36)
test test_faster_somenewlines         ... bench:          23 ns/iter (+/- 1)
test test_fastest_newlines            ... bench:       1,201 ns/iter (+/- 19)
test test_fastest_nonewlines          ... bench:       1,201 ns/iter (+/- 10)
test test_fastest_random              ... bench:      17,836 ns/iter (+/- 65)
test test_fastest_somenewlines        ... bench:          13 ns/iter (+/- 1)
test test_hyperscreaming_newlines     ... bench:         672 ns/iter (+/- 21)
test test_hyperscreaming_nonewlines   ... bench:         670 ns/iter (+/- 16)
test test_hyperscreaming_random       ... bench:      10,174 ns/iter (+/- 397)
test test_hyperscreaming_somenewlines ... bench:          12 ns/iter (+/- 0)
test test_screaming_newlines          ... bench:       1,104 ns/iter (+/- 4)
test test_screaming_nonewlines        ... bench:       1,104 ns/iter (+/- 6)
test test_screaming_random            ... bench:      16,423 ns/iter (+/- 15)
test test_screaming_somenewlines      ... bench:          10 ns/iter (+/- 9)
test test_slow_newlines               ... bench:       5,329 ns/iter (+/- 32)
test test_slow_nonewlines             ... bench:       3,381 ns/iter (+/- 128)
test test_slow_random                 ... bench:      62,874 ns/iter (+/- 456)
test test_slow_somenewlines           ... bench:          29 ns/iter (+/- 1)

test result: ok. 0 passed; 0 failed; 1 ignored; 24 measured

Linux Core i7-5930K CPU @ 3.50GHz (overclocked at 4.2GHz)

$ cargo +nightly bench
   Compiling newlinebench v0.1.0 (file:///home/wscott/src/newlinebench)
    Finished release [optimized] target(s) in 1.54 secs
     Running target/release/deps/newlinebench-1e9e677286d8521b

running 25 tests
test check ... ignored
test test_fast_newlines               ... bench:       1,915 ns/iter (+/- 63)
test test_fast_nonewlines             ... bench:       1,911 ns/iter (+/- 391)
test test_fast_random                 ... bench:      28,540 ns/iter (+/- 4,189)
test test_fast_somenewlines           ... bench:          14 ns/iter (+/- 1)
test test_faster_newlines             ... bench:       2,157 ns/iter (+/- 41)
test test_faster_nonewlines           ... bench:       2,160 ns/iter (+/- 47)
test test_faster_random               ... bench:      32,210 ns/iter (+/- 321)
test test_faster_somenewlines         ... bench:          15 ns/iter (+/- 1)
test test_fastest_newlines            ... bench:         941 ns/iter (+/- 30)
test test_fastest_nonewlines          ... bench:         942 ns/iter (+/- 5)
test test_fastest_random              ... bench:      13,995 ns/iter (+/- 494)
test test_fastest_somenewlines        ... bench:          10 ns/iter (+/- 1)
test test_hyperscreaming_newlines     ... bench:         529 ns/iter (+/- 2)
test test_hyperscreaming_nonewlines   ... bench:         528 ns/iter (+/- 3)
test test_hyperscreaming_random       ... bench:       8,013 ns/iter (+/- 61)
test test_hyperscreaming_somenewlines ... bench:           9 ns/iter (+/- 0)
test test_screaming_newlines          ... bench:         865 ns/iter (+/- 3)
test test_screaming_nonewlines        ... bench:         866 ns/iter (+/- 8)
test test_screaming_random            ... bench:      12,869 ns/iter (+/- 112)
test test_screaming_somenewlines      ... bench:           7 ns/iter (+/- 1)
test test_slow_newlines               ... bench:       4,179 ns/iter (+/- 27)
test test_slow_nonewlines             ... bench:       2,733 ns/iter (+/- 58)
test test_slow_random                 ... bench:      49,122 ns/iter (+/- 888)
test test_slow_somenewlines           ... bench:          20 ns/iter (+/- 0)

test result: ok. 0 passed; 0 failed; 1 ignored; 24 measured

Linux AMD 5950x (16c/32t CPU) @ 3.40ghz (with PBO)

This was a really interesting blog post, thought it would be interesting on newish hardware.

test test_fast_newlines               ... bench:       1,161 ns/iter (+/- 5)
test test_fast_nonewlines             ... bench:       1,163 ns/iter (+/- 10)
test test_fast_random                 ... bench:      16,734 ns/iter (+/- 133)
test test_fast_somenewlines           ... bench:           6 ns/iter (+/- 0)
test test_faster_newlines             ... bench:       1,544 ns/iter (+/- 45)
test test_faster_nonewlines           ... bench:       1,544 ns/iter (+/- 3)
test test_faster_random               ... bench:      23,870 ns/iter (+/- 156)
test test_faster_somenewlines         ... bench:           7 ns/iter (+/- 0)
test test_fastest_newlines            ... bench:         432 ns/iter (+/- 2)
test test_fastest_nonewlines          ... bench:         431 ns/iter (+/- 1)
test test_fastest_random              ... bench:       6,365 ns/iter (+/- 61)
test test_fastest_somenewlines        ... bench:           7 ns/iter (+/- 0)
test test_hyperscreaming_newlines     ... bench:         264 ns/iter (+/- 1)
test test_hyperscreaming_nonewlines   ... bench:         264 ns/iter (+/- 1)
test test_hyperscreaming_random       ... bench:       3,962 ns/iter (+/- 27)
test test_hyperscreaming_somenewlines ... bench:           6 ns/iter (+/- 0)
test test_screaming_newlines          ... bench:         247 ns/iter (+/- 2)
test test_screaming_nonewlines        ... bench:         247 ns/iter (+/- 0)
test test_screaming_random            ... bench:       3,639 ns/iter (+/- 16)
test test_screaming_somenewlines      ... bench:           6 ns/iter (+/- 0)
test test_slow_newlines               ... bench:       2,550 ns/iter (+/- 13)
test test_slow_nonewlines             ... bench:       2,539 ns/iter (+/- 116)
test test_slow_random                 ... bench:      38,214 ns/iter (+/- 181)
test test_slow_somenewlines           ... bench:          10 ns/iter (+/- 0)

Raspberry Pi 3 (ARMv7 Processor rev 4 (v7l))

running 25 tests
test check ... ignored
test test_fast_newlines               ... bench:      30,344 ns/iter (+/- 30,560)
test test_fast_nonewlines             ... bench:      30,322 ns/iter (+/- 286)
test test_fast_random                 ... bench:     454,955 ns/iter (+/- 5,743)
test test_fast_somenewlines           ... bench:         150 ns/iter (+/- 1)
test test_faster_newlines             ... bench:      40,698 ns/iter (+/- 247)
test test_faster_nonewlines           ... bench:      40,697 ns/iter (+/- 260)
test test_faster_random               ... bench:     611,143 ns/iter (+/- 11,975)
test test_faster_somenewlines         ... bench:         194 ns/iter (+/- 0)
test test_fastest_newlines            ... bench:      14,898 ns/iter (+/- 26)
test test_fastest_nonewlines          ... bench:      14,897 ns/iter (+/- 41)
test test_fastest_random              ... bench:     224,316 ns/iter (+/- 454)
test test_fastest_somenewlines        ... bench:         105 ns/iter (+/- 0)
test test_hyperscreaming_newlines     ... bench:      14,834 ns/iter (+/- 126)
test test_hyperscreaming_nonewlines   ... bench:      14,849 ns/iter (+/- 99)
test test_hyperscreaming_random       ... bench:     229,218 ns/iter (+/- 8,037)
test test_hyperscreaming_somenewlines ... bench:         109 ns/iter (+/- 1)
test test_screaming_newlines          ... bench:      13,069 ns/iter (+/- 34)
test test_screaming_nonewlines        ... bench:      13,068 ns/iter (+/- 38)
test test_screaming_random            ... bench:     196,560 ns/iter (+/- 3,732)
test test_screaming_somenewlines      ... bench:          91 ns/iter (+/- 1)
test test_slow_newlines               ... bench:      33,379 ns/iter (+/- 225)
test test_slow_nonewlines             ... bench:      33,375 ns/iter (+/- 201)
test test_slow_random                 ... bench:     502,030 ns/iter (+/- 14,256)
test test_slow_somenewlines           ... bench:           3 ns/iter (+/- 0)

MacOS 10.11.6, Intel(R) Core(TM)2 Duo CPU P7550 @ 2.26GHz

test check ... ignored
test test_fast_newlines               ... bench:       5,517 ns/iter (+/- 43)
test test_fast_nonewlines             ... bench:       5,521 ns/iter (+/- 240)
test test_fast_random                 ... bench:      82,708 ns/iter (+/- 603)
test test_fast_somenewlines           ... bench:          34 ns/iter (+/- 3)
test test_faster_newlines             ... bench:       6,602 ns/iter (+/- 901)
test test_faster_nonewlines           ... bench:       6,603 ns/iter (+/- 741)
test test_faster_random               ... bench:      98,786 ns/iter (+/- 11,483)
test test_faster_somenewlines         ... bench:          37 ns/iter (+/- 5)
test test_fastest_newlines            ... bench:       2,592 ns/iter (+/- 54)
test test_fastest_nonewlines          ... bench:       2,592 ns/iter (+/- 392)
test test_fastest_random              ... bench:      38,741 ns/iter (+/- 7,803)
test test_fastest_somenewlines        ... bench:          28 ns/iter (+/- 2)
test test_hyperscreaming_newlines     ... bench:       1,643 ns/iter (+/- 122)
test test_hyperscreaming_nonewlines   ... bench:       1,643 ns/iter (+/- 333)
test test_hyperscreaming_random       ... bench:      26,596 ns/iter (+/- 2,248)
test test_hyperscreaming_somenewlines ... bench:          26 ns/iter (+/- 1)
test test_screaming_newlines          ... bench:       2,088 ns/iter (+/- 154)
test test_screaming_nonewlines        ... bench:       2,088 ns/iter (+/- 30)
test test_screaming_random            ... bench:      31,328 ns/iter (+/- 710)
test test_screaming_somenewlines      ... bench:          20 ns/iter (+/- 4)
test test_slow_newlines               ... bench:       9,990 ns/iter (+/- 1,111)
test test_slow_nonewlines             ... bench:       9,992 ns/iter (+/- 1,983)
test test_slow_random                 ... bench:     199,697 ns/iter (+/- 34,144)
test test_slow_somenewlines           ... bench:           0 ns/iter (+/- 0)