Tests

[leighmcculloch]

Tests

[leighmcculloch]

Scope of this issue is wide and can be split up into:

• Unit tests (with mock host)
• Fuzz/property-based tests (using common Rust tooling)
• Integration testing (quickstart)

@graydon suggested looking at:

• https://docs.rs/stateright

Also heard of:

• https://github.com/AltSysrq/proptest
• https://github.com/rust-fuzz/afl.rs
• https://github.com/rust-fuzz/cargo-fuzz

[leighmcculloch]

Also:

• https://github.com/loiclec/fuzzcheck-rs

[leighmcculloch]

I spoke to @nano-o today who suggested we also look into:

• Symbolic execution

  • https://crux.galois.com/ (Rust)
  • https://www.cprover.org/cbmc/ (C)
  • https://github.com/trailofbits/manticore (supports WASM)

• Tools that test for reentry bugs

[leighmcculloch]

@nano-o also reinforced something not captured in regards to fuzz testing above: we need to assess the fuzzing fwks/tools to ensure that they evaluate code coverage, otherwise we won't know if they are fuzzing all aspects, nor will the tool be able to build a meaningful corpus over all paths.

[leighmcculloch]

All these things live in subissues now, and I'm going to close this parent issue to continue to use the subissues as it is becoming a bit much managing a series of parent issues, and I keep forgetting to keep them linked. All issues relating to this will be prefixed with Tests: .