hrholm/prop-based-test-tinydb

Property Based Testing of TinyDB

Content of the repository

examples: previous trials working with the Hypothesis framework, and official examples.

experiments: evaluation done on the command generation of Hypothesis.

htmlcov: Coverage report

tinydb: TinyDB source code fetched from their repository, in order to compute coverage.

root: Property based tests, 'test_model_wo_bundle.py' and 'test_roundtrip.py'

Setup

Install dependencies:

pip install -r requirements.txt

Run tests with:

pytest --hypothesis-show-statistics --ignore=examples 

Add '--cov-report html --cov' for coverage.

Development

Pytest will only run methods prefixed with test_, e.g. test_decode_inverts_encode(s)

Preconditions are not supported when using bundles, read bottom of "Preconditions" in https://hypothesis.readthedocs.io/en/latest/stateful.html#preconditions

prop-based-test-tinydb's Issues

generator distribution: add more observations

sanitize references

reference source code / this repo in report

insert more commands in model

in test_model_wo_bundle.py

test deserialization (roundtrip property)

https://tinydb.readthedocs.io/en/latest/usage.html#storage-middleware

See their tests for inspiration: https://github.com/msiemens/tinydb/blob/master/tests/test_storages.py

Update insert_multiple to support dynamic number of documents

conclusion in report

Find corner cases to test for

Hypothesis should have some nice built in corner cases, especially regarding text with different encodings and such.

coverage section

setup different document types