Automatic testing of tvla.py script

[abdullahvarici]

Automatic testing of tvla.py script

[andreaskurth]

Capturing the results of our discussion yesterday:

Highest priority among the tests to be added for TVLA are:

• AES general and byte-based
• Stepping
• Filtering, not just starting from histograms

Furthermore, we should add tests that compare the actual numerical values (e.g., by comparing the t-test trace against expected data).

Test data should always be accompanied by a shell script containing the commands used to capture/generate the data. The primary purpose of that script is to make test data reproducible. This is required because some test data will have to be updated as we change the behavior of the capture and/or analysis code. If manual interaction with hardware peripherals is required to produce test data, the script does not have to be executable from start to beginning; rather, it should contain comments so that an engineer knows when and how to manually interact with hardware between running commands.

For some tests, it could be beneficial to generate minimal, artificial traces to be able to quickly pinpoint bugs. For example, one problem with real traces is that you cannot always know at which exact clock cycle leakage is expected.

Finally, we should work with compressed test data to save LFS space and bandwidth. Note that np.savez() creates uncompressed .npz archives; use np.savez_compressed() to create zipfile.ZIP_DEFLATED .npz archives.