etiq-ai/ml-testing

ML Testing for Everyone. Find issues before they become problems.

ml-testing's Issues

Fix the data leakage notebook

The DatascienceFestivalDemoLeakage_Sept_2021_2.ipynb notebook is no longer working. This issue has been created to fix this issue.

Leakage notebook improvements

The demo leakage notebook is a bit barebones. At the least it needs to demo one actual demographic leakage issue and one target leakage issue. The description should also be expanded.

Metrics in the dashboard

The metrics computed for the baseline dataset and the repaired dataset are both shown in the Data Pipeline Metrics table in the dashboard. It might be worthwhile indicating which set of metrics belong to which dataset since the Debias Pipeline metrics table does not seem to show any metric values.

Create a notebook to demo the inferred data pipeline

The inferred data pipeline requires a demo notebook.

Update the Adult data example notebook to remove the unnecessary transforms