martinthoma/clana

CLANA is a toolkit for classifier analysis.

Hi 👋

I'm Martin and I am currently based in Germany working as a Lead Developer / Python Backend Dev.

• 🤝 Interested in open source and free software projects.
• 📫 You can reach me best via e-mail to [email protected]

If you like my work, you can support me:

---

Blog posts

• ReDoS — Denial of Service by RegEx
• 4 Alternatives to the Standard Interactive Python Shell
• Designing Beautiful Command-Line Applications With Python
• The State of PyPI — 2022 Edition
• 5 Ways to get Enums in Python

Programming Languages and Technology

clana's Issues

Can't sort with < 3 labels

It looks like this prevents working with fewer than 3 labels. I think it should even work with 1 label. When calling simulated_annealing on a 2x2 matrix:

    198             return istart + self._randbelow(width)
    199         if step == 1:
--> 200             raise ValueError("empty range for randrange() (%d,%d, %d)" % (istart, istop, width))
    201 
    202         # Non-unit step argument supplied.

ValueError: empty range for randrange() (0,0, 0)

Need for an up to date example

Hi, your tool looks exactly like what i need, but the documentation is currently not up to date and hard to follow.

I do not what to mix multiple issues in this issue (but you can find multiple issues with the provided examples, like clana metrics not actually existing). What i would want is to provide clana with a CSV file that has two columns, actual and prediction, and an optional labels file.

Now i understand that's not currently supported. So to my actually request:

Can an example be made that can be follow from start to finish, with the actual contents of the csv files? clana get-cm takes gr and predictions csv files as input, but it is unclear to me why those need to have two columns. Can an example of a file with two columns be provided, with an explanation what the columns are?

Thank you for your great work

Missing config.yaml

When installing the pip package, I immediately get an error about the config.yaml file missing.
Moving that file to site-packages/clana fixed it.

Add direct usage example

Currently, there is no directly runnable example.

Links to visualizations are broken

The following links in README are broken:

1. https://github.com/MartinThoma/clana/blob/master/mnist_confusion_matrix.png
2. https://github.com/MartinThoma/clana/blob/master/mnist_confusion_matrix_labels.png
3. https://github.com/MartinThoma/clana/blob/master/visualizations.md
4. https://github.com/MartinThoma/clana/blob/master/cm-wili-2018.png

Add to conda-forge

I was happy to find this on an Anaconda channel: https://anaconda.org/martinthoma/clana
When I install it, its dependencies conflict with my other packages, which are all on conda-forge.
Perhaps the artifacts / recipe could be uploaded to conda-forge as well?

Use of mutation testing in clana - Help needed

Hello there!

My name is Ana. I noted that you use the mutation testing tool in the project.
I am a postdoctoral researcher at the University of Seville (Spain), and my colleagues and I are studying how mutation testing tools are used in practice. With this aim in mind, we have analysed over 3,500 public GitHub repositories using mutation testing tools, including yours! This work has recently been published in a journal paper available at https://link.springer.com/content/pdf/10.1007/s10664-022-10177-8.pdf.

To complete this study, we are asking for your help to understand better how mutation testing is used in practice, please! We would be extremely grateful if you could contribute to this study by answering a brief survey of 21 simple questions (no more than 6 minutes). This is the link to the questionnaire https://forms.gle/FvXNrimWAsJYC1zB9.

Drop me an e-mail if you have any questions or comments ([email protected]). Thank you very much in advance!!