jblattgerste/sus-analysis-toolkit

A web-based analysis toolkit for the System Usability Scale providing calculation, plotting, interpretation and contextualization utility.

Moin! I am Jonas and I work on Mixed Reality 👨‍💻

I research and develop Augmented & Mixed Reality stuff. Currently, I am the Mixed Reality Tech Lead at Raumtänzer GmbH. Previously, I was a Research and Development Engineer at the SMS group GmbH, a Postdoctoral Researcher at the Niederrhein University of Applied Sciences, and a Research Associate at the University of Applied Sciences Emden/Leer. I studied Cognitive Informatics (B.Sc.), Intelligent Systems (M.Sc.) and Computer Science (Ph.D.) at Bielefeld University.

My research interests are head-mounted, handheld and projection-based Augmented Reality approaches for training and assistance in work environments, educational settings and to assist cognitively impaired people. In my Ph.D. thesis, I was especially interested in the development and design space of Augmented Reality authoring tools, enabling (non-programmer) domain experts with varying levels of media competency to develop their own Augmented Reality content.

For my work on Augmented Reality interaction concepts and content authoring tools, usability was always a crucial success factor. As I liked the System Usability Scale and deployed it regularly for years, I always wanted to make it more approachable. Therefore, as a side project, the SUS Analysis Toolkit and the SUS PDF Generator are my attempts at aiding my own research goals but also making the SUS (and the vast amounts of consequent literature and insights on it) more accessible and approachable to others.

As I am an open science and open source advocate, I am trying to share as much as possible here.

For more information, check out my...

Personal homepage: https://www.blattgerste.dev/
ResearchGate profile: https://www.researchgate.net/profile/Jonas-Blattgerste
LinkedIn profile: https://www.linkedin.com/in/jonas-blattgerste/
Google Scholar publications: https://scholar.google.de/citations?user=k2xymcIAAAAJ&hl=en&oi=ao
YouTube channel: https://www.youtube.com/@blattgerste

sus-analysis-toolkit's Issues

Colors

Hello Dear,
Thank you for this very important toolkit. When i upload my data, all seem good except the colors of results by questions, where it keeps giving red color for a question where no "strongly disagree" result was there for all participants. There were just neutral-agree-strongly agree for this question as results. colors given in the chart are for strongly disagree-disagree- neutral. knowing that's the first question and it is positive one.
thank you
Kind regards
Maryam

Replace the "Presets" for the Single Study Dashboard with custom plots

The singly study dashboard currently lets the user select one of 4 presets. Ideally, we would want to develop this towards letting the user decide which side-plots they want to use beside the main SUS plot on the left.

The export functionality should include SVG and PDF plots

Ideally, the export functionality should include SVG and PDF plots.

"Population Standard Deviation" vs "Sample standard deviation"

The standard deviation calculated in the tool is currently the "Population Standard Deviation" and not the "Sample standard deviation".

Looking at practical examples, e.g. at https://statistics.laerd.com/statistical-guides/measures-of-spread-standard-deviation.php , it might be more appropriate to calculate the "Sample standard deviation" in most cases and as the default.

This would be a trivial technical fix, simply replacing

standardDev = statistics.pstdev(self.getAllSUSScores())

with

standardDev = statistics.stdev(self.getAllSUSScores())

but I am unsure if this would actually be more appropriate, if this should be an option or simply always be the sample standard deviation.

"Per Item Chart" CSV-file is not exported correctly

The CSV file for the "per item plots" is exported incorrectly.

How to reproduce the bug:

1. navigate "Multi Variable Analysis" -> "Per Item Chart" -> "Download this Table" or "Multi Variable Analysis" -> (any plot)-> "Download complete analysis"
2. View the downloaded .csv file, which has the incorrect format.

"Sort by" for the "Per Item chart" might be misleading

In the multi-variable analysis in the "per item chart", the user can sort the table and plot by "alphabetical, mean, or median" but this might be misleading because it sorts by the mean or median of the SUS study score.

Is this a behavior we intend, or should this be either removed or further explained?

[Request] New Plot Type

First of all, thank you for the web toolkit. This is very helpful!

May I ask to add an additional plot type selection?
It is a mixture of the plot types "Preset 3" and "Preset 1".

Particularly, I would like to have the percentile value of preset 3 and the spider matrix of preset 1.

If this is not possible in a short

Thank you very much!