stewue/masterthesis-evaluation

Software Microbenchmark Reconfiguration - Reducing Execution Time without Sacrificing Quality

This is the replication repository of the project Software Microbenchmark Reconfiguration Reducing Execution Time without Sacrificing Quality

Report Figure & Table Replication

Figure / Table	Script
Figure 4.2	RQ1_Python number_of_benchmarks.py
Figure 4.3	RQ1_Python number_of_parameterization.py
Table 4.1	RQ1_Results/aggregated/features.csv
Figure 4.4	RQ1_Python parameterization_combinations.py
Figure 4.5	RQ1_Python jmhParams_histogram.py
Figure 4.6	RQ1_Python method_number_of_lines.py
Figure 4.7	RQ1_Python jmh_version.py
Figure 4.8	RQ1_Python jmh_version_age.py
Figure 4.9	RQ1_Python jmh_version_change.py
Figure 4.10	RQ1_Python java_version.py
Figure 4.11	RQ1_Python java_version_change.py
Table 4.2	RQ1_Python feature_per_project_correlation.py
Figure 4.12	RQ1_Python sample_distribution.py
Table 4.3	RQ1_Results/aggregated/annotationpresent.csv
Table 4.4	RQ1_Results/aggregated/isdefaultvalue.csv
Figure 4.13	RQ1_Python warmupForks_distribution.py
Figure 4.14	RQ1_Python forks_distribution.py
Figure 4.15	RQ1_Python mode_distribution.py
Figure 4.16	RQ1_Python mode_number.py
Table 4.5	RQ1_Python value_correlation.py
Table 4.6	RQ1_Python benchmark_repo_correlation.py
Table 4.7	RQ1_Python benchmark_repo_correlation.py
Table 4.8	RQ1_Python feature_per_project_correlation.py
Table 4.9	RQ1_Kotlin ch.uzh.ifi.seal.smr.soa.analysis.executiontimematrix.MainKt
Figure 4.17	RQ1_Python execution_time_cumulative_larger_1.py + execution_time_cumulative_smaller_1.py
Table 4.10	RQ1_Kotlin ch.uzh.ifi.seal.smr.soa.analysis.executiontimeratio.MainKt
Figure 4.18	RQ1_Python measurementWarmupRatio.py
Table 4.11	RQ1_Python execution_time_repo_correlation.py
Figure 4.19	RQ1_Python execution_time_per_benchmark.py
Figure 4.20	RQ1_Python execution_time_per_testsuite_1_h.py + execution_time_per_testsuite_all.py
Figure 4.21	RQ1_Python configuration_changed.py
Figure 4.22	RQ1_Python code_changed.py
Table 4.12	RQ1_Kotlin ch.uzh.ifi.seal.smr.soa.analysis.jmh121update.AnalysisKt
Figure 5.4	RQ2_Python measurement_size_all.py & measurement_size_single.py
Table 5.3	RQ2_Results/variability/variability.csv
Table 5.4	RQ2_Results/variability/variability.csv
Figure 5.5	RQ2_Python boxplot_ci_ratio.py
Figure 5.6	RQ2_Python boxplot_mean_change_rate.py
Table 5.5	RQ2_Kotlin ch.uzh.ifi.seal.smr.reconfigure.analysis.variability.EvaluationReachedKt
Table 5.6	RQ2_Results/time/projects.csv
Table 5.7	RQ2_Results/time/projects.csv
Table 5.8	RQ2_Results/variability/avgiterationandforks.csv
Figure 5.7	RQ2_Python time_saved_cumulative.py

Further Information

Source Code Parser

RQ1 Results

RQ2 Results

Executor