Inconsistent composite score best score computation

[franz1981]

Inconsistent composite score best score computation

[fakeshadow]

This is not a bug from what I see. “display_name” and "framework" are separate fields in benchmark_config.json. The composite score just add every best score from every category under the same framework regardless the display names of multiple tests.

That said I don't feel it's the correct behavior. IMO the composite score should either take the display names into account and give multiple scores for one framework(if it's has many display names). Or choose one display name with the best overall score for one framework. This also means one test must implement all bench categories in order to be shown in composite score list.

[franz1981]

Ah, it's surprising, because I've forcibly added a filter (which is the same for both composite/plaintext), which means, as a user, I expect it to be applied regardless which tab I click ie the best plaintext result of a framework "flavour" which doesn't belong to the filter, should not appear.