[Feature][Core] Implement a generalised evaluation script

[udayraj123]

[Feature][Core] Implement a generalised evaluation script

[Rohan-G]

Current schema for evaluation:

In the tempalte.json, we include a Solution section, with the data for each question ([qNo] : [[Answers,mark1],[Answers,mark2],['DEFAULT',Default_marks]]) as a general set of rules with more details as given below:

Schema flexibility:

Double digit integer                                       - { [qNo] : ['4', '04'] }  
Double digit integer(X is provided in "emptyVal")          - { [qNo] : ['4', 'X4'] }  
Multiple choice                                            - { [qNo] : [ ['A', 4] ] }
Strictly Multiple correct                                  - { [qNo] : [ ['AB', 2] ] } 
Partial Marking                                            - { [qNo] : [ ['A', 4], ['D', 1] ] } 
Ambiguous correct                                          - { [qNo] : [ ['A', 4], ['B', 4] ] }
Ambiguous correct(Cumulative score 2 options)              - { [qNo] : [ ['A', 4], ['B', 4], ['AB', 8] ] }
Ambiguous correct(Cumulative score 3 options)              - { [qNo] : [ ['A', 4], ['B', 4], ['C', 2], ['AB', 8], ['BC', 6], ['AC', 6] ] }

Negative (+4 -1)                                           - { [qNo] : [ ['A', 4], ['B', -1], ['C', -1], ['D', -1] ] }
Negative (+4 -1)                                           - { [qNo] : [ ['A', 4], ['*DEFAULT*', -1] ] }
Negative (+1 -0.25)                                        - { [qNo] : [ ['A', 1], ['*DEFAULT*', -0.25] ] }
Bonus (+4 for all)                                         - { [qNo] : [ ['*DEFAULT*', 4] ] }

Note: order of concatenations is governed by "vals" array from template.json

Edit: many changes in this schema. Follow evaluation_schema.py file for latest schema

[Udayraj123]

Note: there are many changes in the above schema. I'll be populating many examples in the existing samples as a demonstration

[Udayraj123]

Some links:

• Previous attempt for answer key object - also supported 'streaks' of correct answers.
• Evaluate function
• Discord discussion

[Udayraj123]

@Rohan-G are you available to work on this further?

[Rohan-G]

@Rohan-G are you available to work on this further?

Yep I can continue working on this now.