|
Scoring, Weighting and Result Mapping explained
The SAI360 Questionnaire supports Scoring and Weighting for individual Questions, and for Sections.
In addition, users can 'map' an Outcome (e.g. 75% of maximum score reached) to a Result (e.g. "Partially Compliant").
For this step it is important to understand how this will be calculated in SAI360.
Scoring and Weighting
Scores are applied to answers, but only when the answer type is:
- Lookup: the score is mapped to the selected answer - via the settings which are made in the tab Answer Values.
- Numerical (integer or decimal): the selected value is equal to the score.
To allow for the fact that sometimes some
- Questions within a Section, or
- Sections within a Questionnaire
are more important than others, it is possible to apply Weighting as a multiplier.
For example, when an answer for a Question scores with a 3, and the weight is 2, then the weighted score is 6 (3*2).
In case all questions or sections rank as equal, then apply a score of '1' across all of them.
Handling of 'N/A' when calculating a Score/Result
SAI360 allows users to mark Questions, or a whole Section as "N/A" (not applicable).
This requires that, when the outcome is calculated, a Question which has been marked as N/A will have to be "ignored", and that the total MAX SCORE needs to be readjusted.
This is best explained in an example:
- A Section contains 3 Questions of equal Score and Weight, and the maximum score for this Section = 3.
- The Section is only fully compliant when 100% is reached.
- When answering the Questionnaire, one of the Questions is marked as N/A, the other Questions reach full score.
- The result is that the Section will still be marked as fully compliant, because:
- The maximum score for the Section has been reduced by the maximum score of the Question which was marked as N/A. In this example, the "new" maximum score for the Section is 2.
- Since the other two Questions did reach their maximum score, the result is 2 out of 2 - i.e. 100%.
|
When using N/A, you must only use Percentages as Result Mapping
The 'automatic adjustment' for the Result Mapping when using N/A will only work when the Result Mapping is done using Percentages.
If you would have used the Score to map the results in the above example, you would have defined that the Section passes when it reaches "3 out of 3". This calculation will NOT be adjusted when applying a N/A, and the section would be marked as not compliant, since it only reached "2 out of 3".
|
Result Mapping - using Percentages
The use of Percentages has the advantage over absolute Values that a Pass or Fail does not need to be defined for each individual Section, which all could have different maximum scores.
When using Percentages, it is possible to apply a single Result Mapping across all Sections, provided that all Sections need to reach the same "Percentage of the Maximum Score reached" for the same result. For example:
- 0-30%: Not Compliant
- 31-90%: Partially Compliant
- 91-100%: Fully Compliant
|
PLEASE NOTE
When using percentages, negative scores will be converted to 0 (zero). This means that:
- should the score for a Section or a Questionnaire be a negative value, then the system will replace this negative value with a 0 (zero).
- the percentage will always be calculated as actual score / max score.
|
Example Calculation to determine Percentage:
Section A
|
MAX SCORE
|
MIN SCORE
|
WEIGHT
|
WEIGHTED
MAX SCORE
|
WEIGHTED
MIN SCORE
|
Question 1
|
5
|
0
|
1
|
5
|
0
|
Question 2
|
5
|
0
|
3
|
15
|
0
|
Question 3
|
5
|
-5
|
2
|
10
|
-10
|
Weighted maximum and minimum for Section
|
30
|
-10
|
Calculated Percentage when the Score = 20
|
67% (calculated as: 20 / 30)
|
Calculated Percentage when the Score = -10
|
0% (calculated as: 0 / 30)
|
Example Calculation to determine Percentage - when N/A is used:
Section A
|
MAX SCORE
|
MIN SCORE
|
WEIGHT
|
WEIGHTED
MAX SCORE
|
WEIGHTED
MIN SCORE
|
Question 1 - marked as N/A by a user.
|
5
|
0
|
0
|
0
|
0
|
Question 2
|
5
|
0
|
3
|
15
|
0
|
Question 3
|
5
|
-5
|
2
|
10
|
-10
|
Weighted maximum and minimum for Section
|
25
|
-10
|
Calculated Percentage when the Score = 20
|
80% (calculated as: 20 / 25)
|
Calculated Percentage when the Score = -10
|
0% (calculated as: 0 / 30)
|
Result Mapping - using the Score
When mapping the results for a Section, or for the Questionnaire, you must take any Weighting into consideration - since this is part of the calculation which is used by the web application.
As a baseline, you will need to calculate the maximum and minimum possible total score for each Section, by
- determining the maximum and minimum score for each question
- multiplied by the weight for each questions
- adding the results
Example for a Section:
Section A
|
MAX SCORE
|
MIN SCORE
|
WEIGHT
|
WEIGHTED
MAX SCORE
|
WEIGHTED
MIN SCORE
|
Question 1
|
5
|
0
|
1
|
5
|
0
|
Question 2
|
5
|
0
|
3
|
15
|
0
|
Question 3
|
5
|
-5
|
2
|
10
|
-10
|
Weighted maximum and minimum for Section
|
30
|
-10
|
Example for a Questionnaire:
Questionnaire A
|
MAX SCORE
|
MIN SCORE
|
WEIGHT
|
WEIGHTED
MAX SCORE
|
WEIGHTED
MIN SCORE
|
Section 1
|
30
|
-10
|
1
|
30
|
-10
|
Section 2
|
50
|
0
|
3
|
150
|
0
|
Section 3
|
30
|
-30
|
2
|
60
|
-60
|
Weighted maximum and minimum for Section
|
240
|
-70
|
Once these outer limits have been established, it is possible to map the score to an outcome.
|
