Sunday 23 June 2019

To not bell curve or to bell curve grades


To not bell curve or to bell curve grades

In May 2019, Singapore Management University decided to review the letter grades of all 169 students in a class – because the lecturer had awarded every student an A grade, despite the university’s rule to limit the number of As in any one class to a third of the class. On 17 June 2019, The Straits Times ran a feature article on the non-use and use of bell curve grading in Singapore universities.

In this article, I would like apply some critical thought to grading on a bell curve.

We must first establish the purpose of grading. It is to inform some third party (not the lecturer or student) how competent the student has become in the subject at the end of the course. The most likely third party is the student’s future prospective employer. I exclude the lecturer because he or she already knows the answer from class interaction and formative assessments (class exercises, homework, and other non-credit work). The student also knows the answer from the above and from self-reflection.

Hence, the bottom line in discussing grading method is what information it provides to that third party, most likely the student’s future prospective employer. We return to this at the end of this article.

Typically, a student’s competence in the subject is measured through various modes such as quizzes, tests, presentations, projects, essays and examinations. Various weights are assigned to each mode, with the total amounting to 100 marks. That is to say, students are measured on a unique 100-point scale.

This is unlike such scales as for temperature (Celcius, Fahrenheit, Kelvin), length (imperial, metric), electrical (volt, ampere, ohm). A measure of 300 degrees Centigrade means exactly the same thing to a physicist, meteorologist, doctor, or indeed anyone. In contrast, one mark in any given course means one mark in only that course. Each academic measuring scale is unique to the course in which it is used.

At the end of each module, each student would have earned some number of marks for that module. Let’s call this the numerical mark.

The institution, faculty, department or lecturer (the decision-maker varies) sets a minimum number of marks as the pass mark. This establishes the minimum point beyond which the student is said to be competent in the subject. Typically, this minimum varies between 35 and 60 marks. Beyond this, we have a 65-40 point scale of competence.

This is the point where grading kicks in.

Grading is typically not reported on such a multi-point scale to the third party. The typical scale used is the letter grade scale, ranging from A-plus to D-minus – a twelve point scale. The pass mark range is typically equally divided into twelve parts, each corresponding to a letter grade. Each student is awarded the letter grade into which his or her numerical mark falls.

We need to collapse a 65-40 mark pass range into a 12-point letter grade range. Dividing equally, each letter grade covers anything between 5.4167 (65 ÷ 12) and 3.3333 (40 ÷ 12) marks.

Here is a simple example. We set the pass mark at 40 marks. That yields a 60-mark pass range. Dividing this into 12 parts gives us five marks per letter grade. A student scoring 88 marks would get the letter grade “A-“.

This is grading without using a bell curve.

The term “bell curve” is we commonly call the “normal distribution” (which when graphically expressed exhibits a bell shape). This is the distribution of any given feature (such as height, weight, intelligence) in an unbiased population. The caveat is that the measuring instrument must be sensitive enough to distinguish small differences in the occurrence of the given feature. For example, it is good enough to time marathons to the nearest second, but 100-metre races must be timed to the hundredths of a second.

In the same way, a well designed academic measuring scale will uncover student competence in a normal distribution or bell curve shape. This result may be taken as the criterion of good test design. (I once achieved a perfect bell curve with a class of 17 students).

As mentioned above, Singapore Management University set a rule for no more than one third of a class being awarded an A grade. This is a maximum. What happens if more than a third of the class achieves 85 marks or more (to continue our simple example)? What happens if no student achieves at least 85 marks?

This is where the bell curve method of grading would kick in – if mandated.

Percentages (not necessarily equal) are assigned to each letter grade or grade group (B-, B and B+ grades etc.) and students are awarded a letter grade as they progressively fulfil the percentage in each letter grade or grade group.

Bell curve grading is essentially a method to award grades according to a student’s rank (colloquially known as position) in the class.

We can now answer the question: What information does a letter grade provide to the third party, most likely the student’s future prospective employer?

If the letter grade was awarded based on the student’s numerical mark (that is, no bell curve was applied), the letter grade represents the student’s achieved competence relative to the academic measuring instrument / scale used in that course or module.

If the letter grade was awarded based on the student’s rank in class (that is, a bell curve was applied), the letter grade represents the student’s achieved competence relative to the other students in that course or module.

But the basis of awarding the letter grade is invisible to the third party.

Hence, a student showing an “A” for a given course in his or her academic transcript must be understood to be a student who was EITHER a student who achieved top competence relative to the academic measuring instrument / scale used in that course or module OR a student who achieved top competence relative to the other students in that course or module.

This is as good as it gets. The prospective employer must also use other criteria to assess whether it should hire that job applicant.

A final comment: It would be much more informative to the third party to report BOTH a student’s numerical mark (eg. 76 marks) AND the student’s class position (eg. 11 / 17).

Cheers.