Converting Your Paper Rubric to LiveJudge – LiveJudge Help Center

Chances are that LiveJudge will look like it won't map to your paper rubric. RELAX. IT WILL.

To understand how to convert your rubric, let's take this sample from a science fair. Notice that each judging factor (in bold type) has different judging standards, each of which can total up to 5 points. The problem with this rubric is that it lacks precision. Judges are hamstrung by a scale that only allows increments of 20%. Imagine trying to award a student 90% on each of the Design and Methodology standards. The judge would have to figure out 90% of 15 and then allocate the result to the three categories. First, that's just backwards. Second, what happens when the student wants feedback? The scores don't accurately reflect the judge's findings.

How LiveJudge Fixes the Issue and Keeps the Structure of Your Rubric

In LiveJudge, for the class that is using this rubric, set the sliders to 1-10 with an increment of .1 or .25. Judges intuitively know how to evaluate on this scale. If you want, you can make the scale 1-100. Do that in the class setup area (see screen below).

Once complete, create your classes (or modify an existing one) and move to the JUDGING FACTORS area (menu just below the Class Library).

Here, you will create the bold judging factors we see in the paper example above. Let's use "Design & Methodology" as an example. Notice the standards (right image) that I have assigned to this factor. They are the same ones used in the paper sheet. So how will the sliders (which go from 1-10) work if the judge can only award a maximum of 5 points for each standard? The answer lies in the screen above.

Notice that for each factor, there is a weight assigned. In the paper rubric, the student can get a maximum of 15 points from Design & Methodology. So, we will assign that factor 15% in our class setup. As for the sliders, our system knows that there is a maximum of 30 points (vs 15 on paper). So, if the student gets an 7.5, 9.0 and 8.5, our system will sum them (25) and compute the ratio of 25 over a possible 30 maximum, which equals 25/30 or 83.33%. 83.33% of 15 (the raw weighting) = 12.5! That fits exactly into what the paper rubric would come up with (except that it's actually more precise because of the decimal). More importantly, judges can intuitively assign a precise grade to each standard, giving both students and faculty confidence in the precision and fairness of the scores.