Nats Scoring

[Earl Haury]

Given that judging quality isn't likely to change soon (previous posting), 
how do we best handle that at the Nats?

One issue is whether the Nats are defined as a Continental Championship or 
not. This definition determines the scope of the F3A rules with regard to 
scoring, the assumption is that it will be defined as such. It has no impact 
on the other classes. A couple of points worth mentioning for the FAI finals 
when the Team Selections are included. Generally 10 judges are used, some of 
them being "hired guns" by the TSC. It's important that the Nats requirement 
that they be certified is applied. Also, given 10 judges, it seems 
appropriate to take 10 competitors to the finals and follow the rules 
regarding TBL processing of the scores. (The same applies to a regular Nats, 
5 judges / 10 fliers for the finals and use TBL.)

A much large issue, not getting much attention, is how the prelim scores are 
processed. The number of judges required makes it impossible to ensure that 
everyone is capable. (And no, those that are shouldn't be expected to judge 
more than their share - most of us come to the Nats to compete - not judge.) 
This is important for everyone, but will become more so for FAI with only 4 
rounds of prelims and 2 semi-finals. Most have seen very large differences 
between individual judge scores in the prelims, some more that 100 points. 
This is unacceptable! We should consider methods to fix these anomalies if 
they are as prevalent as some suggest. A review of the Nats scores would 
provide the actual number of occurrences and scope of the issue. (Send me 
the tabulated scores as published on the tear sheets and I'll do the 
calculation.)

One course could be that a judge who differs (in total score) from his/her 
peer group by some large number of  points (high or low) per flight over the 
course of their assignment is considered an outlier and all scores by that 
judge be removed. (Little issue with the occasional disparity of score for 
one maneuver). This assumes the majority is correct and, therefore, the 
average of the two correct scores could replace the outlier. Errant judges 
could be required to re-certify and be given a judging assignment in a lower 
class in subsequent years. Yes, this might embarrass (and tick off) some of 
us who think that we're competent judges, but better a few judges than a 
larger number of pilots who work there butts off only to be shafted.

Earl

 


=================================================
To access the email archives for this list, go to
http://lists.f3a.us/pipermail/nsrca-discussion/
To be removed from this list, go to http://www.nsrca.org/discussionA.htm
and follow the instructions.

List members email returned for mailbox full will be removed from the list.