Performance Judging? (back to original discussion)

[Earl Haury]

Bob

I tend to agree with you that the judge scoring lower may be (correctly) 
seeing more defects, especially on complex maneuvers. What I don't know how 
to handle is the situation where a pretty flawless (not too complex) 
maneuver is severely hammered by one judge. We've pretty clear metrics in 
place to define the appropriate downgrades - do some double those? Do they 
double deduct - 1 / 15 for an error and another 1 / 15 for the correction? 
Do they deduct a whole point for a 5 degree error? Are they watching the 
wrong airplane? I don't know the answer, but I've seen enough score sheets 
to recognize that some judges consistently score errors much lower than 
their peer group, while scoring (relatively) flawless maneuvers generally 
high. Maybe they (inappropriately) award points for smoothness, but the 
consequence isn't "more critical - but consistent ( if outside the rules)", 
but an inappropriately larger delta score between nearly equal quality 
flights.

There may not be a way to legitimately smooth well intentioned, if 
erroneous, scores when the number of judges is low, and I really do 
appreciate the efforts of everyone that sits in the judges chair. But what 
would we do if someone (at -say the Nats) chose to score all zeros or all 
tens?

Earl



----- Original Message ----- 
From: "Bob Richards" <bob at toprudder.com>
To: <discussion at nsrca.org>
Sent: Thursday, August 04, 2005 1:35 PM
Subject: RE: Performance Judging? (back to original discussion)


> Ed,
>
> I tend to put more faith in the lower scores. This is
> especially true on high difficulty manuevers since
> there are more opportunity for downgrades.
>
> I have, on at least one occasion, given a zero for a
> maneuver when there were no mandatory zero mistakes
> made. Just because the maneuver was flown, and may
> have even been recognizable, doesn't mean that it
> deserves a non-zero score.
>
> The snap "did it stall first" problem is, itself, a
> judgement call.
>
> Bob R.
>
> --- Ed Deaver <divesplat at yahoo.com> wrote:
>
>> As stated, judges are human, and just because
>> someone gives a low score doesn't make them
>> incorrect.
>>
>> ed
>
> =================================================
> To access the email archives for this list, go to
> http://lists.f3a.us/pipermail/nsrca-discussion/
> To be removed from this list, go to http://www.nsrca.org/discussionA.htm
> and follow the instructions.
>
> List members email returned for mailbox full will be removed from the 
> list.
>
> 


=================================================
To access the email archives for this list, go to
http://lists.f3a.us/pipermail/nsrca-discussion/
To be removed from this list, go to http://www.nsrca.org/discussionA.htm
and follow the instructions.

List members email returned for mailbox full will be removed from the list.