<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html>
<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 10 (filtered)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Garamond;
panose-1:2 2 4 4 3 3 1 1 8 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
p
{margin-right:0in;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman";}
p.Normal1, li.Normal1, div.Normal1
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
p.Normal2, li.Normal2, div.Normal2
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
p.Normal3, li.Normal3, div.Normal3
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
p.Normal4, li.Normal4, div.Normal4
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
span.Hyperlink1
{color:blue;
text-decoration:underline;}
p.Normal5, li.Normal5, div.Normal5
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
span.Hyperlink2
{color:blue;
text-decoration:underline;}
span.Hyperlink3
{color:blue;
text-decoration:underline;}
p.Normal6, li.Normal6, div.Normal6
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
span.Hyperlink4
{color:blue;
text-decoration:underline;}
span.Hyperlink5
{color:blue;
text-decoration:underline;}
span.FollowedHyperlink1
{color:purple;
text-decoration:underline;}
p.Normal7, li.Normal7, div.Normal7
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
span.Hyperlink6
{color:blue;
text-decoration:underline;}
span.Hyperlink7
{color:blue;
text-decoration:underline;}
span.FollowedHyperlink2
{color:purple;
text-decoration:underline;}
span.FollowedHyperlink3
{color:purple;
text-decoration:underline;}
p.Normal8, li.Normal8, div.Normal8
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
span.Hyperlink8
{color:blue;
text-decoration:underline;}
span.Hyperlink9
{color:blue;
text-decoration:underline;}
span.FollowedHyperlink4
{color:purple;
text-decoration:underline;}
span.FollowedHyperlink5
{color:purple;
text-decoration:underline;}
span.EmailStyle40
{font-family:Arial;
color:navy;}
p.Normal9, li.Normal9, div.Normal9
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
span.Hyperlink10
{color:blue;
text-decoration:underline;}
span.Hyperlink11
{color:blue;
text-decoration:underline;}
span.FollowedHyperlink6
{color:purple;
text-decoration:underline;}
span.FollowedHyperlink7
{color:purple;
text-decoration:underline;}
span.EmailStyle46
{font-family:Arial;
color:navy;}
span.EmailStyle48
{font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body bgcolor=white lang=EN-US link="#000000" vlink="#000000">
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Jerry</span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>As with you and Lamar, Mike ALWAYS knew
why he took every point. I scribed for him at Decatur a few years ago
when he 0’ed an unnamed Louisiana pilot of Italian descent on a Cuban 8
of some flavor mostly on heading changes. Mike leaned over and whispered
that I should make a note because the pilot would surely ask. The
maneuver was very recognizable headings varied badly and he missed the
cross-over. If you know the pilot, you can imagine his reaction.
Mike told him where every point went. He settled down and took it.</span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<div>
<p><font size=2 color=navy face="Times New Roman"><span style='font-size:10.0pt;
color:navy'>Steve Byrum </span></font></p>
<p><font size=2 color=navy face="Times New Roman"><span style='font-size:10.0pt;
color:navy'>(256)737-9828</span></font></p>
</div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>-----Original Message-----<br>
<b><span style='font-weight:bold'>From:</span></b>
nsrca-discussion-bounces@lists.nsrca.org [mailto:nsrca-discussion-bounces@lists.nsrca.org]
<b><span style='font-weight:bold'>On Behalf Of </span></b>Jerry Stebbins<br>
<b><span style='font-weight:bold'>Sent:</span></b> Friday, October 19, 2007
1:53 PM<br>
<b><span style='font-weight:bold'>To:</span></b> NSRCA Mailing List<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [NSRCA-discussion]
Judging</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Del, down here we used to have a
judge named Mike Dunphy. Hard judge-tough judge-usually lowest score. I watched
many of his scores get pitched since he was the "low one" so that
made him always wrong. Funny how that encourages new judges to "score
safe".</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Jerry</span></font></p>
</div>
<blockquote style='border:none;border-left:solid black 1.5pt;padding:0in 0in 0in 4.0pt;
margin-left:3.75pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt'>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>----- Original Message ----- </span></font></p>
</div>
<div style='font-color:black'>
<p class=MsoNormal style='margin-left:.5in;background:#E4E4E4'><b><font size=2
face=Arial><span style='font-size:10.0pt;font-family:Arial;font-weight:bold'>From:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> <a
href="mailto:drykert2@rochester.rr.com" title="drykert2@rochester.rr.com">Del
K. Rykert</a> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>To:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> <a
href="mailto:nsrca-discussion@lists.nsrca.org"
title="nsrca-discussion@lists.nsrca.org">NSRCA Mailing List</a> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>Sent:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> Friday,
October 19, 2007 1:22 PM</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>Subject:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> Re:
[NSRCA-discussion] Judging</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=blue face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:blue'>I feel the same way
Jerry.. Having nailed someone for a top hat down upright, 2 spins for 3
turn, extra half roll.. not doing next proper maneuver.etc.. etc.. Have
zeroed 3 maneuvers in row before pilot gets back in proper sequence. We
all know the drill. But the judge that catches them who is also doing it
right is the one who is penalized.. Sure makes one want to man the judges chair
doesn't it.. If all your work and effort to do the job right is just
going to be thrown out because someone feels the judge who scored low is wrong
is not sending the right message to those who try to be honest and accountable
judges. What is promoted is the old play it safe and throw out a 7 or 8
and all are happy. Well except for the pilot who cares... <tic agn>
</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=blue face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:blue'>
Del</span></font></p>
</div>
<blockquote style='border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt;
margin-left:3.75pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt'>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>----- Original Message ----- </span></font></p>
</div>
<div style='font-color:black'>
<p class=MsoNormal style='margin-left:.5in;background:#E4E4E4'><b><font size=2
face=Arial><span style='font-size:10.0pt;font-family:Arial;font-weight:bold'>From:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> <a
href="mailto:JAStebbins@worldnet.att.net" title="JAStebbins@worldnet.att.net">Jerry
Stebbins</a> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>To:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> <a
href="mailto:nsrca-discussion@lists.nsrca.org"
title="nsrca-discussion@lists.nsrca.org">Discussion -NSRCA</a> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>Sent:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> Friday,
October 19, 2007 1:03 PM</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>Subject:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> [NSRCA-discussion]
Judging</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
</div>
<div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Derek, I followed your summary
pretty well until the first sentence in the third paragraph. "system works
very well and in the end the correct order of finish is picked- which is what
we want" </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Where is "correct "
quantified? </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Who says what is
"correct"? </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>What says that one judge being low
on a maneuver is "wrong"/</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Sounds more like the scenario
previously mentioned as the "7 to 9 syndrome" is the safe way to
score.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>How many times have you scored a
zero and others gave a score-in error- because the pilot rolled the wrong way?
By the way throwing out the old requirement that the judges confer on zeros has
only helped get us in this "perceived" problem.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Sure sounds like a "dry
lab" approach to me! Easy to massage data and the algorithms to
"prove" the result desired. </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>I went through the dataseveral years
ago, that was available-and it was not all-on the "Judges ratings",
and got the same gut feeling.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>What the pilot sees/flies, and his
caller sees, and what each judge sees are seldom the same for a multitude of
reasons. </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Also as a judge, have you ever had a
"watcher" come up after a flight and say how great the flight was-
and you had just given several zeros/low scores. Amazing how they change their
perspective when you point out the obvious errors. That is assuming your memory
hasn't blanked out the past pilot yet, and now you are getting ready for
the next.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Jerry </span></font></p>
</div>
<blockquote style='border:none;border-left:solid black 1.5pt;padding:0in 0in 0in 4.0pt;
margin-left:3.75pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt'>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>----- Original Message ----- </span></font></p>
</div>
<div style='font-color:black'>
<p class=MsoNormal style='margin-left:.5in;background:#E4E4E4'><b><font size=2
face=Arial><span style='font-size:10.0pt;font-family:Arial;font-weight:bold'>From:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> <a href=""
title="derekkoopowitz@gmail.com">Derek Koopowitz</a> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>To:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> <a href=""
title="nsrca-discussion@lists.nsrca.org">'NSRCA Mailing List'</a> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>Sent:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> Thursday,
October 18, 2007 11:25 PM</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>Subject:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> Re:
[NSRCA-discussion] D3 Championship - Scoring SystemOverhaul-LONG</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=blue face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:blue'>TBL - scores go back to
the pilots as is... raw. TBL is only factored once a round is finished
and the results calculated. With TBL scores are adjusted to the whole
score and result in whole numbers. Remember, the entire score isn't
thrown out - just a maneuver score. When a score is dropped then TBL is
run on the entire set of scores again to recalculate the mean and std.
deviation - it is an iterative process until all scores fall within the range
that are calculated for the pilots/judges.</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=blue face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:blue'>TBL was used at the TOC
for all years starting in 1999 onwards. It has been used at the WC since
2001 (I think).</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=blue face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:blue'>Bottom line - the system
works very well and in the end the correct order of finish is picked -
which is what we want. In all the years of scoring with TBL at the TOC I
saw very few judges scores discarded which probably says more about the quality
of judging than anything else. I'd be very curious what the results have
been at the F3A WC's since it was implemented.</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=blue face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:blue'>I would love to see TBL
in use at the Nats for the Finals in both classes - we certainly have enough
judges to support its use.</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
<div class=MsoNormal align=center style='margin-left:.5in;text-align:center'><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>
<hr size=2 width="100%" align=center>
</span></font></div>
<p class=MsoNormal style='margin-right:0in;margin-bottom:12.0pt;margin-left:
.5in'><b><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:
Tahoma;font-weight:bold'>From:</span></font></b><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>
nsrca-discussion-bounces@lists.nsrca.org
[mailto:nsrca-discussion-bounces@lists.nsrca.org] <b><span style='font-weight:
bold'>On Behalf Of </span></b>rcmaster199@aol.com<br>
<b><span style='font-weight:bold'>Sent:</span></b> Thursday, October 18, 2007
8:51 PM<br>
<b><span style='font-weight:bold'>To:</span></b> nsrca-discussion@lists.nsrca.org<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [NSRCA-discussion] D3
Championship - Scoring System Overhaul-LONG</span></font></p>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Earl,</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>If I remember correctly, some of the
results from the Judge Evaluation have been presented either in the KF or the
website in past years. But I haven't seen any results posted lately.
Perhaps you are right...posting might serve a purpose.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Curious...in the TBL method, do the
adjustments to a judge's scores come in whole or fractional numbers? How are
the scoresheets that are given back to the pilots handled.....I mean, do they
show adjusted scores or as judged? Or both?</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Koop, was TBL used in the TOC? </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>If we have access to the algorithm,
I wouldn't mind taking a peek of how the 2007 F3A Nats Final could turn out. I
would bet that it wouldn't make much difference on where the pilots
placed.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Matt</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<p class=MsoNormal style='margin-right:0in;margin-bottom:12.0pt;margin-left:
.5in'><font size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>-----Original
Message-----<br>
From: Earl Haury <ejhaury@comcast.net><br>
To: NSRCA Mailing List <nsrca-discussion@lists.nsrca.org><br>
Sent: Thu, Oct 18 10:24 PM<br>
Subject: Re: [NSRCA-discussion] D3 Championship - Scoring System Overhaul -LONG</span></font></p>
<div id="AOLMsgPart_3_850a6352-9570-4af6-a752-5bdc9529c253">
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>We miss an opportunity for judges
to evaluate their performance by not distributing the results of the
analysis of that performance (at major meets). I, for one, would like the
judges performance data to be published in the K-Factor (after all - the pilots
scores are published). However, realizing that some are squeamish about this, I
think that we should still provide each judge with the analysis of his / her
specific performance. At least, each judge would then have an indication of
their current skills and any variation over the years.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Earl</span></font></p>
</div>
<blockquote style='border:none;border-left:solid black 1.5pt;padding:0in 0in 0in 4.0pt;
margin-left:3.75pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt'>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>----- Original Message ----- </span></font></p>
</div>
<div style='font-color:black'>
<p class=MsoNormal style='margin-left:.5in;background:#E4E4E4'><b><font size=2
face=Arial><span style='font-size:10.0pt;font-family:Arial;font-weight:bold'>From:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> <a href=""
title="derekkoopowitz@gmail.com">Derek Koopowitz</a> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>To:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> <a href=""
title="nsrca-discussion@lists.nsrca.org">'NSRCA Mailing List'</a> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>Sent:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> Thursday,
October 18, 2007 7:53 PM</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><b><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial;font-weight:bold'>Subject:</span></font></b><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> Re:
[NSRCA-discussion] D3 Championship - Scoring System Overhaul -LONG</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=blue face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:blue'>I'll post my dissertation
on TBL again since this issue seems to crop up time and time again...</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
<div>
<table cellspacing=0 cellpadding=0 hspace=0 vspace=0>
<tr>
<td valign=top align=left style='padding-top:0in;padding-right:3.0pt;
padding-bottom:0in;padding-left:3.0pt'>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>The Tarasov-Bauer-Long (TBL)
Scoring method has been around since the 1970’s. It has been used
in the full size arena since 1978 and has been used at every full size IAC
World Championship since 1980. The TBL method applies proven
statistical probability theory to the judge’s scores to resolve style
differences and bias, and to avoid the inclusion of potential faulty
judgements in contest results. To understand just why we need TBL, and
how it works, is if considerable importance to us all. It is important
to the pilots because it is there to reduce the prospect of unsatisfactory
judgements affecting their results, and it is important for judges because it
will introduce a completely new dimension of scrutiny into the sequence
totals, and it will also discreetly engage the attention of the Chief Judge,
or Contest Director, if the judges conclusions differ sufficiently from all
those other judges on the same panel.</span></font></p>
</div>
</td>
</tr>
</table>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>When people get together to judge
how well a pre-defined competitive task is being tackled, the range of opinions
is often diverse. This is entirely natural among humans where the
critique of any display of skill relies on the interpretation of rapidly
changing visual cues. In order to minimize the prospect of any “way
out opinions” having too much effect on the result, it is usual to
average the accumulated scores to arrive at a final assessment, which takes
everybody’s opinion into account. Unfortunately this averaging
approach can achieve the opposite of what we really want, which is to identify,
and where needed, remove those “way out opinions” because they are
the ones most likely to be ill-judged and therefore should be discarded,
leaving the rest to determine the more appropriate result.</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>In aerobatics the process of
judging according to the rulebook normally leads to a series of generally
similar personal views. However, one judge’s downgrading may be
harsher or more lenient than the next, their personal feelings toward each
competitor or aircraft type may predispose toward favor or dislike (bias), and
they will almost certainly miss or see things that other judges do not.
How then can we “judge” the judges and so reach a conclusion, which
has good probability of acceptance by all the concerned parties?</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>The key word is <b><i><span
style='font-weight:bold;font-style:italic'>probability</span></i></b>, the
concept of a perceived level of confidence in collectively viewed judgements
has entered the frame. What we really mean is that we must be confident
that opinions pitched outside some pre-defined level of reasonable acceptability
will be identified as such and will not be used. This sort of situation
is the daily bread and butter of well established probability theory which,
when suitably applied, can produce a very clear cut analysis of numerically
expressed opinions provided that the appropriate criteria have been carefully
established beforehand.</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>What has been developed through
several previous editions is some arithmetic which addresses the judge’s
raw scores in such a way that any which are probably unfair are discarded with
an established level of confidence. To understand the process you need
only accept some quite simple arithmetic procedures, which are central to what
is called “statistical probability”.</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>The TBL scoring system in effect
does the following:</span></font></p>
</div>
<div style='margin-left:.75in;margin-right:.25in;margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in;text-indent:-.25in'><font size=4
face=Symbol><span style='font-size:14.0pt;font-family:Symbol'>·</span></font><font
size=1><span style='font-size:7.0pt'>
</span></font><font size=2 face=Garamond><span style='font-size:10.0pt;
font-family:Garamond'>Commonizes the judging styles.</span></font></p>
</div>
<div style='margin-left:.75in;margin-right:.25in;margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in;text-indent:-.25in'><font size=4
face=Symbol><span style='font-size:14.0pt;font-family:Symbol'>·</span></font><font
size=1><span style='font-size:7.0pt'>
</span></font><font size=2 face=Garamond><span style='font-size:10.0pt;
font-family:Garamond'>Computes TBL scores</span></font></p>
</div>
<div style='margin-left:.75in;margin-right:.25in;margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in;text-indent:-.25in'><font size=4
face=Symbol><span style='font-size:14.0pt;font-family:Symbol'>·</span></font><font
size=1><span style='font-size:7.0pt'>
</span></font><font size=2 face=Garamond><span style='font-size:10.0pt;
font-family:Garamond'>Publishes results</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>Commonizing the judging styles
involves remodeling the scores to bring all the judging styles to a common
format and removing any natural bias between panel members. Following
some calculations, each judge’s set of scores are squeezed or stretched
and moved en-bloc up or down so that the sets all show the same overall spread
and have identical averages (bias). Within each set the pilot order and
score progression must remain unaltered, but now valid score comparisons are
possible between all the panel judges on behalf of each pilot.</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>Computing the TBL score involves
looking at the high and low scores in each pilot’s set and throws out any
that are too “far out” to be fair. This is done by
subtracting the average for the set from each one and dividing the result by
the “sample standard deviation” - if the result of this sum is
greater than 1.645 then according to statistical probability theory we can be
at least 90% confident that it is unfair, so the score is discarded. This
calculation and the mathematically derived 1.645 criteria is the key to the
correctness of the TBL process, and is based on many years of experience by the
full size aerobatics organization with contest scores at all levels. The
discarding of any scores of course changes for a pilot the average and standard
deviation of their remaining results, and so the whole process is
repeated. After several cycles any “unfair” scores will have
gone, and those that remain will all satisfy the essential 90% confidence
criteria.</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>Publishing the results is derived
by averaging each pilot’s scores. The final TBL iteration therefore
has any appropriate penalty/bonus values applied and the results are then
sorted in order of descent of the total scores to rank the pilots first to
last. These final scores may, or may not, be normalized to 1000 points,
depending on the setting for the selected class.</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>Educating and improving the
judges is a useful by-product of this process in that it provides all the bells
and whistles how each judge has performed by comparison with the overall
judging panel average and when seen against the 90% level of confidence
criteria. The TBL system will produce an analysis showing each judge the
percentage of scores accepted as “OK”, and a comparison with the
panel style (spread of score) and bias (average).</span></font></p>
</div>
<div style='margin-bottom:12.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Garamond><span
style='font-size:10.0pt;font-family:Garamond'>Unfortunately TBL, by definition,
brings with it a 10% possibility of upsetting an honest judge’s
day. The trade-off is that we expect not only to achieve a set of results
with at least 90% confidence that are “fair” every time, but that
the system also provides us with a wonderful tool to address our judging standards.
TBL will ensure that every judge’s opinion has equal weight, and that
each sequence score by each judge is accepted only if it lies within an
acceptable margin from the panel average. TBL, however, by necessity
takes the dominant judging panel view as the “correct” one and it
can’t make right scores out of wrong ones. If 6 out of 8 judges are
distracted and make a mess out of one pilots efforts, then for TBL this becomes
the controlling assessment of that pilots performance, and the other 2 diligent
judges who got it right will see their scores unceremoniously zapped. In
practice this would be extremely unusual - from the judging line it is almost
impossible to deliberately upset the final results without collusion between a
majority of the judges, and if that starts to happen then someone is definitely
on the wrong planet.</span></font></p>
</div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
<div class=MsoNormal align=center style='margin-left:.5in;text-align:center'><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>
<hr size=2 width="100%" align=center>
</span></font></div>
<p class=MsoNormal style='margin-right:0in;margin-bottom:12.0pt;margin-left:
.5in'><b><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:
Tahoma;font-weight:bold'>From:</span></font></b><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'> <a href="">nsrca-discussion-bounces@lists.nsrca.org</a>
[<a href="">mailto:nsrca-discussion-bounces@lists.nsrca.org</a>] <b><span
style='font-weight:bold'>On Behalf Of </span></b><a href="">vicenterc@comcast.net</a><br>
<b><span style='font-weight:bold'>Sent:</span></b> Thursday, October 18, 2007
8:11 AM<br>
<b><span style='font-weight:bold'>To:</span></b> NSRCA Mailing List<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [NSRCA-discussion] D3
Championship - Scoring System Overhaul</span></font></p>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Tony,</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Do you know if the TBL
system eliminates the high and low scores? I think that is a good
solution but we can not do it in local contests. Probably we could in
some contests since we have many Masters vs. F3A. </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>Do you know
"link" where we can read about TBL system?</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div id=signature>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>--<br>
Vicente "Vince" Bortone</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<blockquote style='border:none;border-left:solid #1010FF 1.5pt;padding:0in 0in 0in 4.0pt;
margin-left:3.75pt;margin-top:5.0pt;margin-bottom:5.0pt'>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>-------------- Original message
-------------- <br>
From: "Tony" <<a href="">tony@radiosouthrc.com</a>> </span></font></p>
<div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'>This TBL will find these
problems and is in use at World Champs. The problem is that you need at
least 5 judges on a line.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> </span></font></p>
</div>
<div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'>Tony Stillman, President</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'>Radio South, Inc.</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'>139 Altama Connector, Box
322</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'>Brunswick, GA 31525</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'>1-800-962-7802</span></font></p>
</div>
<div>
<p class=MsoNormal style='margin-left:.5in'><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'><a href=""><u><font
color=blue><span style='color:blue'>tony@radiosouthrc.com</span></font></u></a></span></font></p>
</div>
</div>
<div>
<div class=MsoNormal align=center style='margin-left:.5in;text-align:center'><font
size=3 face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center>
</span></font></div>
</div>
</div>
</blockquote>
</blockquote>
</div>
</blockquote>
</div>
<div class=MsoNormal align=center style='margin-left:.5in;text-align:center'><font
size=3 face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center>
</span></font></div>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'>_______________________________________________<br>
NSRCA-discussion mailing list<br>
NSRCA-discussion@lists.nsrca.org<br>
http://lists.nsrca.org/mailman/listinfo/nsrca-discussion</span></font></p>
</blockquote>
<div class=MsoNormal align=center style='margin-left:.5in;text-align:center'><font
size=3 face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center>
</span></font></div>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'>_______________________________________________<br>
NSRCA-discussion mailing list<br>
NSRCA-discussion@lists.nsrca.org<br>
http://lists.nsrca.org/mailman/listinfo/nsrca-discussion</span></font></p>
</blockquote>
</div>
</body>
</html>