<font color='black' size='2' face='arial'>
<div><FONT style="BACKGROUND-COLOR: transparent">What oftentimes is referred to as Bias is more a Calibration issue that Bias, methinks...</FONT></div>
<div> </div>
<div>20 judges from 20 countries who have no actual means of practicing the art of Judging in each others' countries, are bound to score very differently from one another, regardless of what the good book sez.</div>
<div> </div>
<div>One way to counter the calibration (lack of I should say) issue is to have judges with a known pedigree in a team or a pool, similar to how other sports such as Figure Skating do it. The size of the team could be as many as 50, from a variety of countries, that are tasked to judge the various Finals competitions around the world. FAI pays the bill of course. New blood enters when their pedigree is proven</div>
<div> </div>
<div>Regards</div>
<div> </div>
<div>Matt<br>
<br>
<br>
</div>
<div style="FONT-SIZE: 10pt; COLOR: black; FONT-FAMILY: arial,helvetica">-----Original Message-----<br>
From: Derek Koopowitz <derekkoopowitz@gmail.com><br>
To: 'General pattern discussion' <nsrca-discussion@lists.nsrca.org><br>
Sent: Tue, Aug 20, 2013 11:39 am<br>
Subject: Re: [NSRCA-discussion] World F3A contest<br>
<br>
<div id=AOLMsgPart_2_c661276b-8385-47c2-ac45-bcfdc7cb6422>
<div class=aolReplacedBody lang=EN-US vlink="purple" link="blue">
<div class=WordSection1>
<div class=MsoNormal><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: ">It is really hard to get all 20 judges to be biased especially when they come from all over… in the prelims, if one looks at the scores, there are 5 judges scoring and if the range is somewhat narrow on a maneuver then I really doubt there is bias or collusion – they are obviously seeing the same thing. None of us were there to see what the conditions were like and based on what I’ve heard they were REALLY challenging… </SPAN></div>
<div class=MsoNormal><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: "> </SPAN></div>
<div class=MsoNormal><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: ">We flew in 25 mph winds at the Nats this year, pretty much down the runway… and I know how challenging that was… I saw MANY good Masters pilots struggle (one’s that finished in the top 4 in Masters) with the box and a LOT of them were going out the box on the left side. All the scores that I gave them were well deserved…</SPAN></div>
<div class=MsoNormal><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: "> </SPAN></div>
<div class=MsoNormal><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: "> </SPAN></div>
<div>
<div style="BORDER-RIGHT: medium none; PADDING-RIGHT: 0in; BORDER-TOP: #e1e1e1 1pt solid; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in; BORDER-LEFT: medium none; PADDING-TOP: 3pt; BORDER-BOTTOM: medium none">
<div class=MsoNormal><B><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: ">From:</SPAN></B><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: "> <A href="mailto:nsrca-discussion-bounces@lists.nsrca.org">nsrca-discussion-bounces@lists.nsrca.org</A> [<A href="mailto:nsrca-discussion-bounces@lists.nsrca.org?">mailto:nsrca-discussion-bounces@lists.nsrca.org</A>] <B>On Behalf Of </B>Michael S. Harrison<br>
<B>Sent:</B> Tuesday, August 20, 2013 5:21 AM<br>
<B>To:</B> 'General pattern discussion'<br>
<B>Subject:</B> Re: [NSRCA-discussion] World F3A contest</SPAN></div>
</div>
</div>
<div class=MsoNormal> </div>
<div class=MsoNormal><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: ">biased amateurs,,,,</SPAN></div>
<div class=MsoNormal><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: "> </SPAN></div>
<div>
<div style="BORDER-RIGHT: medium none; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in; BORDER-LEFT: medium none; PADDING-TOP: 3pt; BORDER-BOTTOM: medium none">
<div class=MsoNormal><B><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: ">From:</SPAN></B><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: "> <A href="mailto:nsrca-discussion-bounces@lists.nsrca.org">nsrca-discussion-bounces@lists.nsrca.org</A> [<A href="mailto:nsrca-discussion-bounces@lists.nsrca.org">mailto:nsrca-discussion-bounces@lists.nsrca.org</A>] <B>On Behalf Of </B>Keith Hoard<br>
<B>Sent:</B> Monday, August 19, 2013 5:28 PM<br>
<B>To:</B> General pattern discussion<br>
<B>Subject:</B> Re: [NSRCA-discussion] World F3A contest</SPAN></div>
</div>
</div>
<div class=MsoNormal> </div>
<div>
<div class=MsoNormal>So basically the Team, AMA, sponsors, and various other contributors just spent $50,000 to get scored by a bunch of amateurs. <br>
<br>
Sent from my iPhone</div>
</div>
<div>
<div class=MsoNormal style="MARGIN-BOTTOM: 12pt"><br>
On Aug 19, 2013, at 17:07, "George Kennie" <<A href="mailto:geobet4evr@gmail.com">geobet4evr@gmail.com</A>> wrote:</div>
</div>
<BLOCKQUOTE style="MARGIN-TOP: 5pt; MARGIN-BOTTOM: 5pt">
<div>
<div>
<div>
<div class=MsoNormal>I think that many of these international judges have been uptown most of the day and are familiar with the atmosphere that they are operating in and it's potential to reward or penalize them for significant discrepancies in their scoring awards.</div>
</div>
<div>
<div class=MsoNormal> </div>
</div>
<div>
<div class=MsoNormal>Possible mental bias exercises: " Let's see now, here comes CPLR, (He's GOOD ! ), this is TBL scoring, I know that all the other judges will grade him highly and if I don't want to stick out like a sore thumb I'd better do likewise"</div>
</div>
<div>
<div class=MsoNormal> </div>
</div>
<div>
<div class=MsoNormal>Think that's too harsh? I don't think so. I know that everybody thinks that I'm a nut case, but I don't care. I scored these guys in Twenty Eleven and I saw 5 pilots who outpointed CPLR and I also witnessed the surprise on his face when they proclaimed him the winner. Am I biased? I don't think so. CPLR is a great guy to talk to. He and I had great conversations regarding force arrangements and I found him to be a wonderful down to earth all around terrific person, but this isn't a personality contest. Your mission is to outpoint your opponents and according to my numbers he didn't do that. Of course you can say that I know absolutely zero about judging, but that's an opinion that would take some amount of verification. I say that my scores were not TBL modified and possibly reflected more accurate raw numbers </div>
</div>
<div>
<div class=MsoNormal> </div>
</div>
<div>
<div class=MsoNormal>I was convinced that the whole international panel could have been classified as individuals who had met poor certification standards, but could it be possible that TBL influenced the outcome in some way? </div>
</div>
<div>
<div class=MsoNormal> </div>
</div>
<div>
<div class=MsoNormal>Nah!, I think I'm sticking to my original conclusion.</div>
</div>
<div>
<div class=MsoNormal> </div>
</div>
<div>
<div class=MsoNormal>G.</div>
</div>
</div>
<div>
<div class=MsoNormal style="MARGIN-BOTTOM: 12pt"> </div>
<div>
<div class=MsoNormal>On Mon, Aug 19, 2013 at 10:08 AM, Stuart Chale <<A href="mailto:schale1@verizon.net">schale1@verizon.net</A>> wrote:</div>
<div class=MsoNormal>Each Worlds the scoring always always causes me "to raise an eyebrow" I can't say surprises me because we have seen it before. For most flyers the scores seem lower than we would expect. Lower than they would receive at the Nats never mind local contests. Did Joseph really deserve 6's on a half loop turnaround. Did he have 60 degrees of error or fly a half hexagon? Are the Judges that much better than the rest of us that they are seeing the errors that we don't? Or are they upping the bar with an unwritten rule ( 1 point / 5 degrees etc) . Any 10's given out?<br>
I know the top fliers are difficult to differentiate until the finals and unknowns and usually it works out that the best flyer wins, I just like to see the same criteria used at all contests.<br>
<br>
Or maybe I am not as good a judge as I think :)<br>
<br>
Stuart C.</div>
<div>
<div>
<div class=MsoNormal><br>
_______________________________________________<br>
NSRCA-discussion mailing list<br>
<A href="mailto:NSRCA-discussion@lists.nsrca.org">NSRCA-discussion@lists.nsrca.org</A><br>
<A href="http://lists.nsrca.org/mailman/listinfo/nsrca-discussion" target=_blank>http://lists.nsrca.org/mailman/listinfo/nsrca-discussion</A></div>
</div>
</div>
</div>
<div class=MsoNormal> </div>
</div>
</div>
</BLOCKQUOTE>
<BLOCKQUOTE style="MARGIN-TOP: 5pt; MARGIN-BOTTOM: 5pt">
<div>
<div class=MsoNormal>_______________________________________________<br>
NSRCA-discussion mailing list<br>
<A href="mailto:NSRCA-discussion@lists.nsrca.org">NSRCA-discussion@lists.nsrca.org</A><br>
<A href="http://lists.nsrca.org/mailman/listinfo/nsrca-discussion" target=_blank>http://lists.nsrca.org/mailman/listinfo/nsrca-discussion</A></div>
</div>
</BLOCKQUOTE></div>
</div>
</div>
<div id=AOLMsgPart_3_c661276b-8385-47c2-ac45-bcfdc7cb6422 style="FONT-SIZE: 12px; MARGIN: 0px; COLOR: #000; FONT-FAMILY: Tahoma, Verdana, Arial, Sans-Serif; BACKGROUND-COLOR: #fff"><PRE style="FONT-SIZE: 9pt"><TT>_______________________________________________
NSRCA-discussion mailing list
<A href="mailto:NSRCA-discussion@lists.nsrca.org">NSRCA-discussion@lists.nsrca.org</A>
<A href="http://lists.nsrca.org/mailman/listinfo/nsrca-discussion" target=_blank>http://lists.nsrca.org/mailman/listinfo/nsrca-discussion</A>
</TT></PRE></div>
<!-- end of AOLMsgPart_3_c661276b-8385-47c2-ac45-bcfdc7cb6422 --></div>
</font>