Partial judgement
Monday, May 24th, 2010On a friday I had diner with 2 good friends of mine and when coming back to their place my friend asked if she could look at the results for X-Factor (one of the many Dutch talent shows; also one of the many I don’t watch) because she liked to see them live. Of course we didn’t mind. It seems the program was running a bit late and there were still performances going on. I wasn’t impressed with what I saw but despite that I thought one of the judges was particularly harsh while another was very mild. When I mentioned this I was told that the judges were also the coaches for some of the contestants. This seemed a little strange to me. They had to judge the people they coached and wanted to succeed themselves?
The mild judge was the coach of the contestant we’ve seen and the harsh one was the coach of an act that had been on the brink on elimination in previous weeks. Of course the former would be mild to take the edge of and of course the latter wanted his act to be the winner. I figured that when it comes to reality tv nothing is real, but when I started to think about a little more I realized that this type of partial judgement goes on all the time.
A few years ago Microsoft started a campaign to prove that running their software was cheaper than running Linux. In order to prove their point they presented a report by an independent researcher. Not long after that Redhat (main competitor of Microsoft in the Linux server market) came up with a similar report from an independent researcher that said their software was the cheapest. Something didn’t seem right here. How could two independent researchers come up with such different results? The answer was easy. In order to satisfy their customers (and get a chance on repeat business) they both structured their research in way that would shed their customers in the best light.
Then more recently there’s the tail of Ab Osterhaus who advised the Dutch government to buy large amounts of a certain serum to fight the Mexican flu. Later it was reported by the media that Osterhaus was an investor in the company that made that particular serum. Although both the manufacturer and Osterhaus deny any wrong-doing, his reputation as an independant advisor took a serious beating.
Let’s be honest, no judgement is impartial. Whether or not the judge/research firm is being paid or some other motive it’s always comes down to his/her own taste or feelings at the time. But here’s one general rule of thumb you can follow: find out where the money comes from when it comes to research results or if a judge has some anterior motive. Only then you’ll know if it’s a case of impartial or partial judgement. ber a