geocorn said:
Well, I for one can not figure out the judging. All of the Choc. Rasp. Ports and Orange Choc Port that did win, how did one not win. In addition,I entered a Pacific Quartet and did not win while others did. I entered wines that are HUGE successes when tasted that did not win. I am starting to feel there is some bias in the judging. No intentional, but there, no less.
COL Bill, George, and myself had a long conversation about this whole judging topic over dinner last night. I think that it is next impossible to avoid some subjectivity in wine judging, and I would expect the magnitude of the WM Mag competition to compound that.
Looking at the numbers in the program, they had 4474wines with 844 flights, 5 wines/flight. 1118 judging hours, or approximately1.32 judging hours per flight. With 3 judges/panel, that translates into26 minutes/flight. This probably means that there were about30 min allocated per flight.
At 844 flights, that means 277 flights/day (accounting for "best of" flights). If wines are judged for 6 judging hours/day, at30 min/flight, that would be12 sessions/day. (277 flights/day)/(12 sessions/day)=23-24 flights/ session. With 3 judges/panel, that means there are probably over70 judges each day, and each judge will taste around 120 wines/day.
Granted, that is not exact, but if there is anything near70 judges there will be a lot of variation. Even using the UC Davis scoring system, between fatigue, inevitable personal bias, and the massive number of wines involved, there will be an element of chance.
One of the things we discussed to "test the system" would be to have the same wine entered by 3 or 4 people to see how each of the entries scores. In a perfect system they would all score the same, but I doubt that would happen here. Maybe we will find out next year.