Thought this comment on judging the ARIAs was illuminating:
Upon joining the judging panel for the ARIA awards, I asked for all of the CDs for which engineers and producers had been nominated. My contact at ARIA was perplexed by this request. Dumbfounded, I patiently explained that I couldn’t possibly judge the quality of engineering and production work without listening to the recordings themselves. This was a perfectly reasonable argument, of course, and a box of 40 or so CDs landed on my doorstep shortly afterwards. Likewise one year later. But on the third year they objected, saying I was the only one of a dozen or so judges who asked for the CDs. I don’t know how the other judges made their decisions, but it sure as hell wasn’t from listening to the recordings – unless they happened to be extremely keen fans of Australian-produced music in all shapes and forms, and already owned every CD on the list. Considering the scope of music covered by the nominations (everything from hard rock to soft baroque), I found that highly unlikely. Other factors were obviously at play in the judges’ minds; perhaps basing their decisions on chart figures, sales success, or even less relevant and/or less honest means. Whatever the case, I rapidly began to lose interest in the whole thing. And when five engineers won the same award simultaneously, I knew the system was screwed.