Rotten Tomatoes is still my favourite site for film reviews. You get a percentage score for each film, a summary of each review, and – most importantly – a link to the original reviews themselves.
But every now and then it drives me mad. It scores each movie solely on the basis of how many positive reviews it has, but it doesn’t give any weighting to each review. So if 100/100 reviewers quite like a film (and give it say 3 stars out of 5), it gets the same score – 100% – as it would if 100/100 reviewers absolutely adore the film (and give it say 5 stars out of 5). So a bland, unprovocative film that managed to mildly please most critics would get a very high score.
This is what set me off last week: I went to see Moneyball partly on the basis that it got 95% on Rotten Tomatoes. Yes, it’s a well-made and thought-provoking film; but it’s also boring, over-long, and not half as funny or intelligent as it should be. This is what the Rotten Tomatoes scoring system can do.
(Maybe I am unjustifiably taking it out on this innocent website. It still got a staggering 87% on Metacritic. Maybe, in this case, it’s the critics themselves who are almost universally wrong. How can Robbie Collin at the Daily Telegraph call it ‘an accomplished, bracingly intelligent film that scores points on all fronts…’?!)
The solution to this problem? Do what Metacritic does. Instead of just adding up the number of positive reviews a film gets, give a certain weighting to each review according to how positive the reviewer was. They also (I’ve just found out) give some reviewers greater weight – as if they trust their judgment more than others. And, it has to be said, the site is really crisp and beautiful – unlike the Rotten Tomatoes site.
Here is the explanation:
A peek behind the curtain
Creating our proprietary Metascores is a complicated process. We carefully curate a large group of the world’s most respected critics, assign scores to their reviews, and apply a weighted average to summarize the range of their opinions. The result is a single number that captures the essence of critical opinion in one Metascore. Each movie, game, television show and album featured on Metacritic gets a Metascore when we’ve collected at least four critics’ reviews.
Why the term “weighted average” matters
Metascore is a weighted average in that we assign more importance, or weight, to some critics and publications than others, based on their quality and overall stature. In addition, for music and movies, we also normalize the resulting scores (akin to “grading on a curve” in college), which prevents scores from clumping together.
How to interpret a Metascore
Metascores range from 0-100, with higher scores indicating better overall reviews. We highlight Metascores in three colors so that you can instantly compare: green scores for favorable reviews, yellow scores for mixed reviews, and red scores for unfavorable reviews.
Why do I stay with Rotten Tomatoes? Simply because the UK site gives you reviews from the UK press, which Metacritic doesn’t, and lists the films under their UK launch date – so you can see what is out this week. If there were a UK Metacritic I would switch to it immediately. And if I had time I’d set about developing one. Maybe there is some money to be made here…