It is a big problem and one of the reasons to resist making lists like this, or at least taking them too seriously.
One the suggestions Quinno makes is to reduce the relevance of ratings over time which would help with this issue. Once I work out how to actually do that I'll give it a go and see what sort of a list we end up with.
Like the idea (haven't looked at the list yet, so don't know if I'll like the results).
I agree with what Quinno and Tris said about older reviews, so it would be good if some sort of weighting for age (of review rather than reviewer, obviously) could be incorporated. (Edit: We appear to have been typing simultaneously.)
Slightly concerned about the maths failure.
Come On You Hatters!
A couple of examples: Swan & Rushes has not been reviewed for four years, and I think I have read somewhere that it is now a pale shadow of its former self; The Leopold has been mentioned in the context of the March 2019 visit to Portsmouth & Southsea - the last review in its pomp is 30 months old but two more recent reviews, reporting the closure and change of style, are without scores so presumably have no effect. These pubs are currently 82 and 89 respectively. (This is not meant as mere carping, just examples of the problem - and hopefully you'll get an idea of a fix from this.)
Come On You Hatters!
Indeed.
I also think that, as suggested earlier, a reviewer's rating shouldn't apply unless they have submitted a minimum number of reviews to help rule out 'spikes' in the ratings due to a person's personal grievance (which if they are a publican/manager) could have been submitted to discredit competition, or boost the rating of their own venture. You'd need to discount a fair number (say their first 10), just in case the reviewer manages a pubco chain. Won't stop Tim Martin though...
Interesting! There's a danger, is there not, of reviewers making special trips to "Top 100" pubs, which would then tend to reinforce the pubs' places in that top 100, thus making it more and more difficult for improving or newly discovered pubs to make their way up the list.
Probably best not to take the whole thing too seriously, as Dave has already mentioned.
Come On You Hatters!
I think this is a great idea,and I look forward to future tweaks.
When in an area that I'm not familiar ,I may well be tempted to visit a pub that appears on this list to see what all the fuss is about.
It's all a bit of fun,but with many very knowledgeable reviewers on PuG it's a list that should have a lot more credibility that the ones we normally comment on.
"Good people drink good beer" Hunter S Thompson