I definitely think more information would help
Where am I voting against the community? Where am I doing well at agreements?
What caused the change in rating?
Etc
2 Likes
I totally agree with this , more information we got , faster we can progress our voting skill and more efficient we will become .
2 Likes
Im back to great again by 9:30, first thing I was still good.
It literally is a case of as soon as I review more than 1 or 2, down it goes, but then it comes back eventually when the reviews are resolved.
It makes me really concerned though what if I didnt stop when it goes good - how many more to drop to fair? And how many disagreements can I get before I never recover?
2 Likes
My guess is that the whole agreements system design was intentional to prevent people from knowing how other people voted, to ensure reviews were being done based on criteria instead of collaboration on what should be accepted. A person who follows criteria would, in theory, have more agreements. But with everything we review a 50/50 toss up, this doesn’t work anymore.
5 Likes
You’re probably right.
I hate feeling like Im not doing a good job and unable to improve because of no real feedback though
Mayve the answer is I don’t have to improve and that the rating system isnt working properly anymore
3 Likes
I think they should remove the existance of rating. It doesn’t help anymore and causes only problems and weird behaviour
1 Like
Hmm… just drop the rating! That’s so simple!
But some kind of check would still need to be in place for reviewers, I think.
2 Likes
Presumably if the “educational ban warning email” etc is a strong enough part of the process, then it doesnt seem worth punishing people trying to review the endless stream of mediocrity currently available by taking away their in game medal progress, making their reviews mean less, and demoralising them by telling them theyre no good at their job when they couldn’t possibly have done better
If they keep the visible ratings then at least tell us what we did wrong and how to do better
5 Likes
I’m right there with you. I’ve been reviewing for a while, and enjoy it when I can find the time. My rating has been “Great” for as long as I’ve been paying attention, but this week I’ve dropped to “Fair.” Haven’t changed the way I rate - but I’m dropping fast. Definitely not encouraging me to do more.
5 Likes
I am still at fair.
I have dropped off reviewing. I am still sticking to the criteria. And not changing my system. So defo rejecting a few.
But if I see something I don’t trust. I stop reviewing and go do something else. So defo doing less.
That said. I am still getting punished. And I strongly use that word. For the system to change so dramatically so quickly. Implies a flaw in the system that is punishing people for doing right thing.
It clearly shows the flaws in reviewing currently when so many things are accepted that are at best borderline. And if you call that out. Punished.
It is not intentional. It is a consequence of how much Emily is working to accept the obvious stuff. Perhaps they can analyse all those whose rating suddenly dropped and ask the questions.
And with Emily doing so many acceptances. Now is the time to remove badges for acceptances. I predict with only the dross left and with people chasing the badges then there can only be way way more dross in the game.
Dunno. Interesting though. Funny. I just did reviews for reviewing. Had I not seen the convo around this I would probably would not have taken notice. And now I am like what the 
1 Like
I’ve stopped reviewing as well. Dropped from great to good despite no change in the way I review with more than 20,000 reviews. It’s demoralizing to see so many low quality submissions and all of a sudden have your reviewer rating drop after a couple of years.
3 Likes
I do think the rating is based on recent agreements and not overall agreements, so you might have had a Great ranking forever but it quickly drops when some threshold is passed.
As an experiment, I reviewed 20 nominations and took a screenshot, recorded the location and how I voted (i.e. approve, reject or IDK). I guess I need to wait a while to see if they turn up in the database, but there was one that I rejected because it was pretty clearly on the wall of a PRP but which got approved anyway…
3 Likes
BE good to see the result of your study. 
1 Like
Here a a couple of examples:
BSE Society Award 2003 (Forum Court)
4 Tayfen Rd, Bury Saint Edmunds IP32 6BJ, UK
Looks kinda eligible at first glance, but clearly a PRP in StreetView. Voted to reject, but it got accepted.
W.C.C Footpath Flag - The Clays, Market Lavington
4 Stobberts Rd, Market Lavington, Devizes SN10 4AZ, UK
Voted to reject because it’s just a public right of way marker, not a trail marker. Also, not a footpath but a bridleway, not a flag but a sign. Essentially not distinct IMO, accepted anyway. Difficult to see on StreetView but I think it’s there.
1 Like
Personally I’d have accepted or skipped the bridleway - depends how good the nomination is and how brave I’m feeling about my rating. They are good places to exercise and I also think they are good for explore too if they take people onto a nice route and the description talks about a sight to enjoy etc
For the other one, I can’t tell, is the plaque on the house, or the apartment block behind it? Assume it was the house, hence the rejection, but it was the “(Forum Court)” that made me wonder abojt the apartments?
For the first one, the pin is on the side of the PRP. I do think trail markers are ones where often I vote against consensus, either rejecting plain old PROW signs or by accepting stick labels for named trails.
I did a sample of 20 a week ago - on 9 I voted Approve (mostly), just 4 of those have been accepted. I voted Reject on 6, but 2 of those have been accepted. And for the remaining 5 I was leaning towards IDK, 2 of those were accepted. I can only tell if the wayspots have been accepted, but I’m surprised about only 4/9 of the ones I though were good getting accepted… it’s only been a week though, so I’ll check back.
btw, for the Rejects one looked like a completely fake nomination and one was on the grounds of a school, I’m please to say that they are not in the game…
1 Like
Yeah I should have been a bit clearer to say these 2 examples you’ve shown are exactly the kind of grey area I mention about the kinds of reviews we do now, where it isn’t clear cut like a church or playground where its almost a 100% accept rate and you’d always expect an agreement for it
If correctly presented PROW are fine.
This includes PROW.
If it’s just a short passageway down the side of some houses that is not really enough .
However if it goes past the houses, continues on perhaps into woodland then that starts to look ok.
Each PROW is officially recorded, legally protected, and has a number to distinguish it.
I would expect a description to say something about what I would see if I walked it - explain its value.
If the proposer simply says it’s a footpath that’s going to not be a good description and is likely to be rejected.
There are usually local websites but a very good database is
I have a tab open so I can easily check.
Bridleways are footpaths that also allow horses so they are fine.
When assessing I don’t set the bar any higher than I would for any other nomination so I don’t expect perfection, but do want it to be reasonable, good enough.
2 Likes
This is probably a topic best spun out into a different thread, but IMO in the UK these PROWs are exceptionally common and if there’s no evidence that it’s a trail then it isn’t distinct. But perhaps in the context of this thread… it’s a marginal quality submission that doesn’t stand out, like many of things we have to vote on now. That having been said, a lot of the submissions are even worse.
1 Like
I may end up splitting.
However it is a good example of something that can be difficult to assess.
It is neither an automatic no or yes.
They do meet eligibility criteria and have a set, official route.
Difficult to assess wayspots are more likely to go either way so you don’t feel confident that you will get an agreement.
1 Like