1. Browse the known issues section or check if another user previously posted about a similar issue.
2. Upvoting posts help us understand how many players are experiencing the bug.
3. Refer to the Best Practices to learn how to write a bug report.
4. File each issue separately if you’ve encountered multiple issues.
Reviewer rating dropped for no good reason
Pangarban-ING
Posts: 31 ✭✭✭
My wayfarer rating has dropped to poor, I believe for no good reason. I have had occasions where the review has timed out, but it happened within a few minutes. The final time was this morning, when I completed a review in less than a minute (it was a good play area, visible on satellite view, in a public park, not a duplicate, so very easy), but the Wayfarer page said I was out of time. One or two reviews later and it said my reviewer rating is now poor.
When my rating went to yellow a few days ago, I started tracking my percentage of agreements every day. At the time my % was 64.3%. I have no idea if that is good or bad, but as of this morning it had gone up to 64.4%. But my percentage of agreements/reviews for the past three days has been 82.1%
So I believe I have been unfairly given a poor Wayfarer rating.
Comments
I noticed last week that I dropped to Amber after 5 months of constant green, then other people started reporting the same thing.
Now, after 15 reviews with clear candidates (playground, sports fields, ...) I'm in Red all of a sudden.
Something has changed for sure, removes all incentive to keep reviewing at this time.
It's amazing how this drop in rating has coordinated with many seasoned UK subbers/reviewers reporting that things that would ordinarily be accepted (historical buildings, church halls, shutter art) are all being rejected for stupid reasons multiple times (like 5 times for each). I've seen temp/seasonal, abuse, URL all unnecessarily and inappropriately highlighted on rejection emails.
@NianticCasey-ING I hope you are able to escalate this issue or identify whether this is because of inexperienced newer reviewers impacting the consensus vote. This seems to happen all the time we anticipate an increase in Pokemon Go reviewers (like last winter). I'm not suggesting that they are wrong and Ingress reviewers are right, but whoever or whatever is causing this needs a little bit of guidance or fixing.
Hello,
I was doing some reviewing and did 3 reviews that were clearly eligible. My rating dropped from green to yellow. I have also seen other people with this issue so it may be a bug
It might just be earlier reviews reaching final yes/no voting status - it can sometimes be several days after voting that a POI has enough votes either way to be accepted/rejected.
Much as I hate to say it, it could be down to tactical voting.
I have had two portals rejected this week because 'image is dark or blurry' and "image appears to be a group of people"
As neither of these statements are correct and I suspect one of two things
1) Tactical voting
2) Reviewers are just piling through as many as they can by the quickest means possible.
Unfortunately if you don't follow the crowd no matter how precise or correct you are, your going to get marked down.
Yes its an issue. Is there anything that can be done about it? Not with the current system AFAIK.
I noticed it myself, went to constant Green for 5 months to Red in less than a week.
I even went from Yellow to Red with about 15 reviews of some clear cases (sports field, churches, ...).
Loads of people have started to report their rating dropping on Facebook, Reddit, other topics on the forum, ...
I noticed it as soon as the "double agreement points in Ingress" event started and was expecting an impact on Wayfarer (at the very least faster reviews). This could be completely unrelated of course, but something has clearly changed.
On the quality of current reviewing, here is my latest rejection. Apparently it was Blurry/Pitch Dark, Temporary/Seasonal Display and Generic Business. (It's a local theater and concert venue whose group started in 1886).
But as long as Niantic doesn't take action to tackle Reviewer abuse/trolling (latest investigation only saw people "using the tool incorrectly" without any further follow-up), nothing you can do about it.
Or it could be that neither of those is eligible and the reviewers didn't want to spend the time typing in what those nominations are when they choose "Doesn't Meet Criteria".
The first picture is blurry, and it's a generic memorial plaque which has no cultural or historical value.
The second one looks more interesting to be honest, but I'd have to see a bigger picture to know if it's really special or just a generic memorial bench.
I have had mine drop for the first time in about 2 years. Only thing I can put it down to is the niantic pre reviewed nominations where they ask you to select what best suits the nomination. Where none of the 3 choices best matched the notification I have been looking for the actual item that's the only thing I have done different. But who knows.
But there is far more rubbish in the reviewing system here in the UK at least so I'm guessing pokemon groups are reviewing together to get non eligible nominations in.
My review status has also dipped from Green to Red currently
Same situation here; dropped from green to red...that's really disappointing..
We hope Nia takes action as soon as possible, this can't be anymore
Mine did too after 5 reviews, all playgrounds. It was strange but the funny thing is my percentage of agreements has gone up.
As I say it's the first time its dropped into yellow in the last 3 nearly 4 years reviewing. I wouldn't expect niantic to do anything they didn't last time it happened. But with what's in the system at the moment makes me think it's not worth reviewing at the moment as clearly groups are working together.
Same here - went from Green to Red in a quick session of reviews. Was offered a "test" by Wayfarer to "reset" my rating - got 10 /10 and was put back to mid-yellow. Back in mid-green now.
Since the double bonus for recon, the Wayfarer rating has continuously dropped from green to yellow to red. This was noticed in our local group and global in various forum and reddit posts.
@NianticCasey-ING can you please make quickly check with the Wayfarer team whether the assumption is correct?
Our local group has been reporting this since the double bonus for recon is active. Maybe a bug in the code for the bonus event?
@NianticCasey-ING What is Niantic doing as response to this?
There are many cases with this problem, but we've had no response about it
Hi folks,
This issue has been reported as a bug in the "Report a bug" section. I have flagged it with the Wayfarer team and they're investigating but unfortunately I don't have any information beyond that.
I'll update both here and in that thread as I learn more. Thanks for your patience.
My rating has dropped after having to select the most appropriate field. Half of what I have reviewed when asked what best matches is nothing like that is in the picture and after finding the correct listing my rating has fallen.
Thank you !
Same problem and I didn't received the link to redo the test and reset my rating :/.
There is an annoying amount of mass 1 starring going on atm, so proper reviewing = your status gets lowered.
Since lockdown started a lot of our local community have been getting things like post offices, pubs and trail markers denied as living animals and obstructs emergency services etc.
Same here. Just slipped in red after a months of the constant green. The strangest thing is that my percentage is actually rising. Please fix this.
100 % agree that there is a lot more 1stars getting used. I know I have used more but that's only because as of lockdown here people are trying to put low quality submissions in.
Not saying pubs etc are low quality like the problem you have been having, but on the whole I'm not going to change my standard of reviewing because someone wants a pokestop at there house. Niantic have put measure in now I believe that allow people to get quests etc from home with out having to go out.
Yeah mine is still going up as well something definitely wrong but will it get fixed.
From green to red in less than a week. I've been evaluating in OPR and Wayfarer since the beginning. I've been green throughout and now this. I'm really frustrated
I think how the only solution for this would be removal of Wayfarer and bringing the good ol' OPR back (only ingress players will get this).
From green to red in less than a week. I've been evaluating in OPR and Wayfarer since the beginning. I've been green throughout and now this. I'm really frustrated.
@NianticCasey-ING Do you really believe that the work that has been good for years is now bad by so many judges? I wonder if I should do the evaluation exercise directly to be put from poor to good or if I should wait and see. What is your opinion ? I have never changed my rating system.
Niantic requested evidence of portals that were "wrongly" rejected. What they got were hundreds of examples of nominations that weren't eligible or whose rejection reasons were not helpful. I will also say that there is a much higher amount of ineligible nominations as well. Usually, I only rejected about 10% to 15% of nominations in a single review session. But the last few sessions, it has been almost 50%. My standards haven't changed and neither has my rating so far. This is why I believe that the sudden drops in ratings people are experiencing may be because Niantic put out more pre-reviewed nominations in order to collect evidence for "wrongly rejected nominations". After all, they have done this before.
Replace "increase in new Pokemon Go reviewers " with "increase in new reviewers" and I'd agree.
Similar drop in my rating happened also when upgrades were introduced during OPR era. And now with Recon badge x2 campaign.