Wayfarer Ratings Bug

My wayfarer rating was affected by the bug last year and has never been fixed.

I’ve reported this before and it was ignored (below).

I’ve only done one batch of reviews in the past 12+ months because of this bug. During the last challenge I did 62 reviews and I believe my upgrade % went up by 60 (+/- 5 or so). My rating remains “Fair”.

I’ve done nearly 7000 reviews all time. I review slowly, I check streetview, I google things to verify existence and facts, I never click a decision within 60 secs even if its something very obvious, say a clear duplicate. For unusual things I’ll take the trouble to go back to the criteria pages and double check. I have nearly 350 accepted wayspot submissions at a success rate of around 80%.

It only dropped in the challenge period last year when there was the bug. Before that it was Great almost always, occasionally dropping to Good if I had a long break and came back and did a bunch of reviews in a day or so. Then it would go back to Great after a while.

Hey @kruddel ,

Wayfarer rating is based on the number of agreements and disagreements. Here are a few tips to help you review more effectively and maintain your performance rating:

  • Follow the criteria while reviewing nominations, we recommend keeping the eligible and ineligible criteria pages open in a different browser tab for easy access.
  • Take your time and review each segment on its own merit. Read this article for tips on how to review each section: Niantic Wayfarer
  • Avoid using third party tools/plugins or depending on others to decide on how you vote on a nomination.

Regards,

Great.

But there was a bug.

You guys took a long time to acknowledge it, and did not explain the intricate details to us.

If I remember correctly, you may have attempted a fix, received a lot more complaints, and then offered a fix to the fix.

If you read the OP’s post, you may have noted that they already addressed the top two points that you fed back as tips. They described how they understand the use of criteria in their own analysis, and make sure to take their time over each review.

This leaves only tools/plugins, and I am ignorant of these outside of TehStone/AlterTobie stuff that doesn’t appear to influence voting.

Are you sure nobody’s stats remained stuck due to previous bugs?

Yes, there was an issue. It has since been fixed. We had rolled back any impact it had on anyone.

Absolutely.

5 Likes

Thanks for taking the time to reply.

The only conclusion we can logically draw is that I no longer understand the criteria or the review process despite ~7000 reviews and ~350 accepted wayspots and years with a “Great” rating. Even after already following all the tips suggested (for the entire time I’ve reviewed).

As my rating did not change from “Fair” after nearly 100% acceptance for 62 reviews on the recent challenge, logically I must have been very far from the fair/good borderline before the start of the challenge.

I think the only sensible course of action, as I’m already following all the advice, is to carry on no longer reviewing.

1 Like

If you do want to try again, are you using your skips on any you aren’t confident of? We seem to have 100 skips now, each on a 24 hour counter. Just don’t skip through too fast, because that might cause a cooldown. Idk if that is one of the suggestions you have been following.

Take a break. You are free to come back and review every now and then.

1 Like

It would be hard to actually know how many reviews you got agreements on; this isn’t even something I fully know. Only nomination reviews count towards your agreement rating, not edits, but you can still gain percentage points towards an upgrade when agreeing on an edit with others. Personally, I have no idea how many reviews I’ve agreed or disagreed on with others.

Text edits can also be interesting, IMO, as some may submit edits just to remove something like a period or quotation marks. Personally, I don’t like quotation marks in titles, even for art pieces, but others don’t mind them. Some don’t like periods in the description to make a sentence, but it’s not against the guidelines. Of course, this is coming from an English POV, and yes, other languages use different grammar, but even then, there are differences in how text should be.

Staff has noted that when it comes to one’s Wayfarer rating, your agreements and disagreements with other reviewers are taken into account. If there is any abuse detected in one’s reviewing, this can also affect one’s rating. This is what is noted on the Wayfarer Profile help page in regards to one’s rating:

Your Explorer rating will improve as the number of decisions you agree with grows, and your performance rating may be lowered if you have too many Disagreements. Your rating may also decrease if abuse of the Wayfarer platform is detected. If your performance is poor, please take the time to re-evaluate how you are analyzing nominations based on our acceptance criteria.

Yes, criteria does change from time to time, and there could be things that was once eligible that no longer are. As the last part of the above quote notes, if your rating is poor, you may want to reevalute Wayspot Criteria as well as the How To Review Wayspots sections of the help pages. Another great place to review is the Criteria Clarification Collection, which breaks down some of the most common categories one may see while reviewing.