[Resolved] Wayfinder Rating Incident

I understand that the issue might be complex and take some time to investigate and resolve. I have no problem to wait for the team doing so.

However, a clear and honest statement on what we should do, would have been (and would still be) nice.
Can we go back on reviewing OR should we wait for further instructions OR do they don’t know at this point.

5 Likes

Same question from me - I went from Great to poor within a short time, and therefore more or less stopped reviewing (and missed a tick on the challenge). Thought that “this is it for me, I’m done with this”. Wonder if we really get count for the reveiws we actually did/do meanwhile they reset our rating (hopefylly to Great again) …

2 Likes

Unfortunately clarity and communication from Niantic and the Wayfarer team has always been awful. In some areas they are gradually improving but still have a huge way to go. Hopefully we will get an answer to these questions but I wouldn’t hold your breath.

3 Likes

Thank you so much for addressing this! It had been discouraging to see my rating drop so fast for seemingly no reason. I appreciate your resolving this - both short and long-term!

1 Like

I do want to thank Niantic for seeing this as a bug and working on fixing it. I have seen a slight uptick with getting agreements, so some reviewers may be back, as well as resolution on upgraded nominations.

1 Like

And now agreements seem to be slowing down again, most likely due to this still being worked on. In the main rating bug thread, people are still not seeing much of an improvement with ratings, so I do hope this gets resolved quickly, so we can bring those disappointed reviewers back.

3 Likes

We have completed the two steps of the incident remediation:

  1. Fixing the root cause
    The error which was impacting the rating algorithm has been fixed and guardrails have been put in place to prevent similar situation to happen in the future.

  2. Restoring ratings
    Users whose Wayfinder ratings were negatively affected by the incident should have seen their ratings restored and increased (if applicable) to what it should have been had the incident not occurred.

We are currently working on the agreements compensation, but we do not yet have an ETA to share.
Thank you for your continued patience.

25 Likes

Thank you for the update, much appreciated. Kudos to the team for working through this as quickly as they could.

On a personal note, thanks for getting this out before @BlameJamal and I record this week :sweat_smile: :rofl:

6 Likes

Previously, it was stated by staff that upgrades were working as intended, even though upgraded nominations went from being resolved very quickly to taking the same amount of time as a natural resolution. We were excited to see staff confirm that upgrades were, in fact, broken. Many of us put in hours of effort to earn those upgrades, and when we cashed them in, we received no added benefit. Could we have those upgrades back?

4 Likes

Everyone is “Great” rating now :joy:

Not true. Some are finding that they were lower than Great before the incident happened.

1 Like

Wayfarer rating is back to normal. I think it was great, but it’s back to like… Thank you. I hope the others are back, too.

1 Like

Thank you for working on fixing this.

Do hope I can stay away from those (poor) ratings from now on. :upside_down_face:

2 Likes

The rating has been restored. Thank you for your response and clarification.

1 Like

I started reviewing during the challenge, not before and my rating is now “fair”.
So I worry when the wording is that “the ratings will go back to what they were before the challenge” since I didn’t have a rating then.

My rating feels very low given the care I take in reviewing so I wonder if there is a further issue for people who started reviewing during the challenge.
If not I’m really bad at reviewing and it would be helpful to know what I am doing wrong/ how I can improve.

1 Like

I was so relieved to see my rating was back to great again a few days ago. I have, however, become very careful with the amount I review per day, so the agreements can ‘keep up’ with the speed, afraid of dropping again.

I’m not really eager for compensation, just glad it was fixed, but a few more appeals would be nice ; I have to appeal almost every nomination that has a bit of green/nature in it.

Actually, instead of upgrades, which are pretty useless and seem to have no effect, I would like to see we can earn appeals. We get way too little of those. So far all my appeals but one have been successful-and rightfully so, but sometimes I have to wait WEEKS before being able to make one.

5 Likes

I was on “Great” before the incident, and fell to “poor” within a few days. My rating has been restored only to “fair”. Does this mean that you will not set me back on "Great?

1 Like

Are you talking about the % agreements calculated by the corresponding wayfarer.tools plugin? This is not your rating %, and it makes sense for it to be slightly lower if you have reviewed recently as things you have just reviewed might take a long time to resolve.

1 Like

Ok sure, just wanted to be sure that this is what you used and wanted to be clear for everyone reading that this is not a built-in feature and not a rating % as people get confused occasionally. (And that there are multiple settings and modes under which you could use it, including options where it will never update unless you input your medal value manually). Sometimes people manually calculate this % (no plug-in) and it makes sense for it not to be stable if you have reviewed lately as many things could be unresolved. Sometimes people input their Pokémon GO medal value into their plug-in but it only syncs once a day or so (or sometimes skips for a few days altogether), not yet reflecting the agreements of the day. Sometimes things you reviewed get taken out of the review pool by ML (eg. old edits) and it’s not clear if, how and when they generate an agreement for you. Sometimes people receive several upgrades from challenge rewards or as compensation and the plugin doesn’t know unless they manually correct for it so that the percentage of agreements is artificially inflated and then lowers over time.
Or sometimes people just disagree with the community that reviewed the things they reviewed but that doesn’t mean much.
All I’m trying to say is that I wouldn’t take this value as an indication of issues without a lot of context around it.

3 Likes

Hi!! So, this was already solved and If someone has poor rating is not because of this issue? :eyes: Because I have a friend who yesterday show me his rating down to “in the middle” (“en la media” in Spanish… idk in English) and we don’t know if this is just for disagrees :scream: