Welcome to the Bug Reporting page! Please refer to these tips when submitting new bug reports:
1. Browse the known issues section or check if another user previously posted about a similar issue.
2. Upvoting posts help us understand how many players are experiencing the bug.
3. Refer to the Best Practices to learn how to write a bug report.
4. File each issue separately if you’ve encountered multiple issues.
1. Browse the known issues section or check if another user previously posted about a similar issue.
2. Upvoting posts help us understand how many players are experiencing the bug.
3. Refer to the Best Practices to learn how to write a bug report.
4. File each issue separately if you’ve encountered multiple issues.
Comments
No test taken. After having problems with this system. I've just finally got to Green rating, tho I was in Red from beginning(to 2.2k), then Yellow, and now got Green rating (63% 2.8k reviewed). I just waited, tho I was being mixed with Red/Yellow, but for first time here I'm in Green.Tho on alt account I'm being 54% and there I'm still yellow, but still being mixed with Red.. For me still they not repaired this ;)
Un mes atrapado en Rojo, sigo revisando y me siguen llegando mejoras para aplicar.
No lo entiendo, no he cambiado nunca mi forma de revisar y todo iba bien. Ahora sin motivo me bajan a Rojo y me siguen enviando Mejoras. Como es posible? Si lo estoy haciendo mal no deberían enviarme mejoras.
Mis acuerdos siguen aumentando, me siguen llegando mejoras y no salgo de Rojo. No tiene lógica.
Niantic revisa que está ocurriendo porque no es normal
It is interesting to see that, even though I have not reviewed at all for the past weeks, my "Upgrade" status has been steadily growing from around 0–5% when I quit, to 70% now (while my karma rating has been stable on "good"/yellow the whole period).
Just went down from green to yellow again.
After going down to yellow and trying giving at least 1 minute per review, i'm at solid green without experiencing any drop in the last month.
Just did 3 more review and back in green.
I did a bunch of reviews, didn't change how I reviewed at all. Dropped to yellow, and slowed reviewing to a few a days, making sure I took several minutes on each one. Dropped to red, and I stopped reviewing entirely at that point, and haven't reviewed for over two weeks now. Agreements have rolled in steadily (and earned some upgrades), and I bumped back up to yellow, and then to green, without doing any additional reviews on my end.
I think there's a real problem with the recency bias in the rating algorithm. From my limited experience, it looks like "undecided" reviews are counting as "not agreement". Rather than having only final decisions count towards the ratings, it definitely seems like anything that's not "agreement" dings the rating. When I'm reviewing a lot of items, I may be one of the first people to vote on something, and then I'm dropping. When my ratings later agree with the final decision, I'm getting the credit back. I think the simplest way to fix this algorithm is to remove the undecided votes from factoring into the rating at all. You can still weight the algorithm to look at recent agreements / disagreements (to ensure people with historically good ratings are still reviewing properly), but I think the big disconnect is that "undecided" is counting towards "disgreement" rather than not being counted.
As a computer scientist who deals with this sort of stuff professionally, I'd propose a slightly different algorithm for the rating which can still be fair but isn't as reactive. 25% of your rating should be based on total historical agreements. 25% of your rating should be based on the past preceding time period (past month? past 2 months? past 3 months?) or 500 reviews, whichever sample size is bigger. 25% should be based on your last 100-200 agreements, the final 25% should be based on "other factors" (time between reviews, rejection reasons, star rating spreads, and/or other "secret sauce" criteria that are clearly there currently).
With those sorts of tweaks, you'd still be able to catch people who significantly change how they're rating, or who start to review too quickly or don't vary their star ratings (giving everything the same rating and not considering individual candidates), but you'd insulate people who were consistently good from dropping randomly when they rate newer submissions. You want to encourage the people who have been consistently good to keep up the work, while still making sure they rate along with guidance.
I want Niantic to hire you...100% agree with what you propose
Great post! 👍️
yes, we should have more people like sq3 - they are players who know the game, who know wayfarer.
what we do have is the "Wayfarer Team" that does have their Coke-Recipe in the Vault. We all know Crystal Coke and New Coke never worked.
We need to have Players and Wayfarer Team to work together, otherwise this will be New Coke forever.
I find hard to believe that your pending nominations would affect your rating. That's kinda stupid. Why would your nominations affect your review rating.
There is different thread where i also posted my findings on stuck nominations.
https://community.wayfarer.nianticlabs.com/discussion/3707/nominations-stucked-in-queue-for-1-month-while-other-players-in-same-town-are-getting-voted-in-3-da#latest
I was on red previously and got back to green on spring. When double credits for recon medal was put effective. I went straight back to red!
I just did one review. Got back to amber (FROM GREEN) while I'm 64% AGREEMENT!
So, all green/great for roughly 1.5 yrs, then dipping in the yellow suddenly 2 weeks ago, back to green, then yellow yesterday again. Did 27 reviews today and poof, red. Rejected random benches, private mail boxes, and generally got bored of the remaining playgrounds and trail markers.
If it wasn't for upgrades being the only way now of getting things through the system, I wouldn't do this. Now I won't, because I don't trust this will be resolved and if I do the test and the system acts up again there's no way fixing it if you can't retake it twice.
Anyway - just wanted to point out the fact that a total review rating (x%) might not be what controls your status: it could be a sliding window, so e.g. your rating would only be for the last N weeks, or a mixed weighted average, eg your total up to N weeks ago is 50% and the last N weeks contributes 50%. Or so other distribution.. This could be to e.g not let people get stuck in "sins of the past" forever without recovering.
Anyway. Doesn't matter now. Will have to wait 4 months for stuff to maybe pass 🤷♂️
Sadly, none of Niantic is bothering to fix the problem. Three months waiting and nothing.
So this morning I was so happy to see that I could finally review again after several days with nothing available. I did ONE review and got the ‘there’s nothing to review’ message and my rating went from green to yellow. ONE REVIEW. After I’d just finally got back to green after several months of being in yellow for no apparent reason. To top it all off, all of my nominations have been in voting for ages. Seems things have slowed down yet again in my area. I’m quickly losing any motivation I had to continue with Wayfarer. It’s just not even enjoyable at this point, honestly. I’m sad because I really do like nominating things and seeing them in the game, but my patience is wearing thin lately with all the glitches and little to no responses or fixes. Really hoping for some changes soon.
In our region all nomunations are in voting about month or two. Mostly active reviews are in red and stopped reviewing. No any wish to submit anything.
Wayfarer is totally broken and Niantic did nothing to fix it.
I went to red a few days ago, voted on a few stops, got four hour «ban» from reviewing. Also, none of the agreements get logged in PoGo Wayfarer medal. Been stuck at 918 several weeks now. Almost as I don’t dare to review now.
Bit of maths: on June 3rd I noticed I was yellow, and took a screenshot. Then I took another one on June 21st when I fell into the red for the first time.
Between times I reviewed 535 candidates, of which I got 377 agreements, which is a 70% success rate. I’ve been doing OPR since it launched, and my overall success rate is about 58% so I was apparently reviewing BETTER than usual, and still managed to fall down to red.
Something is really broken.
Just on a bit of a weird note:
I was 60% on an upgrade when I went into red. Now I am on 80%, so apparently delayed agreements from before still count? (Ingress recon medal seems stuck though, +2 even though I've seen more delayed agreements in the Wayfarer stats page)
That x2 for recon badge just came to affect all of us !
I think if Niantic removed it, all this issue would get solved....but they don't even care about it, it's been more than a month since it happend...until when NIA?
Month? It's been three months.
I got a nomination selection but it's doesn't been in Pokemon go , how can I bring my nomination in Pokemon go
So an hypothesis is that nominations that has not reached an agreement yet contribute to your bad ranking? Around here nominations stay at least 2 months in voting if not upgraded. So if I review 50 nominations on average a day I potentially got a huge number of nominations waiting for decision contributing to my bad ranking. Even worse with my bonus location nominations where agreements can take years.
There's a crystal clear causal connection between nominations being stuck in queue for months and this mess.
OF COURSE they're stuck in queue for months, since most active reviewers have had their status drop to RED and these reviewers either stopped reviewing - or the ones who didn't, don't get as much weight on their vote because their status is in RED, and more and more reviewers are required for a nomination to get processed. It's a snowball sliding down a mountain, turning into avalanche. A formula that just does not compute. And it's only going to go worse if Niantic does not address it.
And I'm sorry to say this, but at this point it seems either @NianticCasey-ING quite simply lied about getting back to this problem, or someone above Casey instructed Casey not to do so.
It started around 28th of April over here, so two months. Just rolling on to the third month.
Which is indeed when the 2X recon event started. Nothing else of note happened around that date. But it would not explain why some cells are stuck (either no reviews showing up, or nominations permanent stuck in voting) while others work normally. As an old IT technician, I'd guess that the database is stuck proceeds only part of the nominations because of timeouts or other issues. In my old job these kind of issues wouldn't even made it live, let alone stay unfixed for two months.
(Then again, that was governmental work. Losing patient data would've been life-threatening in many cases, so maybe I shouldn't compare it to a game database.)
Not surprised. Wouldn't be surprised if Casey has been told to ignore my problem as well.
Niantic have a responsibility to us as players who want to contribute to making their Wayspot database better.
None of us are asking for the world. Even if it take hundreds of short-term fixes like manually pushing 300-day-old submissions or resetting everyone's review ratings once every few months. At least we would know they are trying to make our lives easier!
Niantic need to actively communicate with those who actively try to make their games better to play. A better Wayspot network is just that.
Help us help you.
It's not just a case of nominations stuck in a queue. I started reviewing only a few weeks ago, and I was thrown into red by the time I had 16 agreements. It took no time at all. Currently have a 70% agreement rate with just over 150 reviews completed - still red, though. I've tried everything suggested on here, waiting at least a minute to submit, taking it slow and doing no more than 10 reviews a day, carefully researching everything to avoid honeypot traps. I usually don't start reviewing again until my agreements catch up.
It's just broken. Period. New reviewers don't have a chance, legacy reviewers don't have a chance. I have no idea how some people are managing to stay green but the silence on Niantic's end is a clear message that they don't believe there is a problem or simply don't care.
So, looks like Niantic doesn't want to fix anything?
I've asked some not active persons in Wayfarer from our community to review some nominations. As a result - after 10 reviews - yellow rating, after 20 - red. How did niantic supposed to go out from it?
Hi, I have the same problem. Please look into it for me as well.
I have been stuck at 918 for several weeks now, and also my Wayfarerscore is at red suddenly. Is this a bug that others have experienced? I have reviewed lots after this, but it serms like there is a bug there.