Welcome to the Bug Reporting page! Please refer to these tips when submitting new bug reports:
1. Browse the known issues section or check if another user previously posted about a similar issue.
2. Upvoting posts help us understand how many players are experiencing the bug.
3. Refer to the Best Practices to learn how to write a bug report.
4. File each issue separately if you’ve encountered multiple issues.
1. Browse the known issues section or check if another user previously posted about a similar issue.
2. Upvoting posts help us understand how many players are experiencing the bug.
3. Refer to the Best Practices to learn how to write a bug report.
4. File each issue separately if you’ve encountered multiple issues.
Comments
Just to follow on from my previous post and to further exemplify the adverse effects that this issue is having. Below is a chart showing my rating, the number of reviews and number of agreements for each day for the month of May.
At the beginning of the month I was averaging 115 reviews a day (not including the three days where I didn't do any reviews), after my rating dropped that average dipped down to 15 reviews a day. Furthermore, my desire to keep reviewing has waned, especially if my rating and therefore my agreements are going to be negatively impacted. This sentiment is shared amongst my peers, both locally and globally. Review numbers are dropping, interest in Wayfarer is dissipating and the backlog is ever-increasing now. Nominations are taking longer to go through than at their peak in early April, likely due in part by many people's rating dropped and therefore their reviews not counting anymore.
I would like to keep reviewing as I want to get double Onyx Recon. The double agreement rate for Recon was a nice bonus, but it means nothing if I can't review and I am punished for reviewing. To put it into perspective, I have done over 19,000 reviews and have over 490 portals discovered, I am always seeking quality and strongly abide by the guidelines. I do not accept poor submissions that are not eligible. Despite this, my rating has dropped for no apparent reason and instead punishes me, and my fellow reviewers experiencing the same issue.
It seems that the damage has been done. Many people are quitting Wayfarer, backlogs are increasing, the quality of nominations are at their lowest point. Any statement by Niantic now is just too little, too late. Niantic have an army of people willing to do the free-work for them, but if they can't do that work and if they are punished for doing the work, what possible remedy could Niantic provide to reinvigorate interest into Wayfarer? Why should people review when their rating will just drop suddenly again anyway? Does Niantic even care?
In my area the usual handling time for submissions used to be roughly a week, give or take a couple of days. Now nothing has got approved since 28th of April, except for a few upgraded nominations and a single location edit. Personally, I now have 10 submissions in queue and 19 stuck in voting. So yes, this bug has pretty much killed Wayfarer in my region.
Just fixing the bug won't be enough at this point. I'd suggest resetting everyone's rating to green, otherwise the backlog is never going to get handled.
So I braved a little patch of voting again, big mistake. My score went down again, and now it looks like I've re-triggered the no nominations available bug so my account has ground to a halt. I was voting very slowly (on Australian internet) and carefully and wasn't in disagreement with the community, as my agreements overnight can show.
We've concluded that either it is a bug, or you've created the chaos by setting the honeypot test reviews to tank a person's rating if they give a 3 instead of a 5. I say this because there's no way seasoned reviewers would give a 1 to a 5 star - but people who are voting more carefully than normal give out more 3s.
This can explain what happening. As last reviews does not get for agreement yet - my own submissions are for almost one month in voting. Also people perform less reviews as it take the rating down...
So... anything? At this point nothing in my local area is passing and whatever does go through reviewing fails (we've had acceptible items fail on a consistent bases with very poor reasons since this all began, for example a mural on a building). Most of us have stopped reviewing along with most of us putting a pause on submitting things.
Soo... anything? We're on Tuesday now...
My status just changed from red to yellow, have not done any reviews the last days.
Hi all, Did anyone see an update from Casey today?
None of the comments on Casey's page relate to this topic and it's not in the Known Issues section.
Given how many threads this generated, I'd like to see a pinned announcement post for this.
Thanks to those that linked replies across various threads
@NianticCasey-ING At least here in Norway we're now at Wednesday, and eagerly anticipating the long overdue response we were promised Monday or Tuesday this week...
Seems like @NianticCasey-ING didn't heard any shareable information from the team.
Now, the question is "will this be another HUGE LIMBO-LIKE Bug that Niantic took around 2 year to finally fix?"
So, for 2 years no one will perform reviews?
@NianticCasey-ING just look at review statistics - it's not because of Covid-19, people just afraid to perform review - rating goes to red in a second and we not aware why. So we decide wait to understand what we started to do wrong if with 70% agreements I'm on red...
It has been more than one month we haven't heard any actual information regarding the situation.
If they can take more than one month to fix some urgent situation like this, then i will not be surprised if they took months to fix anyway.
Also, the limbo problem was same as stucked in "in queue" problem. Old website didn't have any tag like "in queue/in voting". Submissions are often stucked months after months & years after years even though the area had quick process rate. After continuous shouting of around two years by Reviewers, they finally fixed it. I still remember, how many reddit post was posted to express the joy of the process of players old stucked submission.
There was no " withdraw" option too. No "Nomination" tab in old website. So, people have to manually remember their submission via email checking.
Pretty disappointed @NianticCasey-ING didnt follow through on an update when they stated they would. Even if no new info to report it is better to contact the player base to share that rather than no post at all. There are many people waiting to know when they can resume reviewing, the lack of keeping your word does not bode well for Niantics commitment to the wayfarer system.
My rating changed too from red to yellow. But tho I was doing some reviews on 01.06. And I stopped and got into yellow. And today I just did one review, and got back to red... (2392 [Yellow] -> 2393 [Poor/Red]).. @NianticCasey-ING Where is our information from yesterday?
Screens:
Before -
After -
Maybe it's not rated about that, but tho people mostly look at it...
Lol dont encourage them to worm out of it with a generic "we are working on it" response 😆.
If they get a chance with a generic response again it will be another month before any response😆
We need answers. Only an explanation on what went wrong, what is being done and when it will be resolved will do. But I can go another month with out hardly doing any reviewing I'm sure others can as well.
well when in doubt i would say @NianticCasey-ING would have gotten back to us, as promised. maybe @NianticCasey is home sick - that can happen.
get well, soon, if you are sick.
if you are in office, please get back to us - you promised and did not fulfill.
I started reviewing a couple of weeks ago, and quickly fell from yellow to red. I was notified to redo the test to be qualified again, which I passed. I am now still stuck on yellow. I have noticed that several of my rejections on the basis of location (K-12, private property, etc.) are not agreed upon, and I am amazed that there now are several Wayspots in Norway that indeed are located on school grounds.
The consensus based review process is seriously flawed if it does not have any quality assurance mechanism apart from a qualification/requalification test. It turns into a vicious circle if the conscientious reviewers no longer review, and what is left is a group of novices or others that do not review according to the guidelines, but rather based on other considerations.
Niantic's opaque communication is further demoralising. I will probably stop reviewing until we get more information. I have spent a lot of time on reviewing submissions carefully. But this, paired with rejections of some of my submissions that to my estimation would be eligible according to the criteria, makes me abandon the free labour.
Sick or scared to respond as they was answering questions yesterday.
Update: Im back in green, I got the conclusion that this is only a visual bug, no matter if im in green, yellow or red i have the same rate of agreements of my reviews. I´ve never changed the way i review, so i suggest u to don´t stop reviewing, u will get agreements and is all the same as if u were in green.
You'll still get agreements, but the rating drops despite that - that's the problem. Ingress players stop receiving points towards their Recon badge while red, and players who fall to red are asked to re-take the test. If it was a visual bug only, then this wouldn't happen.
Knowing developmemt companies, I think @NianticCasey-ING has probably got the most ungrateful job in the world. The middle person between frustrated/angry users and leaders of the development teams who don't want to let any information out in public, unless it's something they've already fixed and it doesn't let anyone really know anything new... I do hope the management above both of them has given her free reign to let all the frustration and anger from us users reign over the development teams, and that she is the kind of person who really can do that! Maybe then we finally can get some answers and bug-fixes... The only other option in my experience from developmemt companies is that the consequences of these problems is getting noticed by the upper management... I really hope their metrics include daily numbers important to the waypoint network, like number of new, number of active reviewers, number of reviews. These metrics should give them something to wake them up and react, given the comments in different threads on this forum...
sitll have the bug... when I do a rating, like 50-100 review my rating needle goes to the BOTTOM and you even cant see it... then i stop and it goes back to red....and my rating is 70%...
Waiting for a follow up here @NianticCasey-ING
Thank you
If it was just a visual bug, I think we would have had a reply more quickly :)
@NianticCasey-ING mentioned in another topic they were looking how to "demystify" the situation. So either they changed something on the backend, but do not want to explain too much, for fear of people figuring out how to abuse the system (even more).
Or they did something else they do not know how to communicate to the players (fear of protests?).
Agreements still come in, but nothing for the Recon badge and the last time I had a nomination upgraded (Trailbridge), it was rejected for being a Generic Business, Natural Feature and featuring a body part (it didn't).
If this type of Reviewers are the only active ones, I'm not dying to get upgrades.
Any updates on this yet?
@NianticCasey-ING buenos dias , comentarle que mi barra de calificacion , sigue baja a pesar de las calificaciones y el visto bueno en las nominaciones , la barra llega al 100 % y me dan otro punto pero aun asi la barra sigue en rojo
saludos
I’ll weigh in on this to say I haven’t done much reviewing lately but hopped on to do a session today to find my rating in red when it was previously green.
It is not going to encourage people to review more and several are already stopping.
Also, I suspect that the drop to yellow/red Wayfinder rating that many of us are experiencing somehow could be related to the Likert scale rating system consisting of 5 options, applied to the six judgment dimensions. If it is the case that we somehow are penalised for rating anything else than 1, 3 or 5, Niantic should revise the system such that the scale has 3 options instead of 5. That would be more honest and also more intuitive.
But there might also be other solutions. I do not know how Niantic's algorithms work, but the inter-rater agreement could be calculated by other means than reducing the scale into three options (assuming this is a factor in the Wayfinder rating). One way could be to make a correspondance to a 3 scale system, e.g. by pooling 2-3 ratings into 3, and 4-5 ratings into 5, while 1 is 1 regardless. They might already be doing this, for all I know.
Let's not try to think of what maybe wrong here, alot of people have dropped in rating all of a sudden. Niantic just need to answer the question now as they was ment to get back to us on the 1st/2nd of this month and they haven't. I'm guessing they wont come back with an actual answer anytime soon that will categorically say what is wrong. I suspect it will be an answer that can be interpreted in a million different ways and will still not actually explain what has happened or with a fix.
somehow this started to feel like a David Linch (cant write y) Movie.