Considering Niantic doesn't have a good track record of handling reviews, I'm worried they'll get it wrong themselves. On the other hand, some of my rejections make me want to reach my hand through my phone and slap somebody.
The ability to put a nomination on HOLD. This would pull it out of the review queue and release it whenever you want. This means if you submitted a nomination that you don't feel is up to par and want to modify it, or think about whether you just want to withdraw it so that it doesn't get auto upgraded, you'll be able to buy yourself this time.
Why spend time on a feature that only helps Contributors who are already so greatly advantaged?
Why not first work on making nomination times equitable?? With the process as it is, I will never need to put a nomination on hold - I can still edit its title and description four months later, because it will still be In Queue. (A city of 4 million is a 2 hr drive from me, in the same region.)
It doesn't impact rating right now? Please don't have rejected nominations hurt Wayfarer rating. I think you will see from doing appeals that many excellent (or at least acceptable) nominations are rejected, and a lot of them several times, before going through as they should have in the first place. Even if reviewers eventually all were kept up to date on clarifications on current criteria, there are too many variables we may not be aware of when we submit. In my area there is a professional photographer dropping gorgeous photospheres in the vicinity of the subject without much regard to exact placement that I don't know about until I have received a rejection for mismatched location. There are gps glitches and out of date satellite/street views that the nominator has no control over that can cause a rejection of a good nomination.
If there's a great poi and multiple people submit it, someone will be accepted and everyone else will get a duplicate rejection. Even if we learn that the Wayspot went live, we can't withdraw our nomination if it is in voting. And I can't scroll through all my nominations constantly checking for that.
It's the dedicated Wayfarers who are going out and finding the most interesting things to submit. If getting rejected hurts rating, then you are only going to see the same few sure things submitted and have fewer people to review them.
The abuse cabals would have a field day with this, rejecting everything that doesn't come from their inner circle until no one else can submit in the area.
Agreed. SOME of my nominations have taken 7+ resubmissions before finally being accepted. None of those, including various murals, "local hotspots", trail markers, playgrounds, historic buildings/artifacts, were invalid.
Even the few I've submitted on a lark, just a whim in the moment, that I knew had a very low chance of succeeding (ie. small parks without signage) were still valid.
But because, even when I'm unable to revisit the location to take "improved" photos, I'm still willing to resubmit with variations on the title/description, it would make me feel VERY disillusioned that these attempts could drag down my "rating".
Yeah, I'd like to see this loop be closed. I've had some rejections on things that should have been accepted. I think they were victims of reviewers who either went too fast to read all the information or people who only accept obvious 5* candidates. If they have to use their brain because they've never seen another POI like this one, they get confused and hit reject.
I also think it's pretty important to be able to cancel an appeal, especially since we have been able to submit one per day.
I also want to add that I really, really, really loved the Russia WF challenge. I felt like I was able to make a difference both in the Moscow community where I chose to review and in my local community because I was able to earn so many valuable upgrades! I live in one of those areas where non-upgraded contributions take 10 - 14 months to reach a decision (yea or nay). Any leg up I can get to have Upgrades makes a big, big difference locally.
I feel like there was some negativity in how the Russia challenge worked. But I was fully engaged with it for at least 7 or 8 days. I have been really disappointed to see subsequent challenges structured differently - either restricting who can participate or not giving the same kind of rewards.
I think good reviewers who put thought and effort in to a review forget that there are so many who don't put in any effort in at all because they are speed reviewing for upgrades or something else.
So I think feedback would be useful for serious reviewers who have got in to a way of thinking that something that should get accepted they have been rejecting. The bad reviewers will ignore it and continue as before, so I think that is why action should be taken against those not even trying.
Just difficult to separate the abusers from the not so gifted in the IQ department, which is no fault of their own since we are all built differently. I think the stats from appeals added to other stats could separate out many type of abusers if Niantic can put someone on the project who can work out algorithms to do this
Niantic is not going to give individual feedback to reviewers. We've been asking for that for years. Niantic says the reviewers could pool their replies, and use them to "game the system".
I doubt they'll even do +1 -1 on agreements. For example, say you live in an area with a 9-month nomination turnaround, and you have 90 agreements toward an upgrade. And suddenly, you have 50 agreements toward an upgrade. THEN you find out that some agreements you lost were from 4 years ago when the rules were different! Any incentive you ever had to nominate and review just went out the window.
The point of appeals is to get more valid waypoints into the system. As a bonus, this will build the morale of nominators.
How would we be phrasing appeals? What should go in there? As if it's a new submission or specifically addressing why the rejection criteria were incorrect?
When you send an appeal, the person dealing with it will see your nomination in its entirety, plus whatever you put in the text box for the appeal. So you can use the box to further explain why you think your nomination meets the criteria, include any other information not already present in your nomination, and address the rejection reasons you received.
One way that Niantic could give reviewers better feedback without being specific about any individual review it is to improve the stats provided to us. I would like to see:
Total submissions reviewed
Total submissions accepted
Total submissions rejected
Total submissions duplicated
Total submissions disagreed OR Submissions pending consensus
(New stat) Total rejections appealed
(New stat) Total rejections overturned on appeal
And to have the same breakdown available for edits.
I would also love to know how well I was doing on various metrics. Like maybe 50th percentile and above for the rate of accepted/rejected/duplicated agreements could have a green dot, 51-75th percentile could have a yellow dot, and below that a red dot. That could let me know, for example, that I'm doing well on acceptances and rejections but I'm missing the boat on duplicates. Stats like this would only show up if you had a fairly high number of reviews under your belt, like maybe a thousand or more... enough that you couldn't work out any identifying details from the aggregates.
Bc of the point "Contribution Management page", I would prefer that there is a button to delete instead of just retract or hold. Because such, sometimes stupid submissions only block and prolong my list unnecessarily.
@Hosette-ING That would be nice. The dots would need to only be about reviews in the past month. Otherwise, changes in behavior wouldn't be rewarded/punished for months or years. Also, many of us would ALWAYS have a red dot by Duplicates, because at first, Niantic counted duplicates in the reject bucket.
Just wanted to let you all know we are aware of the issue affecting rejected appeals not including the rejection reason. We've let the team know and we are working on it. More info to come when it's available.
I haven't had any personally resolve, but from what I've seen from others it looks just like a normal accept or reject (except with no reasons on the rejections)
@RatataFan045-PGO On Wayfarer, an accepted appeal keeps its original nomination date. It looks just like any other accepted nomination - same as if the original nomination had been accepted.
I'd hope they would come back with some sort of !this one has been appealed" indication, or some sort of "lock" on them so they can't be pushed back into the system.
Still no one with an SS of an accepted or rejected appeal?
Wait, appeals are going through now? I knew they were planned to happen this weekend roughly but I still hadn't seen anything yet. Do we get emails or anything like that or do we just need to check our contribution management?
By "lock" I meant that there was something to prevent a nomination that had been through the appeals system and come back as rejected from being resubmitted by using another appeal for a "second bite of the cherry".
If you mean preventing a person from appealing the same nomination multiple times, that was already confirmed by both Danbocat and Tintino that you could only appeal a nomination once. They may, of course, make a new submission and try again at a later time.
Comments
Considering Niantic doesn't have a good track record of handling reviews, I'm worried they'll get it wrong themselves. On the other hand, some of my rejections make me want to reach my hand through my phone and slap somebody.
I would also leave Wayfarer completely if I were scolded for not approving a mattress store or an Aldi. They need to tread very, very carefully.
The ability to put a nomination on HOLD. This would pull it out of the review queue and release it whenever you want. This means if you submitted a nomination that you don't feel is up to par and want to modify it, or think about whether you just want to withdraw it so that it doesn't get auto upgraded, you'll be able to buy yourself this time.
Why spend time on a feature that only helps Contributors who are already so greatly advantaged?
Why not first work on making nomination times equitable?? With the process as it is, I will never need to put a nomination on hold - I can still edit its title and description four months later, because it will still be In Queue. (A city of 4 million is a 2 hr drive from me, in the same region.)
Thank you for the updates regarding appeals.
It doesn't impact rating right now? Please don't have rejected nominations hurt Wayfarer rating. I think you will see from doing appeals that many excellent (or at least acceptable) nominations are rejected, and a lot of them several times, before going through as they should have in the first place. Even if reviewers eventually all were kept up to date on clarifications on current criteria, there are too many variables we may not be aware of when we submit. In my area there is a professional photographer dropping gorgeous photospheres in the vicinity of the subject without much regard to exact placement that I don't know about until I have received a rejection for mismatched location. There are gps glitches and out of date satellite/street views that the nominator has no control over that can cause a rejection of a good nomination.
If there's a great poi and multiple people submit it, someone will be accepted and everyone else will get a duplicate rejection. Even if we learn that the Wayspot went live, we can't withdraw our nomination if it is in voting. And I can't scroll through all my nominations constantly checking for that.
It's the dedicated Wayfarers who are going out and finding the most interesting things to submit. If getting rejected hurts rating, then you are only going to see the same few sure things submitted and have fewer people to review them.
The abuse cabals would have a field day with this, rejecting everything that doesn't come from their inner circle until no one else can submit in the area.
Agreed. SOME of my nominations have taken 7+ resubmissions before finally being accepted. None of those, including various murals, "local hotspots", trail markers, playgrounds, historic buildings/artifacts, were invalid.
Even the few I've submitted on a lark, just a whim in the moment, that I knew had a very low chance of succeeding (ie. small parks without signage) were still valid.
But because, even when I'm unable to revisit the location to take "improved" photos, I'm still willing to resubmit with variations on the title/description, it would make me feel VERY disillusioned that these attempts could drag down my "rating".
Yeah, I'd like to see this loop be closed. I've had some rejections on things that should have been accepted. I think they were victims of reviewers who either went too fast to read all the information or people who only accept obvious 5* candidates. If they have to use their brain because they've never seen another POI like this one, they get confused and hit reject.
I also think it's pretty important to be able to cancel an appeal, especially since we have been able to submit one per day.
They probably don't want anyone exploring there, so I'd guess No.
NEED MOAR STOPS!!!!
I also want to add that I really, really, really loved the Russia WF challenge. I felt like I was able to make a difference both in the Moscow community where I chose to review and in my local community because I was able to earn so many valuable upgrades! I live in one of those areas where non-upgraded contributions take 10 - 14 months to reach a decision (yea or nay). Any leg up I can get to have Upgrades makes a big, big difference locally.
I feel like there was some negativity in how the Russia challenge worked. But I was fully engaged with it for at least 7 or 8 days. I have been really disappointed to see subsequent challenges structured differently - either restricting who can participate or not giving the same kind of rewards.
Rejected as a body part
I think good reviewers who put thought and effort in to a review forget that there are so many who don't put in any effort in at all because they are speed reviewing for upgrades or something else.
So I think feedback would be useful for serious reviewers who have got in to a way of thinking that something that should get accepted they have been rejecting. The bad reviewers will ignore it and continue as before, so I think that is why action should be taken against those not even trying.
Just difficult to separate the abusers from the not so gifted in the IQ department, which is no fault of their own since we are all built differently. I think the stats from appeals added to other stats could separate out many type of abusers if Niantic can put someone on the project who can work out algorithms to do this
I'd like to to have the ability to upgrade edits and the other types of contributions just like with nominations.
Also, I can't wait for coal to be cleared. Some nominations and edits are stuck there for years.
Contribution page and coral-clear features are my favs. Good job!
I think to get to the cabin you need to follow a hiking trail……
but unfortunately only some waypoints get accepted and you end up lost trying to follow the route 🤔
Niantic is not going to give individual feedback to reviewers. We've been asking for that for years. Niantic says the reviewers could pool their replies, and use them to "game the system".
I doubt they'll even do +1 -1 on agreements. For example, say you live in an area with a 9-month nomination turnaround, and you have 90 agreements toward an upgrade. And suddenly, you have 50 agreements toward an upgrade. THEN you find out that some agreements you lost were from 4 years ago when the rules were different! Any incentive you ever had to nominate and review just went out the window.
The point of appeals is to get more valid waypoints into the system. As a bonus, this will build the morale of nominators.
@cyndiepooh-ING A duplicate is not a rejection.
How would we be phrasing appeals? What should go in there? As if it's a new submission or specifically addressing why the rejection criteria were incorrect?
When you send an appeal, the person dealing with it will see your nomination in its entirety, plus whatever you put in the text box for the appeal. So you can use the box to further explain why you think your nomination meets the criteria, include any other information not already present in your nomination, and address the rejection reasons you received.
One way that Niantic could give reviewers better feedback without being specific about any individual review it is to improve the stats provided to us. I would like to see:
And to have the same breakdown available for edits.
I would also love to know how well I was doing on various metrics. Like maybe 50th percentile and above for the rate of accepted/rejected/duplicated agreements could have a green dot, 51-75th percentile could have a yellow dot, and below that a red dot. That could let me know, for example, that I'm doing well on acceptances and rejections but I'm missing the boat on duplicates. Stats like this would only show up if you had a fairly high number of reviews under your belt, like maybe a thousand or more... enough that you couldn't work out any identifying details from the aggregates.
Bc of the point "Contribution Management page", I would prefer that there is a button to delete instead of just retract or hold. Because such, sometimes stupid submissions only block and prolong my list unnecessarily.
@Hosette-ING That would be nice. The dots would need to only be about reviews in the past month. Otherwise, changes in behavior wouldn't be rewarded/punished for months or years. Also, many of us would ALWAYS have a red dot by Duplicates, because at first, Niantic counted duplicates in the reject bucket.
Hey Explorers,
Just wanted to let you all know we are aware of the issue affecting rejected appeals not including the rejection reason. We've let the team know and we are working on it. More info to come when it's available.
Safe Exploring!
Anyone who has an example how it looks like when an appeal is accepted or rejected in wayfarer? I would really like to see it.
I haven't had any personally resolve, but from what I've seen from others it looks just like a normal accept or reject (except with no reasons on the rejections)
@RatataFan045-PGO On Wayfarer, an accepted appeal keeps its original nomination date. It looks just like any other accepted nomination - same as if the original nomination had been accepted.
And you receive a standard „congratz your wayspot got accepted“ mail?
I'd hope they would come back with some sort of !this one has been appealed" indication, or some sort of "lock" on them so they can't be pushed back into the system.
Still no one with an SS of an accepted or rejected appeal?
Wait, appeals are going through now? I knew they were planned to happen this weekend roughly but I still hadn't seen anything yet. Do we get emails or anything like that or do we just need to check our contribution management?
You SHOULD receive an email, unfortunately many people have reported that as not working.
I don't understand your "lock" request. And I've seen screenshots shared in other locations.
By "lock" I meant that there was something to prevent a nomination that had been through the appeals system and come back as rejected from being resubmitted by using another appeal for a "second bite of the cherry".
If you mean preventing a person from appealing the same nomination multiple times, that was already confirmed by both Danbocat and Tintino that you could only appeal a nomination once. They may, of course, make a new submission and try again at a later time.