I review on mobile, and I adjust the text size down to 50% and rotate my iPhone when I want to take a screenshot of the first three categories. Adjust your text size, mobile reviewers!
It doesn’t seem fair that a participant can only earn an upgrade if they correctly guess which category the ‘winners’ will be in. Would be easier just to give everyone who participated in good faith a free upgrade.
I really don't want to be negative. But y'all have GOT to talk to REAL USERS before designing these challenges.
1) Many of us have been reviewing for a long time and don't get confused about things we come across. I may give some things a 3 star but that usually means I'm ambivalent, not confused.
2) We ONLY get the reward if we are confused about the same category as the 3 most frequently submitted nominations? So, again, those of us who know the criteria really well are not likely to earn the award.
3) The award is 1 Upgrade for doing 100 reviews?! I mean, that's pretty dang close to just earning an upgrade the old fashioned way for those of us who know how to review correctly. I don't get it. What's the award? You've got people in this forum who do 200+ reviews each DAY.
4) The people who need a better understanding of the criteria will never understand this challenge or even know it's happening. The noobs are not going to take a screenshot and go to some form on another site to submit an image that won't result in a guaranteed answer.
Sigh. I guess I should just be happy it's not about scanning.
Normally on iOS, when taking a screenshot, you can select "Screen" or "Full Page". However it looks like Niantic coded the Wayfarer website in a viewport, so doing "Full Page" changes nothing.
I don't know if another "browser" would work, since they all use Safari's WebKit no matter what. But the form only allows upload of 1 image so you can't take 3 screenshots... I suggest @NianticTintino you at least allow 3 screenshots in the upload if you can? That way iOS users can upload without jumping through hoops.
I posted the ongoing pool debate. What constitutes a "similar residentially-focused location" that is ineligible per the November 2020 AMA. And what is the defining factor that makes a pool ineligible? Because that AMA also said, " Other than that, pools would be a great place to meet and that encourages exercise and should be considered eligible." Which I agree with.
But "pools" wasn't on the drop-down list, so I had to pick "other" so no way it will be a top three.
I am assuming the review 100 starts immediately and not after we submit the form? Reviewed close to 100 and still have not located what I am looking for. Pools!
This is ridiculous. Getting a screenshot that has all that info is not Intuitive. You know what would work? Allowing three photos from mobile devices to give Niantic what they want. This is amongst the poorest conceived ideas Niantic has ever concocted and that says a lot. This barrier was incredibly obvious and easily resolvable. You’d think after six years Niantic would have figured this stuff out.
@NianticTintino I know a lot of our feedback is negative, including my own, but I do want to say that I'm loving how active you've been on the forum today. We crave this kind of discussion with y'all. Please keep it up, even when we're salty.
You mean actual oversight? lol as if Niantic would ever fork over the money for that. Even basic filters could filter out soo much of the trash subs. I just went through 40 odd subs. All 4 of the portal edits I had were "Please select the spot on the right" or such to try to abuse the system.
Reviewing poi's sucks. It's a waste of time. If someone wants something, and they have the majority, they will get it.
I don't care about the rewards although I think they're just fine, no complaints - it sounds like a fun scavenger hunt! Unfortunately I'm having some issues with exhaustion and brain fog at the moment so can't really comprehend the rules, but once I get a good night's sleep I expect to participate to the fullest! Thanks for providing something different to do. :)
Just off the top of my head they could have said something like
Do 100 reviews to receive an upgrade and a vote on which category you think needs most clarification. Maybe allow each reviewer 3 votes and 3 free upgrades for the week.
@NianticTintino Please have a rethink and give anyone who submits a picture an upgrade instead of the random lottery upgrade win.
Although don't do this one day before the event ends :D
For future challenges, I would suggest you take into account how much we review/how many agreements we collect. I know you received some **** storm with the rewards of the russia challenge, but this was mainly because poor communication and low effort - big reward. No one really knew if a reviewer had to review 1 nomination in russia or whether they need to gain 1 agreement with a russian nomination.
A lot of people did 1! review and gained 10? Upgrades. That's not how it should work. The more reviews one reviewer does, the more upgrades should be rewarded. Make it cap at a certain limit, but don't just hand out upgrades like pens for students. Everyone loves free stuff. That's essentially what you have been doing. There should be some effort required to gain these. After all, you want the backlog to shrink in countries with a huge number of nominations and low number of reviewers. If one reviewer does one review and gains 10 upgrades, it has the opposite effect.
Another aspect is the incentive in this challenge. You require me to do at least 100 reviews. That's fine, but is there anything else for me after I do 100 reviews? No, so I could just stop once I reach the requirement. If there would be something like 2 Upgrades every 100 agreements, a lot of folks including me would review like crazy, the backlog would shrink, the "elite" of reviewers (who hopefully know what makes a good Wayspot) would be rewarded and your Lightship database would become more valuable.
You have been helpfully clarifying but it is all mixed up in this thread could the announcement post be amended to have clear instructions.
once last (?) time
starting 17th August - what time UTC did it start?
finish 25th August 06:59 UTC
For global events giving the time in UTC is better.
within that time you must review 100 contributions in wayfarer - does this mean new waypoints, and edits and photos or not? As later on you refer to 100 nominations and that is different.
What you want out of that 100 or an older one???? Is an example where
It is acceptable
But you are unsure how to categorise under the what is it section
or
when you mean criteria whether something might be a reject but you are not sure how it would score against the acceptance criteria.
I think it’s the first one but the use of language is confusing and probably more so when Google translate gets hold of it.
By completing the form you are in with a chance of an upgrade.
To be successful you need to select one of the top 3 categories other people chose.
If you do you will get an upgrade provided you also met the 100 reviews entry requirement.
Because of a number of reasons I would really welcome clarity in one place instead of across numerous posts.
Not well worded, but I sort of see what Niantic are doing - any kind of feedback on why 30% of my reviews are "incorrect" is welcome, and any clarification about some of the more regularly debated issues is welcome. For those who say "but we know we are doing", take it as an opportunity to submit those things where, for some reason the "community" seem to be going in a different direction from the criteria. What I would really like to see is specific feedback on some of the regular submission to give a simple "yes - no" answer to some things.
thank you for your reply, sorry to say, dear @NianticTintino but did you talk to the Ambassadors beforehand? Also, maybe someone here could help you with making the announcement.
"Improving the Wayfarer Criteria" - what does that mean? "...claryfing the criteria that the community finds most challenging". - "the most on the fence about" - ???
You are collecting the sent in "Challenge Submissions" (Confusing criteria?)"
I am totally with you - but you lost me at every sentence. it isnt clear to me what niantic wants, it isnt clear to me what should be done, it isnt clear to me why you are giving out AGAIN totally unsatisfying rewards that are given out seemingly random.
Now please, talk to the Ambassadors, or make another group of 5 people that are reviewing on a daily basis and make a PLAN for the next challenge.
The Categories are really weird. Why didn't they just look thru the "Nomination Improvement" category here on this community, to choose categories where real people seem to get confused?
What if you're unsure about a restaurant because it looks run down, something common, isn't even on yelp, and the reviewer didn't say why it's special? You wouldn't want the "Popular restaurant" option, because you're pretty sure it's not popular.
What about a spit of grass in a neighborhood that the nominator thinks is "a common area", like a park, but you think it's just landscaping? What category is that?
What about neighborhood clubhouses? What if someone calls something a clubhouse, but it's really the showers and toilets for the pool? What about a pool? I don't see any category for neighborhood items.
What about "street furniture" - lampposts, cell phone towers, geographic disc markers along the road?
A plaque that says "In memory of... from..." - in other words, a park fundraiser where you can buy a plaque for a bench, tree, etc? The person is recently deceased, and we don't know anything about them, so have to assume no more special than the other million people who have died recently. What category would that be?
We should have had a contest to choose the categories for the contest. 🤣
According to the initial post: "and when you come across a contribution that you find to be the most confusing to you, take a screenshot of it and submit it to the Criteria Challenge Form"
But I wouldn't do that. I would keep a folder with several screenshots of potential candidates where I've found issues and when the final day is close enough I would pick which one to send instead of sending one right away and then find out another that it's a much better example of a nomination where I want a clarification about the criteria.
With worldwide reviews I mean: you've requested that we send a screenshot of the nomination that caused us the confussion about the criteria, so in the end you might have 1000 screenshots where people ask clarification about pedestrian access (those deadly rural roads) and in those nominations we will find a huge range of nominations, some that are badly presented and can't be judged properly based only on a screenshot without being able to see the original full-size pictures and/or streetview, some where the reviewer is too harsh and tries to set their point of view that only the very best elements are worth being a PoI, and others where the reviewer hasn't read anything and bases their reasoning only on existing wayspots.
So, are you gonna give detailed replies of every nomination sent in the three top winning categories?
I doubt so, and that leads to the question: why are you doing this?
Just put a poll in the wayfarer page so each wayfarer can vote only once (except multiaccounters and those that use different email for Ingress and Pogo) where you ask people which category should be explained better.
That's all, no need to ask people to send screenshots that you're not gonna use.
Give the rewards to everyone that participates, not only those that guess which is one of the top three categories, that's just lame.
I will do the challenge but I don't see anyone that is not here on the community regularly doing this the reward is not good. I'm in a group of 375 wayfarer and only one besides me showed real interest. Rewards could be double upgrades and a couple of appeals and give us clothes, we are asking for years at this point.
Employee 2: "Yeah, we should do that but it's really hard to know where to start. What are the highest priority 'categories' that need clarification?"
Employee 3: "It's also really hard to try to explain without concrete examples. Any time I've tried to explain it on the forums, it's only led to a flurry of more questions about really specific situations. How can we get concrete examples to talk about?"
Emp 1: "People also seem to like challenges - can we combine all these things?"
Emp 3: "Oh! Like, make them give us photos of real world submissions they see that are iffy? I like that."
Emp 2: "How do we parse through all that data?"
Emp 1: "We need to categorize the examples. But, yeah, we that's a lot of work. So we need them to pick the category for us. That way we only have to analyze the results. AND we get to see what they think is 'confusing' (is that the word we should use?) about the example by the category they pick."
Emp 2: "That's still a LOT of data."
Emp 1: "True. We want them to do it but not overwhelm us. And once we decide on the categories, we have to look through all those examples and figure out what's confusing (yeah, that's the word we should use) about each individual example in each category."
Emp 3: "Then we have to figure out how to explain why some are eligible and some are not eligible within each category."
Emp 2: "You know a lot of the ineligibility is based on location - how will a photo show the accuracy of the location?"
Emp 1: "You can tell from the support photo."
Emp 2: "You're adorable. OK, how do we incentivize them to do this?"
Emp 3: "They like Upgrades."
Emp 1: "Yeah, but we can't give too many or they will overwhelm us. So, they can only submit one confusing submission. We will only give one Upgrade."
Emp 2: "ONE UPGRADE?"
Emp 1: "Yeah, that's not a lot but we will say that they only have to do 100 reviews."
Emp 2: "Uh..."
Emp 3: "Yeah, yeah, I'm loving this. They will love this."
Emp 2: "You are also adorable."
Emp 1: "Two, we might need to loop HR in on how you keep calling us adorable."
Emp 3: "Right now this challenge isn't much of a game. What if we tie their Upgrade reward to picking the right category. So, if you do 100 reviews AND submit a confusing contribution in one of the top 3 categories, then you WIN! Everyone likes a winner!!!"
Emp 2: "Adora... Sorry. I'm gonna go do some more Appeals. You guys have this all worked out."
My 2 pet hates are "select the most appropriate location" and "select the photos that don't meet the criteria"
The location one usually a guess unless you can get there on steetview,
The Photo one doesn't show you the actual photo in use in the game so you don't know if they are just duplicates and again if you don't know the area/location the photo may not even be of the thing being described
Comments
I review on mobile, and I adjust the text size down to 50% and rotate my iPhone when I want to take a screenshot of the first three categories. Adjust your text size, mobile reviewers!
It doesn’t seem fair that a participant can only earn an upgrade if they correctly guess which category the ‘winners’ will be in. Would be easier just to give everyone who participated in good faith a free upgrade.
I really don't want to be negative. But y'all have GOT to talk to REAL USERS before designing these challenges.
1) Many of us have been reviewing for a long time and don't get confused about things we come across. I may give some things a 3 star but that usually means I'm ambivalent, not confused.
2) We ONLY get the reward if we are confused about the same category as the 3 most frequently submitted nominations? So, again, those of us who know the criteria really well are not likely to earn the award.
3) The award is 1 Upgrade for doing 100 reviews?! I mean, that's pretty dang close to just earning an upgrade the old fashioned way for those of us who know how to review correctly. I don't get it. What's the award? You've got people in this forum who do 200+ reviews each DAY.
4) The people who need a better understanding of the criteria will never understand this challenge or even know it's happening. The noobs are not going to take a screenshot and go to some form on another site to submit an image that won't result in a guaranteed answer.
Sigh. I guess I should just be happy it's not about scanning.
Normally on iOS, when taking a screenshot, you can select "Screen" or "Full Page". However it looks like Niantic coded the Wayfarer website in a viewport, so doing "Full Page" changes nothing.
I don't know if another "browser" would work, since they all use Safari's WebKit no matter what. But the form only allows upload of 1 image so you can't take 3 screenshots... I suggest @NianticTintino you at least allow 3 screenshots in the upload if you can? That way iOS users can upload without jumping through hoops.
Yeah this is actually probably the easiest way now that I'm looking.
Tap the "aA" in the URL bar and at least on the standard iPhone 12 size 50% in landscape looks like a normal desktop view with all 3 boxes horizontal.
I posted the ongoing pool debate. What constitutes a "similar residentially-focused location" that is ineligible per the November 2020 AMA. And what is the defining factor that makes a pool ineligible? Because that AMA also said, " Other than that, pools would be a great place to meet and that encourages exercise and should be considered eligible." Which I agree with.
But "pools" wasn't on the drop-down list, so I had to pick "other" so no way it will be a top three.
Yup! 100 Reviews :)
It might be due to the size of the file. Try making the file smaller and try again. Keep me posted.
are they just going to ignore this
@NianticTintino I forgot to take a screenshot of my entry. Is there a way to get back and see what I wrote on the form?
I am assuming the review 100 starts immediately and not after we submit the form? Reviewed close to 100 and still have not located what I am looking for. Pools!
This is ridiculous. Getting a screenshot that has all that info is not Intuitive. You know what would work? Allowing three photos from mobile devices to give Niantic what they want. This is amongst the poorest conceived ideas Niantic has ever concocted and that says a lot. This barrier was incredibly obvious and easily resolvable. You’d think after six years Niantic would have figured this stuff out.
@NianticTintino I know a lot of our feedback is negative, including my own, but I do want to say that I'm loving how active you've been on the forum today. We crave this kind of discussion with y'all. Please keep it up, even when we're salty.
You mean actual oversight? lol as if Niantic would ever fork over the money for that. Even basic filters could filter out soo much of the trash subs. I just went through 40 odd subs. All 4 of the portal edits I had were "Please select the spot on the right" or such to try to abuse the system.
Reviewing poi's sucks. It's a waste of time. If someone wants something, and they have the majority, they will get it.
I don't care about the rewards although I think they're just fine, no complaints - it sounds like a fun scavenger hunt! Unfortunately I'm having some issues with exhaustion and brain fog at the moment so can't really comprehend the rules, but once I get a good night's sleep I expect to participate to the fullest! Thanks for providing something different to do. :)
I think I have many questions about this event. Please give me more infomation with clearly word.
so posted mid month letting us know we have 2 weeks to submit. hope im on the next one im not 37 yet
Just off the top of my head they could have said something like
Do 100 reviews to receive an upgrade and a vote on which category you think needs most clarification. Maybe allow each reviewer 3 votes and 3 free upgrades for the week.
@NianticTintino Please have a rethink and give anyone who submits a picture an upgrade instead of the random lottery upgrade win.
Although don't do this one day before the event ends :D
For future challenges, I would suggest you take into account how much we review/how many agreements we collect. I know you received some **** storm with the rewards of the russia challenge, but this was mainly because poor communication and low effort - big reward. No one really knew if a reviewer had to review 1 nomination in russia or whether they need to gain 1 agreement with a russian nomination.
A lot of people did 1! review and gained 10? Upgrades. That's not how it should work. The more reviews one reviewer does, the more upgrades should be rewarded. Make it cap at a certain limit, but don't just hand out upgrades like pens for students. Everyone loves free stuff. That's essentially what you have been doing. There should be some effort required to gain these. After all, you want the backlog to shrink in countries with a huge number of nominations and low number of reviewers. If one reviewer does one review and gains 10 upgrades, it has the opposite effect.
Another aspect is the incentive in this challenge. You require me to do at least 100 reviews. That's fine, but is there anything else for me after I do 100 reviews? No, so I could just stop once I reach the requirement. If there would be something like 2 Upgrades every 100 agreements, a lot of folks including me would review like crazy, the backlog would shrink, the "elite" of reviewers (who hopefully know what makes a good Wayspot) would be rewarded and your Lightship database would become more valuable.
Thanks @EvieEvolved-ING and @TrevorAlan-PGO for help around screenshot.
@NianticTintino
You have been helpfully clarifying but it is all mixed up in this thread could the announcement post be amended to have clear instructions.
once last (?) time
starting 17th August - what time UTC did it start?
finish 25th August 06:59 UTC
For global events giving the time in UTC is better.
within that time you must review 100 contributions in wayfarer - does this mean new waypoints, and edits and photos or not? As later on you refer to 100 nominations and that is different.
What you want out of that 100 or an older one???? Is an example where
It is acceptable
But you are unsure how to categorise under the what is it section
or
when you mean criteria whether something might be a reject but you are not sure how it would score against the acceptance criteria.
I think it’s the first one but the use of language is confusing and probably more so when Google translate gets hold of it.
By completing the form you are in with a chance of an upgrade.
To be successful you need to select one of the top 3 categories other people chose.
If you do you will get an upgrade provided you also met the 100 reviews entry requirement.
Because of a number of reasons I would really welcome clarity in one place instead of across numerous posts.
Not well worded, but I sort of see what Niantic are doing - any kind of feedback on why 30% of my reviews are "incorrect" is welcome, and any clarification about some of the more regularly debated issues is welcome. For those who say "but we know we are doing", take it as an opportunity to submit those things where, for some reason the "community" seem to be going in a different direction from the criteria. What I would really like to see is specific feedback on some of the regular submission to give a simple "yes - no" answer to some things.
thank you for your reply, sorry to say, dear @NianticTintino but did you talk to the Ambassadors beforehand? Also, maybe someone here could help you with making the announcement.
"Improving the Wayfarer Criteria" - what does that mean? "...claryfing the criteria that the community finds most challenging". - "the most on the fence about" - ???
You are collecting the sent in "Challenge Submissions" (Confusing criteria?)"
I am totally with you - but you lost me at every sentence. it isnt clear to me what niantic wants, it isnt clear to me what should be done, it isnt clear to me why you are giving out AGAIN totally unsatisfying rewards that are given out seemingly random.
Now please, talk to the Ambassadors, or make another group of 5 people that are reviewing on a daily basis and make a PLAN for the next challenge.
I feel the next challenges will be;
As this one is about Criteria Clarification, this is their way of hitting the Ambassador goals.
The Categories are really weird. Why didn't they just look thru the "Nomination Improvement" category here on this community, to choose categories where real people seem to get confused?
What if you're unsure about a restaurant because it looks run down, something common, isn't even on yelp, and the reviewer didn't say why it's special? You wouldn't want the "Popular restaurant" option, because you're pretty sure it's not popular.
What about a spit of grass in a neighborhood that the nominator thinks is "a common area", like a park, but you think it's just landscaping? What category is that?
What about neighborhood clubhouses? What if someone calls something a clubhouse, but it's really the showers and toilets for the pool? What about a pool? I don't see any category for neighborhood items.
What about "street furniture" - lampposts, cell phone towers, geographic disc markers along the road?
A plaque that says "In memory of... from..." - in other words, a park fundraiser where you can buy a plaque for a bench, tree, etc? The person is recently deceased, and we don't know anything about them, so have to assume no more special than the other million people who have died recently. What category would that be?
We should have had a contest to choose the categories for the contest. 🤣
Thank you for the reply.
According to the initial post: "and when you come across a contribution that you find to be the most confusing to you, take a screenshot of it and submit it to the Criteria Challenge Form"
But I wouldn't do that. I would keep a folder with several screenshots of potential candidates where I've found issues and when the final day is close enough I would pick which one to send instead of sending one right away and then find out another that it's a much better example of a nomination where I want a clarification about the criteria.
With worldwide reviews I mean: you've requested that we send a screenshot of the nomination that caused us the confussion about the criteria, so in the end you might have 1000 screenshots where people ask clarification about pedestrian access (those deadly rural roads) and in those nominations we will find a huge range of nominations, some that are badly presented and can't be judged properly based only on a screenshot without being able to see the original full-size pictures and/or streetview, some where the reviewer is too harsh and tries to set their point of view that only the very best elements are worth being a PoI, and others where the reviewer hasn't read anything and bases their reasoning only on existing wayspots.
So, are you gonna give detailed replies of every nomination sent in the three top winning categories?
I doubt so, and that leads to the question: why are you doing this?
Just put a poll in the wayfarer page so each wayfarer can vote only once (except multiaccounters and those that use different email for Ingress and Pogo) where you ask people which category should be explained better.
That's all, no need to ask people to send screenshots that you're not gonna use.
Give the rewards to everyone that participates, not only those that guess which is one of the top three categories, that's just lame.
I will do the challenge but I don't see anyone that is not here on the community regularly doing this the reward is not good. I'm in a group of 375 wayfarer and only one besides me showed real interest. Rewards could be double upgrades and a couple of appeals and give us clothes, we are asking for years at this point.
After thinking about this challenge, I tried to put on my "Niantic" hat. Here's how I see them coming up with this challenge...
Employee 1: "People want criteria clarifications."
Employee 2: "Yeah, we should do that but it's really hard to know where to start. What are the highest priority 'categories' that need clarification?"
Employee 3: "It's also really hard to try to explain without concrete examples. Any time I've tried to explain it on the forums, it's only led to a flurry of more questions about really specific situations. How can we get concrete examples to talk about?"
Emp 1: "People also seem to like challenges - can we combine all these things?"
Emp 3: "Oh! Like, make them give us photos of real world submissions they see that are iffy? I like that."
Emp 2: "How do we parse through all that data?"
Emp 1: "We need to categorize the examples. But, yeah, we that's a lot of work. So we need them to pick the category for us. That way we only have to analyze the results. AND we get to see what they think is 'confusing' (is that the word we should use?) about the example by the category they pick."
Emp 2: "That's still a LOT of data."
Emp 1: "True. We want them to do it but not overwhelm us. And once we decide on the categories, we have to look through all those examples and figure out what's confusing (yeah, that's the word we should use) about each individual example in each category."
Emp 3: "Then we have to figure out how to explain why some are eligible and some are not eligible within each category."
Emp 2: "You know a lot of the ineligibility is based on location - how will a photo show the accuracy of the location?"
Emp 1: "You can tell from the support photo."
Emp 2: "You're adorable. OK, how do we incentivize them to do this?"
Emp 3: "They like Upgrades."
Emp 1: "Yeah, but we can't give too many or they will overwhelm us. So, they can only submit one confusing submission. We will only give one Upgrade."
Emp 2: "ONE UPGRADE?"
Emp 1: "Yeah, that's not a lot but we will say that they only have to do 100 reviews."
Emp 2: "Uh..."
Emp 3: "Yeah, yeah, I'm loving this. They will love this."
Emp 2: "You are also adorable."
Emp 1: "Two, we might need to loop HR in on how you keep calling us adorable."
Emp 3: "Right now this challenge isn't much of a game. What if we tie their Upgrade reward to picking the right category. So, if you do 100 reviews AND submit a confusing contribution in one of the top 3 categories, then you WIN! Everyone likes a winner!!!"
Emp 2: "Adora... Sorry. I'm gonna go do some more Appeals. You guys have this all worked out."
*I might identify too much with Employee 2.*
Be honest you were there
My 2 pet hates are "select the most appropriate location" and "select the photos that don't meet the criteria"
The location one usually a guess unless you can get there on steetview,
The Photo one doesn't show you the actual photo in use in the game so you don't know if they are just duplicates and again if you don't know the area/location the photo may not even be of the thing being described
and I can never "Skip" these
They are Employee 2. HR have a case on them already.
@NianticTintino Are confusing edits allowed as an entry?
Examples: