The reviewing spectrum

I have seen many people comment that they either do a 1* or a 5* (Which 90% of the time i also do the same thing) But does anyone do the 2* to 4* range? And lets say the majority of votes on a submission is a 1*, do the ones that gave it a 2* get points towards their upgrade percentage, as their 2* is still considered a rejection? (As i remember correctly reading that someone said a 2* is still a no)


When have you ever used a 2* and when have you used a 3* or 4*?

Comments

  • HankWolfman-PGOHankWolfman-PGO Posts: 4,849 ✭✭✭✭✭

    I almost never use the 2* rating. Everything else gets used plenty though.

  • Stephyypooke-INGStephyypooke-ING Posts: 506 ✭✭✭✭✭

    I agree 2* is my least used stars but I use all the others every review session.

  • Hosette-INGHosette-ING Posts: 3,469 ✭✭✭✭✭

    For "Should this be a Wayspot?" I use 1* and 5* most heavily but the others get a workout as well.

    For the other fields I'm much more likely to use the full spectrum.

  • TrevorAlan-PGOTrevorAlan-PGO Posts: 998 ✭✭✭✭✭

    My understanding was 3* is neutral-positive? 2* is basically a reject. I know it was mentioned in the AMA that things don't get rejected if one of the other categories gets a 1* or 2*... But I've had nominations rejected with the only reason stated "The nomination does not appear to be historically or culturally significant" which isn't a rejection reason soooo, what?

  • HaramDingo-INGHaramDingo-ING Posts: 1,725 ✭✭✭✭✭

    I rarely give out 5*'s flat. Think on average I used 3* more, mainly because I have my own reviewing style but it's how everything goes together in the end, it comes out as an agreement, and everyone is all happy. Well, mostly.

  • Hosette-INGHosette-ING Posts: 3,469 ✭✭✭✭✭
    edited October 2021

    @TrevorAlan-PGO Things can get rejected because a lot of people gave it 1*, and when they did that they have to provide a rejection reason to go with it. They can also get rejected because everybody just gives it "meh" ratings across the board.

    I'm pretty sure that email thing is that the email generation code is kinda dumb. There was an old AMA question about what would happen if everyone rated everything 2* on all fields and the answer was that it would be rejected. So imagine that case. The email generation code doesn't have anything to fill in for a rejection reason because there are no 1* reasons, so what does it do? We don't know, but my best guess is that it starts scrounging around looking for fields where the rating was especially low and offers them up in the hopes that they're helpful. This explanation fits all of the observed data and it also makes sense from a logical perspective. (Historical/cultural significance and visual uniqueness might be the only ones it does this with... I'm not sure.) I think those reasons are more confusing than helpful.

  • Elijustrying-INGElijustrying-ING Posts: 5,482 Ambassador

    I think this is a good description of what probably happens.

    I would find it helpful if we were clearly told what happens with our scores. Yes there is the old argument that it could be misused……but that happens now.

  • peardrop-INGpeardrop-ING Posts: 34 ✭✭

    I'm currently poking about in a recent GDPR data dump and have worked out the "average rating" across everything I have reviewed since May 2017.

    My average (e.g. unweighted, across all rating fields) is 4.4 for everything not 1* -almost 75% of my non-1* reviews were 4-5 stars, (23% 3-4, and 2% 2-3).

    Still digging, but was interesting to see that I've been fairly consistent over all the time I've been doing this, with a Great rating (70-80% agreement rate for the last 2 years, looking at all decisions Vs all reviews).

  • VladDraco-PGOVladDraco-PGO Posts: 560 ✭✭✭✭

    Hi, very interesting question, thanks !

    On last 200 :

    1*/abuse : 50%, 2* : 8%, 3* : 10%, 4* : 18%, 5* : 14%

    My ratings are dependent on how I feel about what is submitted :

    1* : Don't meet any criterias/ineligible

    2* : it can meet one criteria but it's really not clear and i don't want this to be approved

    3* : it's ok, but not great, some problems in this nomination

    4* : ok

    5* : great, why it's not a Waypoint yet.

  • WoodWose-PGOWoodWose-PGO Posts: 128 Ambassador

    I definitely use 2* the least...

    For me, it would be:

    1★ I feel the nomination doesn't meet any criteria, is completely unable to be located, or is otherwise ineligible.

    2★ I use this if I'm fairly sure it should be a 1, but I also feel that there is the very remote possibility that I'm simply not understanding the submission or the intent of the submitter.

    3★ Neutral. I can see how the submission could be acceptable if I squinted and turned my head sideways, but there are also some pretty major flaws such as having several non-criteria breaking issues with the title or description, a borderline acceptable photo, or a failure by the submitter to 100% convince me of the submission's "socialise, explore, or exercise" merit by providing enough clarification and context in their description and supporting information.

    I may also use 3 if I've run out of skips and I genuinely feel that I am unable to grasp the importance of a nomination due to a lack of local knowledge or cultural ignorance (mostly on upgraded submissions from far away or bonus location submissions.)

    4★ Acceptable, but maybe with a few quirks such as a few very small typos in the description, or there is a very slight possibility that I've misinterpreted something in the submission's favour.

    5★ Great. Good. Fantastic. Wonderful. I love it.

  • PlutoIsSad-PGOPlutoIsSad-PGO Posts: 188 ✭✭✭

    I don't think I've ever given all grades of the same rating in a review.


    Mostly 3* and 4* though I drop 2* on bare descriptions.

    2* for submissions I'm not sure of but don't want to waste a skip on.

    1* for obvious criteria issues and for restaurants etc that have no supporting info that makes them special.

    Safety usually gets a 5*

  • Roli112-PGORoli112-PGO Posts: 2,236 Ambassador

    Why 2* for stuff you aren't sure? 3* is supposed to be neutral, 2 is less than neutral.

  • TshirtAndTie-PGOTshirtAndTie-PGO Posts: 11 ✭✭

    1* - Stuff that is an obvious rejection, and for one of the reasons selectable

    2* - Stuff that ins't a flat out rejection, but isn't really poi-worthy. A local chinese restaurant that all they can say is it's a hidden gem

    3* - Eligible stuff probably, maybe, I don't really want to say yes or no but i'm out of skips

    4* - Eligible but nothing special. A playground that the title says "Playground" and description says "A Playground"

    5* - Eligible stuff that is awesome by itself or the reviewer has done a great job on the description to make it more than a 4*

  • Duiomar-PGODuiomar-PGO Posts: 458 ✭✭✭✭✭

    We are incentivized to only use the most extreme scores by the agreements system, there's no reward for a more nuanced review which doesn't help your side of the vote as much, even if it's more accurate.

  • Shilfiell-INGShilfiell-ING Posts: 1,559 Ambassador

    I reserve 5* for truly excellent, "wow I want to go see this immediately" candidates. I did find that too many overall 5* scores in the first field led to more captchas and cooldowns, which I rarely get for "yes this is a good valid candidate" 4* reviews. This is just my own personal experience and may not be true for others.

    I use 2* only occasionally - usually for "I really hate this candidate although it may be marginally acceptable at some level" reviews.

  • ArborAndyYT-PGOArborAndyYT-PGO Posts: 87 ✭✭

    1* if it's a mailbox, 5* obvious things but I'll still read through the nomination and 2-5* the grammar. I don't accept "playground....playground" kind of lazy. Or if you misspelled what's right undying of you I'll give the Autocuccumber the benefit of the doubt and 4*. Or for example, PERFECT POI, shittu description. I'll 5* then 1/2* the supporting info but proudly * the location. Obviously 3-5 If it is there or might be there if I'm giving a location 1 or 2 stars then I'm probably giving a whole nomination a one star because it's not there and doesn't exist. That's why I feel A lot of the time it's either a stop or it isn't so it's either 1 or 5 so I'm with everyone else here lol

  • Gazzas89-PGOGazzas89-PGO Posts: 2,619 ✭✭✭✭✭

    I usually 4 star rather than 5 star things as I've read that 4 star doesn't effect your rating as much. I still 5 star things thst i think are easy passes, like play parks, churches, that kind of stuff

  • ScaryS0ul-PGOScaryS0ul-PGO Posts: 162 ✭✭✭

    Does the 2/3/4 star count toward the agreement should the nomination get accepted or rejected?

  • Roli112-PGORoli112-PGO Posts: 2,236 Ambassador

    Yes, to what extend we don't know or are meant to know, but those who use the full spectrum to review don't have problems reaching agreements.

Sign In or Register to comment.