2022 Data: How long does it take for things you've reviewed to reach a decision?
Hosette-ING
Posts: 3,470 ✭✭✭✭✭
In the middle of 2020 I decided to do an experiment to see how long it took for the things I reviewed to reach a decision. In order to do this I reviewed a ton and then quit reviewing cold turkey. Every day I recorded the stats that were shown in my profile on Wayfarer-- Total Nominations Reviewed, Accepted, Rejected, and Duplicated. Since there's no way to know how many of my reviews are still pending a decision I decided that my stopping point would be 30 days without a new agreement-- that wouldn't be a perfect answer but it would give me a pretty good feel for how long almost all reviews took to resolve.
I found this so interesting that I did it again in 2021 and you can follow that link to get data and graphs. I didn't start it on purpose, but I did it a third time in 2022. Here's what I learned in 2020 and 2021:
- In 2020, 50% of my reviews resolved by around two weeks. In 2021, 50% of my reviews resolved by around four weeks.
- In 2020, 90% of my reviews resolved by around four weeks. In 2021, 90% of my reviews resolved by around ten weeks.
- In 2020, nearly all of my agreements resolved within 39 days. In 2021, nearly all of my agreements resolved within 120 days.
So what did I learn in 2022? Well, the fastest stuff is better than 2021, roughly in the same range as 2020. The 90th percentile were much faster than 2021 but not quite as fast as 2020. The long tail is worse now than it was in either of the past two years.
- In 2022, 50% of my reviews resolved in 13 days.
- In 2022, 90% of my reviews resolved in 37 days.
- In 2022, nearly all of my reviews resolved in 133 days.
Here's a graph for 2022. You can see 2021 and 2020 graphs in the previous post.
Comments
Neat and it confirms my own suspicion that there are more no-brainer rejections that go quickly then acceptances.
As part of your data report it would be nice to see a graph that total your total agreements and broke it down by percentage in the 3 categories.
eyeballing, it looks like 60%ish rejection 30% acceptance 10% duplication but early on the percentage of rejection looks higher
Thanks for this I always start with good intentions to do this sort of thing but lack the discipline, and I need the upgrades 🙄
@Cowyn2016-PGO Oh! Thank you for the reminder. Here's a link to the raw data for this: https://docs.google.com/spreadsheets/d/1Bo7JehxTKsm-UmFbfVTo6vPyyCAG-5q_lyjPX8YGmSc/edit?usp=sharing
You're welcome to copy it and play with it. The previous post linked above has links to the 2021 and 2020 spreadsheets.