Review Scoring?

[katiesquilts]

Until a reviewer gets to the highest levels, a review must be edited and scored by two different editors. The overall score you receive for a review is not an average; it is the lower of the two editors' scores. I am not sure if both editors' comments are shown for each review. I think the comments are randomly picked for display. That might explain why you might see comments that are very complimentary with a lower score.

It's not an average?? That doesn't make very much sense to me. If you're not going to average the scores, what's the point of having multiple people grade the review?
Hmm... I wonder what the purpose of only using the lowest score is?

I assume you didn't mean me when you wrote, "If you're not going to average the scores." I was just passing along what was explained to me at the time. It would be better to discuss these issues with Scott directly.

Of course I didn't mean "you" directly! It was a general and broad "you."
I highly doubt Scott is interested in reviewing the editing system. It seems he has many other things he is busy with, despite how many questions are raised on the same issues. I also think it's natural that people want to see "behind the scenes" of what the editors are doing, especially since it's such a highly regarded position on the site!

In any case, thank you for answering my questions to the best of your abilities!

[bookowlie]

Actually, I think Scott has always listened to feedback about all aspects of the site, and often makes changes based on members' suggestions. That's one of the things that makes this site special. From what I remember, I think the reason for the lower of the two scores (instead of an average) is that sometimes one editor will catch a mistake or omission that another editor overlooked. However, I can certainly understand the benefit of using an average since some people can be a little stricter vs. others.

[MrsCatInTheHat]

Actually, I think Scott has always listened to feedback about all aspects of the site, and often makes changes based on members' suggestions. That's one of the things that makes this site special.

I would concur with you on this, I do think Scott listens to feedback and incorporates it into changes when it makes sense.