Reviewer Updates: October 2022

431 posts Thu, Oct 27, 2022 at 03:56 PM in Reviewer Discussions

Reviewers play an important role in the experience of our members and customers. In turn, you play a critical role in Topcoder’s mission of connecting members and customers to produce high-quality, timely outcomes.

The purpose of this note is to share an update to the Reviewer Selection process (how we assign Review opportunities to Review applicants). We are making this update to better align the Reviewer Selection process with our mission to produce high-quality, timely outcomes.

Effective immediately:

  • Reviewer selection will be based on applications received within the first 24 hours of posting

    • Goals: Support timeliness. Support the timezones of a global community.
  • Applicants will be selected based on fit & qualification. This includes relevant skill match and performance history (timeliness and quality of past reviews). This article provides an overview and some examples.

    • Goal: Support high-quality.
  • If 2 applicants are equally qualified, the assignment will go to the candidate who applied first.

    • Goal: Support timeliness.

Unless a data point clearly relates to your timeliness or work quality, it’s not a determining factor in your eligibility to get a Review assignment. Therefore please note that tenure, number of projects, and payment-related details are not considered selection criteria.

Lastly, thank you again for being a special part of what makes Topcoder. And we want to hear from you! Reply here with your feedback.

Does this mean all the work will go to just a few Reviewers?
Not necessarily. It means that the most qualified and most responsive members will receive the most assignments. It also means a member won’t be denied (or given) work assignments based on their activity level or workload.

What if a challenge launches when I’m sleeping?
Challenges launch at different times. On whole, this means certain time zones have advantages for certain challenges, based on when those challenges are launched. To balance this:

  • Applicants have 24 hours to apply and be considered for assignment
  • Assignments are decided first & primarily by applicant qualifications and performance history. Speed/time of application is a tie-breaker.

What if 1 person gets assigned all the Review opportunities and projects suffer because they have too much work?
High-quality comes first in our mission. Each assignment represents a commitment to perform high-quality, timely work. We will respond to poor quality and/or late work with individual members in accordance with Development Review Role & Responsibilities.

Thank you!

View: Threaded  |  Flat
Sign In or Register to comment.