HotConf Home

Review ratings

PC members can anonymously rate one another’s reviews. We hope this feedback will help reviewers improve the quality of their reviews.

When rating a review, please consider its value for both the program committee and the authors. Helpful reviews are specific, clear, technically focused, and provide direction for the authors’ future work. The rating options are:

HotCRP reports aggregate ratings for each review. It does not report who gave the ratings, and it never shows review ratings to authors.

To find which of your reviews might need work, simply search for “rate:bad:me”. To find all reviews with positive ratings, search for “rate:good”. You may also search for reviews with specific ratings; for instance, search for “rate:short”.


Chairs set how ratings work on the review settings page.


A review’s ratings are visible to any unconflicted PC members who can see the review, but HotCRP tries to hide ratings from review authors if they could figure out who assigned the rating: if only one PC member could rate a review, then that PC member’s rating is hidden from the review author.