Webinar
Upcoming

The Grant Review Committee Has a Consistency Problem

See why identical proposals get different scores from different reviewers, and how to standardize scoring without losing their judgment

event
October 6, 2026
schedule
11:30 am

The Same Proposal Can Get Two Completely Different Scores. Here's Why.

See why identical proposals get scored differently by different reviewers — and how to standardize the process without losing reviewer judgment.

Hand the same grant proposal to five different reviewers, and you won't get five identical scores. You'll get five interpretations of the same rubric — shaped by what each reviewer personally weighs, how many applications they've already scored that day, and how strict "strong" versus "adequate" feels to them in the moment. Most committees assume a scorecard makes review objective. The research on grant peer review consistently says otherwise.

If your committee is heading into a new review cycle, onboarding new reviewers, or has already had a proposal that split the room under the same rubric, this is the window to fix how scoring works — before those scores are the ones a board or funder is asked to trust.

This session is for grant program managers, review committee chairs, and the staff who build and run evaluation forms — including anyone who's had to explain to a board why two qualified reviewers landed on opposite conclusions for the same application. Can't make it live? Register anyway and we'll send you the full recording. Want to talk through your committee's specific scoring setup first? Reach out and we'll set up time to walk through it directly.

What You'll Learn

  • Why the same proposal can land two completely different scores under the same rubric, with real examples of where that disagreement comes from
  • How to build evaluation forms and scoring criteria that guide a reviewer's judgment instead of asking them to simply check a box
  • How to use weighted criteria and structured workflows to standardize scoring without eliminating the expertise your reviewers actually bring
  • How to surface outlier scores — unusually high or unusually low — automatically, so they get a second look before a decision is final
  • How to use AI-assisted summaries as additional context for a reviewer's own read of an application, never as the evaluator making the call
  • How to keep an organized, complete record of every evaluation, comment, score, and decision in one place instead of scattered spreadsheets and email threads

A scorecard doesn't make review consistent by itself. The process behind it does.