The same CPA scholarship application can receive two very different scores depending solely on which reviewer evaluates it — and it should not. In this recorded session, Reviewr examines why this happens and what is required to correct it, organized around the two components of the process that must work in tandem: the application experience and the evaluation process that follows it.
The session begins with an overview of Reviewr's history: founded approximately 15 years ago by individuals who had served on the applicant and juror sides of application management, and who observed the same inconsistencies from multiple perspectives across the thousands of scholarship, grant, and award programs Reviewr now supports.
The session then addresses the core problem directly. Without a shared rubric and clear guidance on how reviewers are expected to evaluate a submission, the same application can be scored differently for reasons unrelated to its merit. With no other standard to rely on, reviewers default to the single figure already present on the transcript — the GPA — and a lengthy, non-intuitive form without mobile support or saved progress causes strong applicants to abandon the process before completing it. For most CPA scholarship programs today, a score depends on which reviewer is assigned, how much context that reviewer happens to have, how heavily the GPA is weighted, and whatever standard feels appropriate to that individual on a given day — a standard that can vary from reviewer to reviewer, and even from day to day for the same reviewer. What should determine the score instead is a rubric anchored to the foundation's mission and applied consistently every time.
The Application Process covers three components designed to keep strong applicants engaged through completion:
The session also addresses how a program's structure carries forward year to year. Rather than rebuilding a PDF or Google Form from scratch each cycle, or leaving an outdated form unchanged, Reviewr allows a program to copy its event forward in its entirety, retaining every submission, configuration, and automation as the foundation for the next cycle, with updates made only where necessary.
The Evaluation Process — arguably the most consequential part of the program, as it determines who ultimately receives funding — covers three additional components:
This webinar also reviews capabilities newly available in Reviewr and relevant to evaluating at scale: AI-generated summaries that provide every reviewer with a consistent starting point and a baseline score for comparison — useful when triaging a large applicant pool, though the final decision remains with the reviewer — and assignment tools that distribute applications across a review committee automatically, whether every reviewer evaluates every application, reviewers are organized into groups, or assignments are randomized so that each application receives a set number of reviews.
The session concludes with a direct comparison of the two approaches. Where a long-form application without mobile support causes strong applicants to abandon the process, and questions any capable student could answer without revealing meaningful information, Reviewr instead provides a mobile-friendly form built around what a foundation values — leadership, commitment, and potential assessed alongside academic performance — supported by evaluation criteria anchored to the foundation's mission and consistent, guided scoring across every reviewer. The central conclusion: the same application should not be able to receive two different scores depending on who reviews it. Consistent, mission-anchored scoring ensures that an applicant's outcome reflects what was written, not who happened to review it.
The session closes with a walkthrough of the Reviewr platform: the applicant experience, from account creation and autofill through the scholarship matching and eligibility tool for programs administering multiple scholarships within a single cycle, file uploads, and the letter-of-recommendation process, in which references are invited directly into the system to submit their letters and may rank an applicant against the program's stated priorities rather than relying on writing quality alone, to reduce advantage based on a reference's writing ability. The walkthrough also covers the review portal in full: the complete submission form and evaluation form displayed side by side, personally identifying information redacted upon request to support blind review, and range-based scorecards with context provided for every score, so reviewers can substantiate the reasoning behind each evaluation.
The all-in-one platform for managing scholarships, grants and awards programs.
