Why Personal Statements in Academic Admissions Are (Mostly) a Waste of Time

Altus Assessments
Jul 24, 2017 · 3 min read

Posted: July 24, 2017

It’s one of the biggest challenges of academic admissions: how can admissions departments form a holistic assessment of a candidate, one that takes both academic performance and personal characteristics into consideration?

Unlike academic performance, for which there are statistically reliable predictors for future academic success, personal characteristics are difficult to assess. The most commonly used measurements are unreliable and inconsistently measured. We’ve previously covered reference letters, so let’s now examine the personal statement.

For decades, academic institutions have been asking applicants to submit personal statements, autobiographical sketches, personal essays and letters of intent, many of them weighing these submissions heavily in the admission decision. But the practice is largely unstructured and varies from institution to institution, and program to program. Some admissions departments set out to measure an applicant’s motivation and their goals for the future, while others seek to understand a student’s past experiences in effort to measure skills useful in the future. Some are looking for criteria to pair an applicant with an advisor. These inconsistent goals yield inconsistent information from applicants.

Because the kind of information collected through personal statements varies, there is a limited amount of data on their psychometric strength [1]. Being a single sample, personal statements have a low reliability and are a measure of maximal, not typical, performance. Research demonstrates that personal statements don’t even strongly correlate with applicants’ writing abilities [2]. While some applicants might go so far as to have them written by third parties, almost all applicants have friends and family help them edit and construct these statements.

A review study of personal statements conducted by Murphy et al. [3] found that personal statements did not have any strong correlations with other personal and professional predictors, including verbal ability tests, quantitative ability tests, prior grade point average, letters of recommendation, and interviews. The strongest correlation found was with letters of recommendation (r = 0.42), which themselves have no strong research to support their effectiveness (see our blog post: “Do Reference Letters Still Have a Place in Academic Admissions?“).

The conclusion of the study suggested that personal statements do not provide unique information to contribute to the prediction of an applicant’s academic performance, and that there is not enough research available on their scoring and validity. A similar conclusion was drawn by another study [4] focused on medical school admissions; it found that while personal and professional characteristics are important for the field of medicine, personal statements are not a useful way to identify and assess them.

Personal statements require energy and time to write, and energy and time for the program to assess. Yet they provide very little useful information for admissions departments. Fortunately, standardized and reliable measures of personal and professional characteristics requiring little admissions department effort (e.g. Situational Judgement Tests like CASPer®), are becoming more widely available.


References

[1] McManus, I. C C., S. Maitlis, and P. Richards. (1989). Short-listing in medical student selection. Medical Education. 2323: 147–151.

[2] Powers, D. E E., and M. E E. Fowles. (1996). The personal statement as an indicator of writing skill: A cautionary note. GRE Board Research Rep. №93–2626; ETS Research Rep. №95–4343. Princeton: Educational Testing Service.

[3] Murphy, S. C., Klieger, D. M., Borneman, M. J., & Kuncel, N. R. (2009). The predictive power of personal statements in admissions: A meta-analysis and cautionary tale. College and University, 84(4), 83.

[4] Ferguson, E., Sanders, A., O’Hehir, F., & James, D. (2000). Predictive validity of personal statements and the role of the five‐factor model of personality in relation to medical training. Journal of Occupational and Organizational Psychology, 73(3), 321–344.

Altus Assessments

Written by

We help academic programs select better students by robustly measuring for personal characteristics through the CASPer test. https://altusassessments.com

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade