About

The Way To Bet or Predictive Validity Is Imperfect Too!

Yesterday’s post continued the theme of the lack of understanding of validity in both the design of tests at all levels and interpretation of their scores. In service of that argument, I quoted from a chapter by Emily Shaw in the book Measuring Success edited by Jack Buckley, Lynn Letukas, and Ben Wildavsky: “Decades of […]

Mailbox Monday: Our Faithful Correspondents Communicate

Double digits now! This is the tenth post of the thirty-one promised January Jolts for Testing: A Personal History. For new readers — and if LinkedIn stats are valid — we have many of those — here is an explanation for why this blog exists: Having been thrust accidentally into the world of testing 20 […]

Validity is an Imperfect Measurement

Some things bear repeating like this line from a November post on tbhis blog: “Validity is the “cardinal virtue in assessment” noted Bob and two other former colleagues Linda Steinberg, & Russell Almond, in 2003. ” There are some disagreements about validity among psychometricians; some think that the test should be tested for validity, not just its score. Harvey Goldstein articulates the protest well […]

The failure to reconcile social learning with competitive testing schemes

Hard to believe that seven years have passed since Alina Von Davier and I with the expert assistance of Sue Borchardt created this brief animated video on  collaborative assessment as part of the Pulling to the Edge series to accelerate innovation in educational measurement. Alina offers some glittering insights in this short film such as “We (educational measurement scientists) measure very very well what we […]

Two Stories of Failed Testing — And Teaching

Stories  Day 2 is made much easier because two friends shared stories from their own personal histories of testing that allow me to riff off of them. First, my dear friend and former colleague, Vasu Murti related this example:  Sharing my testing story while pursuing Bachelors in India vs. Masters in the US.  Bachelors: 5-years Naval Architecure B.Tech program (Focus: ship design, construction […]