Two questions Success at what exactly? Will my answer change the mind of anyone already biased for or against the test? As stated in yesterday’s entry in this marathon of blog posts on various aspects of testing and how they’ve intersected with my own personal history, I do NOT think the SAT matters as much […]
Tag: educational measurement
What Do the SATs Measure?
Twenty years ago today, I became something of a marked man. It was a Friday and I received a phone call anxiously awaited telling me that ETS was offering me its newly created position of Chief Learning Officer. I had gone over to the dark side of the people who made the SAT. Of course, […]
MailBox Monday # 2
Our mailbox is bustling this week and even better many of the comments come from dear friends whom I have known for over half a century. In fact, the photo above is from where Mark attended school — the Abigail Adams Schoolhouse — while growing up in Weymouth Massachusetts. We met at Manhattan College in […]
The Way To Bet or Predictive Validity Is Imperfect Too!
Yesterday’s post continued the theme of the lack of understanding of validity in both the design of tests at all levels and interpretation of their scores. In service of that argument, I quoted from a chapter by Emily Shaw in the book Measuring Success edited by Jack Buckley, Lynn Letukas, and Ben Wildavsky: “Decades of […]
Validity is an Imperfect Measurement
Some things bear repeating like this line from a November post on tbhis blog: “Validity is the “cardinal virtue in assessment” noted Bob and two other former colleagues Linda Steinberg, & Russell Almond, in 2003. ” There are some disagreements about validity among psychometricians; some think that the test should be tested for validity, not just its score. Harvey Goldstein articulates the protest well […]
Aiming for Validity
My gratitude swells for the generosity of Marianne Talbot who has commented on each of the January jolt posts thus far. But in an echo of my last post, it’s not just the quantity of her comments but the quality that matters as she offers insights and resources. In a recent comment, Marianne offered this […]
True Stories, Realities, and Illusions
Over the Christmas week as is our custom, my wife, Marjorie, and I watched several favorite movies. The winner for most viewed film during our more than four decades together has to be The Philadelphia Story even though the story itself contains elements that make us just a little bit more uncomfortable as each year […]
The failure to reconcile social learning with competitive testing schemes
Hard to believe that seven years have passed since Alina Von Davier and I with the expert assistance of Sue Borchardt created this brief animated video on collaborative assessment as part of the Pulling to the Edge series to accelerate innovation in educational measurement. Alina offers some glittering insights in this short film such as “We (educational measurement scientists) measure very very well what we […]
Two Stories of Failed Testing — And Teaching
Stories Day 2 is made much easier because two friends shared stories from their own personal histories of testing that allow me to riff off of them. First, my dear friend and former colleague, Vasu Murti related this example: Sharing my testing story while pursuing Bachelors in India vs. Masters in the US. Bachelors: 5-years Naval Architecure B.Tech program (Focus: ship design, construction […]
Claims matter the most for those deemed different
In the first days of this blog, Testing: A Personal History, a reader who is also a friend wrote me this reaction: “ I’ve really enjoyed your writing on testing. I’ve always hated tests, but I think its’s more an issue of what is done with those test results that informed my experience than the […]