My biggest problem with the SPOT reviews is that they are only available for students who completed the course… which means those who drop the course for good reason never get the chance to say why. It introduces what could be a textbook example of survivor bias.
Say for example you have an interdisciplinary course meant to teach data analytics to statistics and CS majors, and the professor makes it so math heavy it is inaccessible to the CS folks who all drop out, then all the reviews will be almost exclusively from the stat majors, who will probably give it positive marks. The department will never know the difference, or why all the CS students keep dropping out.
The same could be said if the course has a weird schedule that conflicts with people from a certain college (the vet school is always out of sync with the rest of us), or in a much more nefarious case, if the professor created a hostile environment for a certain subset of students. Imagine if the professor makes sexist remarks, not enough to warrant a Title IX investigation but enough to drive away certain students – the only ones giving that professor a review will be the ones who were not offended and stayed in the class.
It seems to me that asking students why they dropped is even more valuable than asking for passing students to evaluate the course. Do they even keep track of the total number of students which drop a course?
_______________
Survivor Bias: –> http://www.smbc-comics.com/comic/path-of-a-hero