What are We Supposed to Do With Student Evals Anyway?

This post is not to exalt evaluations as the pinnacle of student assessment. First, the hunt for great evaluations sped on by grade inflation and student pressure for good grades can negotiate a tacit contract between instructors and students-a kind of quid pro quo agreement. Second, response rates are notoriously low on student evaluations and often the two types of students who complete evaluations are those most & least satisfied with our ourses. This leads to a Janus-faced discourse that is unhelpful to instructors. Third, student evaluations are always already burdened by systems of patriarchy and racism and exist to support systems of white, male, heterosexual privilege. For example, see this excellent annotated bibliography on Gender and Student Evaluations. The race, gender, and age of the instructor prejudices student perceptions of instructors before they ever begin to teach.

Moreover, even beyond these factors, subject expertise does not always translate to expert teaching. Meaning that the most qualified person to deliver content to students is not always the best at that task–so we should not assume that poor evaluations automatically assumes that learning is not occurring. Also, to some degree, evaluations are a test of the affective response lingering by students towards the instructor, instructors who may come off as misanthropes at times, may be great in the classroom and are not perceived that way by students.

Feel free to skip the breakdown below and jump to the tips on reading evals at the very end.

Watching my inbox, twitter, & Facebook feeds it seems it is student evaluations time now that the semester has come to a close. Student evaluations make for tricky reading for instructors because they are documents that can have some weight on current and/or future promotion, retention, or job prospects. Also, no matter how much we urge and desire student feedback during our classes, many students use evaluations, for a variety of reasons, rather than talking to instructors directly about their experiences in a class.

I know many of my peers and myself, especially those of us early in our careers, are eager to see student feedback for a number of reasons. Because of that urge, I want to explore the usefulness of qualitative student feedback on course evaluations.

First, we want to know about major flaws in our course design. This is a genuine desire: was a unit particularly unhelpful? Was a unit too easy? Was an assignment particularly unclear? Grade data can help provide this information, but the evidence is particularly damming when it corresponds to student feedback.

Second, teaching is a deeply performative art. Students often provide feedback on our personality. This can be painful to read. We learn the good and the bad. It was in course evals that I learned I like to make a fist and pound on the white board when I get fired up about a topic. It is also here, that we can learn that we are communicating things to our students we never intended. For example, from time to time students will report on my course evaluations that I am intimidating, arrogant, or difficult to approach. I struggle with this description, not because I lack the capacity to be arrogant, intimidating, and difficult to approach, but because I work hard in the classroom to craft a persona the is open and approachable–even begging students to visit me during office hours if they have questions, or by lingering after class to speak with students and arriving early to chat informally with students. Moreover, I know this is a performative issue because the students I develop deeper relationships with describe me in much different terms.

Third, evaluations are these bizarre blind exercises. There is this deep temptation to try and figure out who said what about you. Sometimes you have a sense about which student said what by their tone and writing style, particularly if the semester demanded you attend to their writing in detail. This may be the most consumptive and least useful part of reading student evaluations. When I was a young boy I heard a story about my grandfather; who was a minister in a Presbyterian church in Florida. Each year the congregation would take an anonymous vote to retain or dismiss him. Each year the vote would be something like 68-2. For the rest of the year my grandfather would relentlessly obsess over who the two people were that sought to cast him away. I wonder with some irony, if we engage in those same exercises. It is as if we tell ourselves: If I can correlate the negative comments with students who performed poorly, perhaps I can excuse their force. Even though that means we may be dismissing a very important correlation, a student’s poor experience and their poor outcome may be crucially related.

How, then, do we use qualitative feedback on student evaluations?

First, the feedback will be personal, but don’t take it that way. One semester is a snapshot in your career and teaching is an act of becoming. It is a work in progress, not a reflection on who you will always be.

Second, no comment in isolation merits significant change, but every comment can, and perhaps should, generate reflection. If one student says assignment expectations were unclear, then perhaps they were to them. If four or five evaluations say that, it may be time to revisit that assignment’s description. Especially if those comments correlates with the class’ average score on that assignment.

Third, even when statements correlate, that does not mean that that you need to take action. I have four years of student evaluations that suggest that the reading material in my classes at the University of Utah is too difficult (not every eval says this, but about six students per class will say this). I recognize that many of the readings I assign push at my students. However, I have yet to find a case where the difficulty of the readings was the cause of a lack of student success. Does that make my class hard? Yes. Demanding? Yes. Will I ease up on my syllabi? No. In this case I recognize the triangulation on evaluations, but see the educational merit in reading difficult, but applicable, material for the educational opportunities it offers. Moreover, I have not chosen the material just to be difficult, it simply happens that when you deal with complex and abstract ideas you need complex and abstract readings. In essence, even when students routinely object, if you have taken a principled stand, don’t let evaluations pressure you into backing down. I have recently started sharing some of the thoughts on difficult readings & reading difficult theory collected by Robert W. Gehl with my classes and I saw less of those comments this last semester, you can find his thoughts here.

Please share your thoughts on course evals, as a student, instructor, or interested/apathetic party below or with me via twitter @acaguy

Advertisements

5 Comments

Filed under Cultural Studies, Feminisms, Grad School, Teaching

5 responses to “What are We Supposed to Do With Student Evals Anyway?

  1. James Bunker

    Teaching evaluation comments to ignore:

    1. Difficult readings
    2. The class is to hard, demanding, or ease up a little on a gen ed.
    3. Less Group Work
    4. Grading is subjective

    1-3 mean that you are challenging your students and doing your job
    4. All grading is subjective and this comment is usually left by someone who
    did not score well or do the assignment according to teacher
    expectations.

    • Number four is a really important point. I think we should, and I do, often remind my students that no amount of multiple choice questions or scantrons make an exam less subjective. It is all smoke and mirrors.

      • James Bunker

        No way around this. You design the test, essay, or exam and set out your individual expectations for that assignment. You grade according to your own expectations and this will differ from other instructor expectations and perhaps the students as well. Students either live up to your expectations or they do not and their final grade will reflect that. Granted, you were correct in your original post that if students across the board score relatively low something is wrong with the structure of the test, essay, or explanations of expectations, which is valid and the instructor should take steps to correct this. What I find repeatedly, at least in terms of my own grading is that it is fairly consistent with the bell curve. Some students do extremely well others, others do above average, many are average, and some are below average and occassionly I fail someone (although I find that they fail themselves it has nothing to do with me). In terms, of negative teaching evaluations there is a relatively high level of coorelations between poor grades and negative individual comments. Yes, it is blind but realistically instructors can determine to a student or two who most likely wrote a certain comment based on performance in class.

      • I agree with your comments, my suggestion about reassessment was if students are complaining and the average grade is a low C or D that’s evidence some work may need to be done to be more clear about expectations. What I would not do it just make it easier.

        For example, on my final papers in both classes this semester my course averages were 78.8% with two very different curves and two very different assignments (a 4-6 page media critique and a 9-11 page argumentative position paper). Clarity helps get to that average.

  2. James Bunker

    Good point. What I find myself doing is to set high expectatations in the beginning of the semester and score harshly on the first assignment. The first assignment is also weighted less than subsequent assignments. Therefore, receving a “C” does not prevent a student from receving an overall grade of an “A”. As they get used to my expectations I do two things: 1. increase the weight of the assignment; and 2. find that I do not have to grade as harshly. I actually let up quite a bit as students are responding to the expectations that I set and their scores on the first assignment. It’s a win-win in my book. The student puts in more work and usually demonstrates a better product and by default the work I have to put into grading decreases dramatically because the student is aware and responding to your demonstrated expectations. But, expectations need to be demonstrated to students in written form in terms of your expecations for the class and assignment as well demonstrated grading with clear indication of what needs to be done to receive a higher grade in the next assignment. I also tell my students I’m less concerned about their grades than they are. I teach a lof of practical classes so I’m much more interested in them taking away the knowledge or skill that will aid them in the future even it means getting a poor grade. Poor grades can often lead to invaluable lessons (not necessarily a valuable impression of the teacher).

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s