Tag: evaluation

142/365 Teachers Know What They’re Doing, and We Shouldn’t be Surprised

EdNews Colorado has this piece up today reporting on the results of the pilot of Colorado’s new teacher evaluation system. For those outside the state, CO’s legislature passed Senate Bill 10-191 which structured evaluations around professional practices for 50% and the other half based on student scores.

We could go ’round and ’round on the weight of scores. (And, I’m happy to do that.) What struck me about the article was a tone I’m sure we’ll be seeing as this new initiative and others like it across the country come online.

“More than nine out of 10 of Colorado teachers evaluated during a pilot test of the state’s educator effectiveness were rated proficient or higher on the system’s five-step rating scale,” the reporter Todd Engdahl writes.

What follows is a general tone of incredulity that this could be true. It includes a not so subtle subtext of “surely more of our teachers have to be crappier than that.”

This is worrisome.

Statistically, it’s perhaps improbable that the pilot study is fine-tuned enough to determine what the final product will show.

This, though, is more a conversation of expectations. We should be expecting our teachers to be proficient. We should expect their professional practices to show our teachers are qualified to be working with our children.

Each time we imply differently, we do harm to education. We lower the status of teaching. We send a message of lowered expectations to teachers in the classroom. And, we say to those considering becoming teachers that the bar is low and they probably couldn’t do any worse than what is expected of those already in the classroom.

Such a tone also keeps the focus on the wrong elements of the work of our schools. Instead of altering assessment so that it “reveals” more teachers to lack proficiency in their practices, perhaps we could agree that the majority of teachers have the proficiency we should expect and start looking to other factors – health care, poverty, hunger – as contributing to lower-than-hoped-for student achievement.

I’m not surprised by findings that show teachers to be capable of doing their jobs. Sadly, I’m not surprised by those who are dedicated to believing the opposite to be true.

83/365 Success Must be Defined by All

The setting is a familiar one. A teacher sits across the table from an administrator. Both have note taking devices in front of them. The teacher – a spiral notebook and a pen he found on the floor after his last class. The administrator – an iPad with stylus.

They begin their debrief of the lesson the administrator has just observed. She pulls up the lesson plan the teacher submitted the day before using the district-approved template.

“I noticed the learning objective wasn’t on the board,” the administrator begins after some small talk.

And we’re off to the races.

While several pieces of the above scenario are glaringly unsettling, the piece to be focused on is not even mentioned.

In the schools we need, the adults must be working from a common and co-created definition of success.

When our teacher and administrator and their real-life counterparts at schools across the country sit down to de-brief, they are not likely to have a conversation about what a successful lesson looks like in the eyes of each other.

As such, any debrief conversation is likely to sound much like each person talking about an element they saw as successful (or not) and the other responding by attempting to fit that element into their own definition or argue against its importance.

A favorite question to ask school and district leaders at the top of any school year is, “What are three things you would like to achieve in order to count your school or district as successful this year?”

For most, such a frank and open question is met with a long non-answer that ends with, “all children being successful.” If we’re really lucky, they’ll also throw in “lifelong learners.”

Learning spaces that engage in conversations about their definitions of success are doing more than setting goals, they are setting culture as well. As Harvard Graduate School of Education Professor Richard Elmore says, “Language is culture.”

By defining success together, administrators and teachers sidestep a language imbalance where discussions of teaching and learning are loaded with the language of administrators and result in teachers attempting to translate what they do into that language. Such unequal conversations are classroom-level instances of educational colonialism where the teachers are the colonized.

Instead, imagine a meeting at the close of a school year where all of the adults in the school sit together and are asked to write their responses to two questions:

  • Were we successful this year?
  • What makes you say that?

Two simple questions with the ability to uncover great swaths of unspoken cultural beliefs within the organization.

Move forward to the re-convening of the school the next Fall. Rather than standing in front of those assembled and speaking to them as though the year ahead and the people it will include are wholly separate from the previous school year, the principal returns to the questions with which the school concluded that last year.

“Here is how we defined success last year,” she says and distributes a listing of people’s anonymous responses grouped by similarities. “The question we must decide moving forward is, “How will we, as a learning organization, decide to define success this year?”

From there, the hard work begins of moving from a group of adults tacitly assuming they’re working toward the same measures of success to explicitly stating the standard toward which they will be working that year. Uncovering assumptions is a difficult and sometimes painful task. It may result in some teachers realizing their visions of success do not align with the goals of the school and thereby asking them if they are willing to re-align their definitions or asking if it is time for them to find another community better-synced with their beliefs.

The difference here is the co-creation of success and the ownership of all adults of the definition.

Returning to our teacher and administrator de-brief, imagine the conversation they are able to have and the language they will share as a result of their shared definition of success. Imagine the democracy of such a school.

Things I Know 362 of 365: Education bought a round of bad evaluations for the house

Nice! Compulsory feedback #fail

– Gary Stager

To register next semester, I (along with all other Harvard ED School students) were required to complete our Fall term course evaluations. One would imagine signing off on the student loan promissory note was enough to get the job done, but it turns out telling others how they did their job is one of those fine-print requirements.

I’m of a mixed mind about the process.

To not see the erosion of validity in mandatory course evaluations, I’d have to be blind.

Then again, my answers were truthful and honest, but I’d likely never have completed the evaluations if left to my own post-semester devices.

Realizing this puzzle, I’ve been trying to think of possible alternatives.

Evaluations for two of my classes were particularly frustrating because I’d been keeping a mental list all semester of comments and compliments about what worked and what didn’t. I’d been waiting for the chance to offer feedback. When the chance came, though, I couldn’t remember what I wanted to say. I remembered bits and pieces, but completing course work and getting assignments down on the page throughout the semester had taken precedence over keeping a running evaluative journal.

For another course, I wanted more than text boxes could provide. I wanted the chance to sit with the professor and say, “I know you’re brilliant. I know you understand more about this field than I can probably ever hope to understand. I’ve got a little game of my own when it comes to teaching. Maybe we could help each other out?”

I dig wordsmithing, but I just couldn’t find a way to put that sentiment judiciously in a course evaluation.

My thinking on course evaluations at any level runs parallel to my thinking on single-scoop standardized testing. The bulk of the work has been done, and the feedback is supposed to paint a picture of the learning and teaching as a whole. It just doesn’t work. Evaluations need not be mandated if they are meaningful to those on either end.

If students benefit from frequent and multi-faceted feedback, it stands to reason the same could be said of teachers.

It could be as simple as, “What would you keep, and what would you change from today’s lesson?” or “What are two things you would have done to make today’s class better?”

Not only would such thinking model a willingness for improvement, but taking the feedback seriously would likely improve the level of instruction in the class as well.

Few things are as lonely as those few moments after a class of students has walked out the door and a teacher is left in the vacuum between the lesson that has just concluded and the next lesson to be planned.