Tag Archive for 'merit pay'

Alter’s Ego

A suggestion by Claus Von Zastrow of Public School Insights that pundits like Jonathan Alter who write about education be subject to performance pay attracted the notice of Alter, who has been mixing it up with commenters to the post.  It started when Von Zastrow took issue with Alter’s KIPP cheerleading and broad brush take on reform.

What do we make of Alter’s suggestion that only charter schools and merit pay are “real reform?” Well what about better staff development? Better curriculum? Stronger ties between schools and communities? Much, much better assessments? Are those phony reforms?  All in all, Alter gets an unsatisfactory rating, so no performance bonus this year. In fact, his failure to improve since last summer puts him at risk of termination.

That was apparently too much for the Newsweek pundit, who showed up on the blog’s comments to defend himself and do a little advocacy work.  ”With the president’s support, the pool of reformers is growing,” Alter wrote.  “Come on in, guys. The water’s warm.” 

Alter gets points for showing up and opening himself up for further abuse.  The highlight of the thread so far: One anonymous wit who wickedly applies Alter’s take on merit pay to his own columns:

I’m glad you’ve accepted Claus’ merit pay proposal. The formula is clear. Since your job is to inform the public, we’re going to measure your readers’ knowledge. Then, a year from now, we’re going to measure it again. If they’re smarter, you’ll get a substantial bonus. If not, we’ll put you on a 90-day plan of review, support, and, if your readers don’t get smarter, we’ll have to regretfully let you go. Sorry, but it’s all about the readers, not the writers.

Tough crowd.

Moving the Chains

Football fans see it time and again:  It’s 4th down and short yardage.  An official standing 30 or 40 feet away from the play sees a running back hurl himself full throttle into a forest of 300-pound linemen and disappear beneath a collapsing pile of players, a football buried somewhere against his body.   Chaos everywhere, yet the official, with unquestioned authority places the ball he lost sight of on the exact spot on the ground where forward momentum stopped and calls for the chains.  Play stops and the fans grow quiet as a team of officials runs in from the sidelines and takes a precise-to-the-inch measurement of the ball’s location.  If the any part of the ball is beyond the plane of the outstretched chain, a first down is awarded.  The crowd goes wild. 

FIRST DOWN by MIKECNY.

Never mind that the linesman is merely estimating the ball’s position.  Never mind that the ten-yard length of chain was placed based on an eyeball approximation of where the series of downs began three plays ago.  Never mind that every play in the series of downs begins and ends with a best guess (the wide receiver was knocked out of bounds at about the 35-yard line) When it’s time to determine whether or not a first down is to be awarded, football is suddenly a game of inches

Games, playoff hopes, bowl bids and careers turn on a guess–or a series of guesses.  But no one seems to question it.  Call for the chains!  If you stop and think about it, this doesn’t make a lot of sense.  The answer however is simple: Don’t think about it.

Here are a few more things not to think about:

  • Writing in the New York Times, Todd Farley, the author of the book “Making the Grades: My Misadventures in the Standardized Testing Industry” describes getting a part-time, $8 an hour job scoring fourth-grade, state-wide reading comprehension tests after a five-minute interview.  “Arbitrary decision is the rule, not the exception,” he writes.  
  • “Bowen Elementary was part of what [Washington, DC] officials hailed as the success story of their 2008 standardized test results,” reports the Washington Post.  “But Bowen also had four classrooms where children erased wrong answers and replaced them with correct ones at abnormally high rates.”  The paper reports there were elevated numbers of erasures at six schools involving classrooms with 573 students.  CTB McGraw-Hill declared the data “inconclusive,” and no teachers or administrators have been accused of wrongdoing, the Post reports.  
  • In New York State seventh graders who answered just 44 percent of questions correctly on the state math test were given a passing grade. “Three years ago, the threshold for passing was 60 percent,” the New York Times reports. “In fact, students in every grade this year could slide by with fewer correct answers on the math test than in 2006.”
  • Teacher Diana Senechal recently described an experiment in which she was able to “pass” several standardized tests just by guessing and without even looking at the tests. 
  • “Policy makers define good education as higher test scores,” writes Diane Ravitch. “But students can get higher scores in reading and mathematics yet remain completely ignorant of science, the arts, civics, history, literature and foreign languages.” 

We know this.  We see it all around us, but like the football fan caught up in the arbitrary kabuki dance of the moving of the chains, we accept it, applaud it or moan about lousy spots, but the game goes on. 

“There must be a better way,” Pat Summerall, an N.F.L. veteran and broadcaster said in a recent New York Times article. “Because games are decided, careers are decided, on those measurements.”  He was talking about measuring for first downs.  “There’s a certain amount of drama that is involved with the chains,” said New York Giants president, John Mara in the same article. “Yes, it is subject to human error, just like anything else is. But I think it’s one of the traditions that we have in the game, and I don’t think any of us have felt a real compelling need to make a change.”

“With national standards will come national standardized tests, so it’s an especially good time to rethink how these exams are scored, and by whom,” Dana Goldstein sensibly observes at The American Prospect’s Tapped blog.  “Perhaps teachers and principals should be scoring tests, not $8 an hour part-timers. In that case it would be important, especially with the push for merit pay, to make sure teachers aren’t grading their own students’ tests, to decrease the temptation to engage in foul play.”

Like the theatrical measurement of a first down in football, we want to rely on precise measurements of an imprecise process to make high stakes decisions on everything from federal funding to merit pay to whether a teacher keeps his or her job at all.  “I understand that tests are far from perfect and that it is unfair to reduce the complex, nuanced work of teaching to a simple multiple choice exam,” Education Secretary Arne Duncan recently observed. 

Right.  It’s way more complicated than that. 

But it’s 4th down!  Call for the chains!  Take a measurement.  How else are we going to know?

“An Unavoidable Element of Subjectivity”

Schools need much more than merit pay to recruit and retain good teachers, argues Kevin Carey at the Quick and the Ed.  “They need strong leadership, good facilities, safe working conditions, and the right kind of organizational culture,” he writes. “You can’t paper over the lack of those things by simply tacking on a salary bonus, even a big one, to the existing steps-and-lanes pay scale.”

Carey’s reasoned (and reasonable) take on merit pay feels like a welcome departure from the teacher-quality-and-test-scores über alles refrain more commonly sung by accountability hawks.  Especially in his recognition that “we need to build schools great people want to teach in, and that means fully recognizing their value in all ways, including pay.”

The great schools of the future will be professional meritocracies in a way today’s public schools are not, but not by adding test scores to the mechanistic logic of an industrial-age salary scale. Rather, they’ll spend a great deal of energy on getting the conditions and culture right, and then negotiate substantially higher and substantially more variable salaries with individual teachers. It will be an expensive, time-consuming, imperfect process with an unavoidable element of subjectivity. It will also be much, much better than what most schools use today.

Agreed.  I’d also wager there isn’t one teacher in a thousand who wouldn’t welcome merit pay in a school that spent “a great deal of energy on getting the conditions and culture right.” 

The phrase “unavoidable element of subjectivity” also strikes me as a recognition of the infinite complexity teachers face in working with our most disadvantaged students (any attempt to move past mindless “teachers fear accountability” sloganeering is a welcome development).  Guest-blogging over at Joanne Jacobs, the always insightful Diana Senechal captures the dilemma of nuance-averse accountability well.  “With dumbed-down tests, vapid literacy programs, an overwhelming focus on test prep at the exclusion of essential subjects, and unreliable rating systems, we end up taking a yardstick to a void–and declaring miracles whenever we please,” she wrote.  The flip side of that — the thing that teachers reasonably fear — is that it is too easy to declare failure whenver we please, and hold teachers solely responsible when they are too often reduced to foot soldiers with no control over what or even how they teach. 

This cannot be said often enough: teachers are not by nature accountability-averse.  They are, however, sensibly averse to having an extraordinarily difficult and complex task measured by crude and simplistic tools.

Update:  John Thompson, a vocal teacher advocate who also viewed Carey’s post favorably, takes up a similar theme at This Week in Education.  “I’ve never understood why ‘reformers,’ who are angered by the terrible results of policies set by principals and central offices, respond by attacking teachers who do not set those policies. But the answer, which the New Teacher Center makes clear, is not to attack principals but to use ‘contextual data’ to enhance teacher and principal quality and create a learning culture which attracts and retains educators.”

Nineteen Points and One Very Bad Idea

Near the end of World War I, President Woodrow Wilson sought to reassure Americans that what was known at the time as “The Great War” was a just cause.  In a speech to Congress, he outlined America’s war aims in “Fourteen Points” that were as broad as insuring freedom of navigation on international waters and fair trade, and as specific as redrawing the borders of several European nations and restoring their pre-war populations.  French Prime Minister Georges Clemenceau, in one of history’s finer bon mots, quipped, “Fourteen points?  Why, God Almighty has only Ten!” 

Secretary of Education Arne Duncan goes Wilson one better.  Five, actually.  He has Nineteen Points.  God has fallen nine back, well off the pace.

According to detailed guidelines being released today in Washington, states that hope for a piece of the $4.35 billion Race to the Top Fund will have to abide by 19 detailed criteria on academic standards, data-tracking, teacher recruitment and retention, and turning around low-performing schools.  “You can’t pick or choose here,” Duncan tells USA Today.

EdWeek’s Michele McNeil notes the guidelines “send a strong message that any state hoping to land a grant must allow student test scores to be used in decisions about teacher compensation and evaluation.”  While opposition to that will be summarily dismissed as the product of accountability-averse teachers unions, Dan Willingham has cogently described why this particular reform is not ready for prime time.  Still, states like New York and California, which currently forbid by law using test data to evalute teachers will not be eligible for Race to the Top funds, as McNeil points out:

Being able to link teacher and student data is “absolutely fundamental—it’s a building block,” U.S. Secretary of Education Arne Duncan said in an interview. “We believe great teachers matter tremendously. When you’re reluctant or scared to make that link, you do a grave disservice to the teaching profession and to our nation’s children.”

To be sure, there is much to like about this Ed Reform Early Christmas, and the sense of urgency is welcome and laudable.  But let’s be clear, No Child Left Behind, however well-intentioned, did little to advance the idea that children benefit from a robust, well-rounded curriculum.  It did much to advance the idea that children must be taught whatever might appear on a year-end test. If time was limited, anything that did not contribute to this near-term payoff was jettisoned. Thus, aggressive accountability measures actively worked against the patient, steady development of background knowledge that creates both well-educated children and, ultimately, higher test-scores.  It beggars credulity to think that using data to hold individual teachers directly responsible for student gains will result in a sudden outbreak of big picture thinking in classrooms across the country. 

The idea that reading comprehension is a function of background knowledge has not taken deep hold in America’s classrooms.  And what teacher — especially the new, young and relatively inexperienced teachers who disproportionately fill struggling urban schools — will have the wherewithal to insist on the steady buildup of knowledge across the curriculum?  Indeed, if we are to have 19 points, why not round up to 20 and insist that a Race to the Top cannot happen without attending to a well-rounded curriculum?   Instead we are almost certain to have more — much more — of the deleterious effects of our data-driven, muscular accountability age:  endless focus on reading strategies that have limited impact, mind-numbing test prep, and no attention to the essential long-range development of background knowledge that will make reading gains possible years down the road.

“Language comprehension is a slow-growing plant,” observes E.D. Hirsch.  “Even with a coherent curriculum, the buildup of knowledge and vocabulary is a gradual, multiyear process that occurs at an almost imperceptible rate. The results show up later.” 

This is clear, this is obvious, and this is certain.  But there is simply no room for this kind of thinking in an accountability system that insists –for every good reason under the Sun–on results right now and encourages individual teachers to compete instead of cooperate.

Fast-forward.  It is 2016.  After a years of holding teachers accountable for short-term gains, and creating incentives that actively work against the buildup of knowledge, with disappointing results, we wake up and realize we are going about this the wrong way.  A few look back and say we should have listened to our Cassandras.  But other energetic, well-meaning  reformers see it another way.  Instead of realizing we have fatally neglected a robust curriculum, that we are reaping what we have sown, they will conclude that as a nation we simply have no good 8th grade reading teachers.  Aggressive, immediate action is needed.

Because after all, the data doesn’t lie, does it?

Six Reasons Merit Pay is Unfair

President Obama loves merit pay.  So does Arne Duncan.  Editorial writers from coast to coast support the idea proposed by Gov. Arnold Schwarzenegger  that “teacher employment be tied to performance, not to just showing up.”  Dan Willingham wanders into the fray with his latest video, “Merit Pay, Teacher Pay and Value-Added Measures,” and offers six reasons why “value added measures sound fair, but they are not.”

<a href="http://youtube.com/watch?v=uONqxysWEk8">http://youtube.com/watch?v=uONqxysWEk8</a>

The political winds certainly seem to be very much at the back of merit pay plans.  Months or years hence, there may be a temptation to describe the “unintended consequences” of such plans.  Call them unintended, but not unanticipated.

Coming Soon to a Screen Near You

“In a world where ed reformers think merit pay is the key to improving student outcomes…”

The summer’s biggest blockbuster?  Dan Willingham is about to give his patented YouTube treatment to the issue of performance pay for teachers. Tongues will wag. 

While you wait for that, check out Dan’s latest over at Britannica Blog, which takes up the question of whether ”common sense” can be taught.  The short answer:  “To some extent, yes,” he says.  Because of the complexity of human thought and how we face unfamiliar problems and situtations, smart people will do dumb things.  “But with sufficient practice, people can come to recognize the types of errors the reflective mind makes, and learn to avoid them,” Willingham notes.

Cassandra Warns the Trojans About Merit Pay

If you remember your Greek mythology, you’ll recall Cassandra, tragically blessed with the gift of prophecy but cursed by Apollo so that no one would believe her.  Think of her while reading Diane Ravitch’s latest over at Bridging Differences

Here is my prediction: Merit pay of the kind I have described will not make education better, even if scores go up next year or the year after. Instead, it will make education worse, not only because some of the “gains” will be based on cheating and gaming the system, but because they will be obtained by scanting attention to history, geography, civics, the arts, science, literature, foreign languages, and all the other studies that are needed to develop smarter individuals, better citizens, and people who are prepared for the knowledge-based economy of the 21st Century. Nor will it identify better teachers; instead, it will reward those who use their time for low-level test preparation.

“Is it possible to have an education system that mis-educates students while raising their test scores?” Ravitch asks. ”Yes, I think it is. We may soon prove it.”

Cassandra is speaking.  Are you listening? Do you believe her? 

I do.

Incentivize Everyone!

The normally mild-mannered Joanne Jacobs goes off on a former Oregon teacher, principal and superintendent, who writes in a letter to the New York Times that President Obama, if he’s serious about about improving education, should “lose the words ‘achievement’ and ‘rigor,’ which have no connection to the inquisitiveness, determination, creative thinking and perseverance students need for genuine lifelong learning.” 

No connection? I remain dubious about the idea that those who’ve learned little in school will become “lifelong learners” at some happy day in the future.  As for “inquisitiveness, determination, creative thinking and perseverance,” those traits usually lead to achievement in the here and now without the necessity of waiting till winged pigs are ice-skating in hell.  I don’t even think that “achievement” and “rigor” foreclose the possibility of “creative thinking.” Not unless “creative” is a synonym for “wrong” and “thinking” means “making a poster.”

Amen to all that.  Click through to the letter in the Times and the writer’s main point (if you can ignore the nonsense about rigor and achievement) actually proposes a provocative idea.

If the federal government wants to reward school success, it should split those rewards among all those who have contributed: parents; the whole school faculty, including the principal; and the students themselves. The government might also reward the community that gave its schools financial and moral support.

Each of these ideas is fraught with baggage and “moral hazard” but each has its champions: New York City has piloted a program to offer cash incentives for things like attending their child’s parent teacher conferences, for example.  Roland Fryer and others have promoted pay-for-grades schemes.  Merit pay plans are legion.  I remain skeptical about all of them for various reasons. But I’m equally skeptical about treating teachers as the only moving part in the incentive equation.   If you believe that cash incentives matter, it would be an interesting thought exercise to think through what a Total Incentive Plan might look like.

Obama to Lay Out Education Plan Today

President Obama goes to the United States Hispanic Chamber of Commerce in Washington today to outline how his administration plans to improve education from “cradle to career,” Reuters reports quoting officials familiar with the President’s planned speech.

They said he would challenge U.S. states to adopt more rigorous standards of education, especially in reading and math. He would also explain how he plans to reward good teachers, redesign federal aid programs for students, and turn around underperforming schools.  Obama will note the large gap between the best and worst performing states with respect to reading and math, the administration officials said in a briefing.

The Wall Street Journal reports Obama’s merit pay proposal “would significantly expand a federal program that increases pay for high-performing teachers to an additional 150 school districts.” The President will also call for more charter schools and challenge states to lift limits on the number in operation, the paper says.

There’s No “I” In Value Added

If teachers are evaluated and rewarded on the performance of their individual students, what incentive do they have to be good team players?  Why prize the overall performance of their students and school over how kids perform in the teachers’ own class?  This essential question was brilliantly posed by Matthew Ladner at Jay Greene’s blog last week.

The impetus for the question was a New York Times magazine piece by Michael Lewis on Shane Battier of the Houston Rockets, who is “widely regarded inside the N.B.A. as, at best, a replaceable cog in a machine driven by superstars,” according to Lewis. ”And yet every team he has ever played on has acquired some magical ability to win.”

In basketball, gaudy personal statistics earn you megabucks and create incentives to pad you stats regardless of whether it helps your team win.  Battier, however, is a white space employee.  “The term refers to the space between boxes on an organizational chart,” Ladner explains. ”A white space employee is someone who does whatever it takes to achieve organizational goals and makes the organization work much better as a whole.”  What does this have to do with teaching?  Plenty. 

As we move into the era of value-added analysis for teacher merit pay, this article provides much food for thought. School leaders must consider carefully what they will reward, and give some consideration to how white space behavior is rewarded. Rewards should not just be based on individual learning gains- reaching school wide goals should also be strongly rewarded. Otherwise my incentive as a math teacher will be to assign six hours of math homework a night- and to hell with everyone else (see Iverson, Allen).

“There’s no reward for being a white space player OR a superstar in the current system of teacher compensation,” Ladner concludes. “Just an old player.”  The unintended consequences have been the undoing of many a school reform effort.  If Ladner’s right about this — and I think he is — the consequences may be unintended, but they will not have been unforeseen.