Friday, November 17, 2017

Column: A better way to judge teachers


The most important determinant of educational quality is teacher quality. Yet, as a recent study of school principals' permissiveness in teacher evaluations and a cheating scandal in Atlanta show, this performance is difficult to measure.

The best way forward is to move the evaluation of teachers outside the schools entirely, with standardized tests administered by an independent agency. This would be supplemented by classroom assessments based on unobtrusive videotaping, also judged by outsiders, including teachers' representatives.

Researchers have long noted the power that teachers have over student test scores.

In an influential paper published in 2005, economists Steven Rivkin, Eric Hanushek and John Kain examined administrative data in Texas and found that 15 percent of the differences in students' math scores were explained by variations in teacher quality. The difference in test score gains between a teacher who is rated average and one who is better than 85 percent of educators generates the same improvement as dropping class size by 10.

My Harvard colleagues Raj Chetty and John Friedman, together with Jonah Rockoff, link school data with evidence on adult earnings and find that replacing a teacher "in the bottom 5 percent with an average teacher would increase the present value of students' lifetime income by more than $250,000."

One approach is to follow standard corporate practices, giving principals the power to decide which teachers are good or bad. Good managers should know which workers are more productive, and good principals should be able to assess their educators, taking into account the ephemeral elements that can influence a classroom. Economists Brian Jacob and Lars Lefgren have found that principals are quite good at identifying which teachers produce the highest test score gains.

But a recent New York Times article reminds us that you can't always trust principals to use the knowledge they possess. In Florida, Michigan and Tennessee, principals were called on to rate teachers and graded more than 97 percent of them as being effective or better. Now that's grade inflation.

Like college teachers who freely dispense A's to unworthy students, principals want to be popular and avoid the hassles inherent in telling people that their work is subpar. In corporations, managers know that their own promotions depend on firing the incompetent. Principals know no such thing, so they take the easy way out.

Just as colleges could fix grade inflation with a simple policy of assigning a grade distribution to each teacher, requiring a fixed number of A's, B's, C's and F's, principals could be similarly required to fire the bottom tenth of their teachers each year. I suspect that such a draconian policy would help American children, but good luck getting that one through the teachers' unions.

The standard alternative to relying on principal evaluations is to use student test-score gains. This approach also has limitations, and unions aren't fond of evaluating teachers this way.

Even the best teacher can get a bad class, yet teachers can be evaluated over long enough periods to smooth out the idiosyncrasies of particular student groups. Teaching to the test may not be ideal. Yet as long as the test is sufficiently broad, it will still measure student learning. Moreover, the Chetty-Friedman-Rockoff work confirms that teachers who raise test scores also raise adult earnings.

Test scores become valueless, however, if they reflect teacher cheating rather than student achievement. A few days ago, 35 Georgia educators were indicted in a scandal in which seven teachers were accused of raising students' scores by erasing wrong answers and making them right, according to the New York Times report.

Teacher cheating isn't an excuse to give up on standardized tests. It is a reason to administer them properly. If the United States is going to use standardized tests to evaluate teachers or schools, it should pay the extra price of using an external agency, such as the College Board.

The idea of outside evaluation also makes sense when it comes to assessing the more ephemeral aspects of teacher quality. One advantage of using outsiders, rather than principals, is that independent experts would be more insulated from the pressure to rate poor teachers as effective. Those outsiders could be held accountable if they routinely gave high marks to teachers who achieved limited test score gains.

A second advantage of this evaluation approach is that teachers themselves, including teachers' unions, can be brought into the process.

The old-fashioned way of doing this would be to have teams of outside monitors randomly visit classrooms. The modern version would be to have video monitors installed in classrooms, a step that Wyoming debated and dismissed in 2011. In theory, video monitoring has improved to the point where students as well as teachers could be regularly filmed, so that the degree of student engagement could be more accurately assessed.

The obvious downside of videotaping is the loss of privacy for teachers and students. I can sympathize with those concerns, because I don't typically videotape my lectures. As long as some externally administered evaluation complements the test score approach, I would happily give up the video camera idea — for now. The United States needs externally administered student tests and classroom visits. The best teachers must be paid more; poor instructors must be managed out.

Edward Glaeser is an economics professor at Harvard University and author of "Triumph of the City."

© 2013 Bloomberg News


Editorial: Good for Tampa council member Frank Reddick to appeal for community help to solve Seminole Heights killings

As the sole black member of the Tampa City Council, Frank Reddick was moved Thursday to make a special appeal for help in solving four recent murders in the racially mixed neighborhood of Southeast Seminole Heights. "I’m pleading to my brothers. You ...
Updated: 4 hours ago
Editorial: It’s time to renew community’s commitment to Tampa Theatre

Editorial: It’s time to renew community’s commitment to Tampa Theatre

New attention to downtown Tampa as a place to live, work and play is transforming the area at a dizzying pace. Credit goes to recent projects, both public and private, such as the Tampa River Walk, new residential towers, a University of South Florid...
Published: 11/17/17
Editorial: Rays opening offer on stadium sounds too low

Editorial: Rays opening offer on stadium sounds too low

The Rays definitely like Ybor City, and Ybor City seems to like the Rays. So what could possibly come between this match made in baseball stadium heaven? Hundreds (and hundreds and hundreds) of millions of dollars. Rays owner Stu Sternberg told Times...
Updated: 4 hours ago
Editorial: Wage hike for contractors’ labor misguided

Editorial: Wage hike for contractors’ labor misguided

St. Petersburg City Council members are poised to raise the minimum wage for contractors who do business with the city, a well-intended but misguided ordinance that should be reconsidered. The hourly minimum wage undoubtedly needs to rise — for every...
Published: 11/16/17

Editorial: Make workplaces welcoming, not just free of harassment

A federal trial began last week in the sex discrimination case that a former firefighter lodged against the city of Tampa. Tanja Vidovic describes a locker-room culture at Tampa Fire Rescue that created a two-tier system — one for men, another for wo...
Updated: 5 hours ago
Editorial: Firing a critic of his handling of the sewer crisis is a bad early step in Kriseman’s new term

Editorial: Firing a critic of his handling of the sewer crisis is a bad early step in Kriseman’s new term

Barely a week after St. Petersburg Mayor Rick Kriseman promised to unite the city following a bitter and divisive campaign, his administration has fired an employee who dared to criticize him. It seems Kriseman’s own mantra of "moving St. Pete forwar...
Published: 11/15/17
Updated: 11/16/17
Editorial: USF’s billion-dollar moment

Editorial: USF’s billion-dollar moment

The University of South Florida recently surpassed its $1 billion fundraising goal, continuing a current trend of exceeding expectations. At 61 years old — barely middle age among higher education institutions — USF has grown up quickly. It now boast...
Updated: 4 hours ago
Editorial: Vets should not have to wait years for benefits

Editorial: Vets should not have to wait years for benefits

American military members hurt in service to their country should not have to wait a lifetime for the benefits they deserve. But that’s a reality of the disability process at the U.S. Department of Veterans Affairs, which hasn’t made payi...
Published: 11/14/17

Editorial: Deputies’ rescue reflects best in law enforcement

The bravery two Hillsborough County sheriff’s deputies showed a week ago is a credit to them and reflects the professionalism of the office.Deputies Benjamin Thompson and Trent Migues responded at dusk Nov. 11 after 82-year-old Leona Evans of Webster...
Updated: 11 hours ago

Another voice: An untrustworthy deal with Russia

President Donald Trump’s latest defense of Russian leader Vladimir Putin included — along with a bow to his denials of meddling in the U.S. election — an appeal to pragmatism. "Having a good relationship with Russia is a good thing, not a bad thing,"...
Published: 11/13/17
Updated: 11/14/17