Showing posts with label high stakes tests. Show all posts
Showing posts with label high stakes tests. Show all posts

Monday, August 6, 2012

A Hill to Die On! by Tim Slekar

Original post found on The Chalk Face, HEREby Tim Slekar 8/6/12
The SOS convention was a great opportunity to see old friends and make some new ones.  A lot happened and I am not going to summarize the conference.  My intent is to portray what I believe is the single biggest issue facing public education that emerged and describe the only solution.

The WAR we are fighting (and it is a war) is against the mistaken belief that private interests would run public schools best.  And the weapon being used–very successfully– is punitive high stakes testing.  The tests and the “data” perpetuate the mythology of failing schools, failing teachers, and failing students.  This mythological mass failure has convinced our neighbors that “doing anything” is acceptable and even preferable as long as we “fix” failing schools.

However, “doing anything” only occurs because of the false narrative that is supported by data from high stakes tests.  The use of high stakes tests must end.
There is nothing to compromise on this issue–nothing!.  We know (and we better start helping our neighbors know) that the only thing high stakes tests tell us reliably and validly is the socio-economic condition of the test takers—that’s it.
Even if we cared about achievement (I don’t because I care about learning) the test scores provided by high stakes tests don’t tell us about achievement.  Therefore a massive “Opt Out” of high stakes testing must be used to destroy the entire reform movement!  We cannot negotiate some % of acceptable use of high stakes test data in calculating student achievement, teacher effectiveness, principal effectiveness, and school achievement.  There is NO acceptable use of high stakes test data–None!
Opting out and subverting any use of high stakes tests is the only solution.  This is war and this is a hill we must be willing to die on!
Follow Timothy D. Slekar on Twitter: www.twitter.com/slekar

Monday, February 6, 2012

Despite Focus on Data, Standards for Diploma May Still Lack Rigor


The next time people try to tell you how much the data-driven education reform programs of President George W. Bush (No Child Left Behind) and President Obama (Race to the Top) have raised academic standards in America, suggest that they take a look at the Jan. 24, 2012, New York State English Regents exam. (continue reading by clicking HERE.)

Thursday, February 2, 2012

Montgomery superintendent and Daniel Pink discuss new ways to motivate teachers, students in book talk

Montgomery County superintendent Joshua Starr said he is “disappointed” and “astounded” at the national direction of school reform and its emphasis on standardized testing, but that Maryland’s largest school system can pursue a “third way” to improve performance by focusing on what motivates teachers and students rather than how they perform on an annual test, said superintendent Joshua Starr during his second book talk

Since No Child Left Behind was signed into law in 2002, “we’ve come to know so much more about brain research...and about how kids learn and how adults learn...Yet we choose to have a 180 departure from it,” he said.
(Josh Starr hosts his second book talk with author Daniel Pink. Photo courtesy Montgomery County Public Schools)
“We have missed wonderful opportunities to redefine what American education should be in the 21st century,” he said.

To stir new ideas about what helps teachers and students invest in their work, Starr invited author Daniel Pink to Rockville on Tuesday night to discuss his best-selling book “Drive,” which draws upon 50 years of research on the science of motivation.

As a new superintendent in Montgomery County, Starr proposed a series of book talks to introduce his educational philosophy to the community. The 90-minute conversation was filmed in front of a studio audience and broadcast on local television. A second group of parents and teachers watched the live event from a Barnes & Noble in Bethesda.

Pink told viewers that the prevailing wisdom about motivation — namely, that rewarding a certain behavior encourages it while punishing a behavior discourages it — does not hold true in today’s businesses or schools.

Extrinsic motivators, such as financial incentives, helped speed up assembly lines during the industrial age. But they don’t work as well to encourage the creative thinking or sound judgment needed in the more complex jobs that characterize today’s economy.

Despite the national push for merit pay, boosting teachers salaries is not a surefire motivator, Pink said. The key is to pay teachers — or any employees — enough, so they do not feel unfairly paid, but beyond that, they need to find motivation from the work itself.

A better way to motivate people nowadays is to give them more autonomy to direct what they do and how they do it.

In some ways, public schools are difficult places to introduce flexibility and autonomy, since they have long compliance checklists of federal and state requirements.

But Donna Redmond Jones and a teacher from Rosa Parks Middle School in Olney joined the conversation to talk about how they implemented ideas from Pink’s book.
(A second group of parents and educators watched the webcast from Barnes & Noble in Bethesda.)
They said teachers can be given more freedom to decide how they want to structure lessons or planning time and staff meetings. And students can be given more choices of activities or different ways to respond to questions or take notes.

For more on the discussion, an archived version in available on-line.


Monday, January 30, 2012

How high stakes corrupt performance on tests, other indicators

By

This was written by Larry Cuban, a former high school social studies teacher (14 years, including seven at Cardozo and Roosevelt high schools in the District), district superintendent (seven years in Arlington, VA) and professor emeritus of education at Stanford University, where he has taught for 20 years. His latest book is “As Good As It Gets: What School Reform Brought to Austin.” A version of this post appeared onhis blog .

By Larry Cuban

Test scores are the coin of the educational realm in the United States.No Child Left Behind demands that scores be used to reward and punish districts, schools, and teachers for how well or poorly students score on state tests. In pursuit of federal dollars, the Obama administration’s Race to the Top competition has shoved state after state into legislating that teacher evaluations include student test scores as part of judging teacher effectiveness.

Numbers glued to high stakes consequences, however, corrupt performance. Since the mid-1970s, social scientists have documented the untoward results of attaching high stakes to quantitative indicators not only for education but also across numerous institutions. They have pointed out that those who implement policies using specific quantitative measures will change their practices to insure better numbers.

The work of social scientist Donald T. Campbell and others about the perverse outcomes of incentives was available and known to many but went ignored. In “ Assessing the Impact of Planned Social Change ,” Campbell wrote:

“The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor” (p. 49).

Campbell drew instances of distorted behavior when police officials used clearance rates in solving crimes, the Soviet Union set numerical goals for farming and industry, and when the U.S. military used “body counts” in Vietnam as evidence of winning the war.

That was 40-50 years ago. In the past decade, medical researchers have found similar patterns when health insurers and Medicare have used quantitative indicators to measure physician performance. For example, Medicare requires — as a quality measure — that doctors administer antibiotics to a pneumonia patient within six hours of arriving at the hospital.

As one physician said: “The trouble is that doctors often cannot diagnose pneumonia that quickly. You have to talk to and examine the patient and wait for blood tests, chest X-rays and so on.” So what happens is that “more and more antibiotics are being used in emergency rooms today, despite all-too-evident dangers like antibiotic-resistant bacteria and antibiotic-associated infections.”

He and other doctors also know that surgeons have been known to pick reasonably healthy patients for heart bypass operations and ignore elderly ones who have 3-5 chronic ailments to insure that results look good.

Here are some more examples:

TV stations charge for advertising on the basis of how many viewers they have during “sweep” months (November, February, May, and July). Nielsen company has boxes in 2 million homes (representative of the nation’s viewership) that register whether the TV is on and what families are watching during those months. They also have viewers fill out diaries. Nielsen assumes that what the station shows in those months represents programming for the entire year (see 2011-2012-Sweeps-Dates). Nope. What do TV networks and cable companies do during those “sweeps?” They program new shows, films, extravaganzas, and sports that will draw viewers so they can charge higher advertising rates. They game the system and corrupt the measure (see p. 80).

And, ripped from the headlines of the daily paper, online vendors secretly ask purchasers of their products to write reviews and rate it with five stars in exchange for a kickback of the price the customer paid. Another corrupted measure.

Of course, educational researchers also have documented the link between standardized test scores and narrowed instruction to prepare students for test items, instances of state policymakers fiddling with cut-off scores on tests, increased dropouts, and straight out cheating by a few administrators. (see Dan Koretz, “Measuring Up ”)

What Donald Campbell had said in 1976 about “highly corruptible indicators” applies not only in education but also to many different institutions.

So why do good policy makers use bad indicators?* The answer is that numbers are highly prized in the culture because they are easy to grasp and use in making decisions.The simpler the number — wins/losses, products sold, profits made, test scores — the easier to judge worth. When numbers have high stakes attached to them, they then become incentives (either as a carrot or a stick) to make the numbers look good. And that is where indicators turn bad as sour milk whose expiration date has long passed.

The best policymakers, not merely good ones, know that multiple measures for a worthy goal reduce the possibility of reporting false performance.

See: *Steven Glazerman and Liz Potamites, False Performance Gains: A Critique of Successive Cohort Indicators,” Working Paper, Mathematica Policy Research, December 2011, p. 13.