Make us your home page
Instagram

Today’s top headlines delivered to you daily.

(View our Privacy Policy)

Despite fixes, computer testing troubles still likely for Florida schools in 2016

Failed log-ins. Frozen screens. Server crashes. Service denials.

Students, teachers and administrators recall all too well the woes that plagued Florida's most ambitious attempt at computerized testing last spring. As this year's testing season approaches, they're working to avoid a repeat.

"We'll have a first glimpse of whether or not the issues have been resolved" when Florida Standards Assessments in writing begin Feb. 29, said Gisela Feild, research and assessment director Miami-Dade schools. "We hope we won't see the same problems again."

The Florida Department of Education, its testing vendor American Institutes for Research, along with districts and schools, have taken several steps to prevent such troubles. Those include expanding bandwidth, upgrading defenses against outside attacks and improving testing software.

Even with such moves, though, the department warned that students still might encounter interruptions beyond their control. And that, said FairTest public education director Bob Schaeffer, could hurt some children.

Imagine the impact when the screen goes blank for a seventh-grader taking a civics test required to get out of middle school, Schaeffer said. "For an emotional adolescent to experience that, it's a scary situation."

Yet there's almost no way to guarantee trouble-free computerized testing on a stage as large as Florida's, experts said.

That's because the undertaking is "not just a test, but a massive technology project" that involves so many moving parts in a decentralized system, said Doug Levin, founder of EdTech Strategies, a consulting firm.

The tests originate at the vendor's servers, move over the Internet through district providers, and enter schools with varying levels of networks, hardware and infrastructure.

"Some of the devices are going to be quite old. Some of the school networks won't be as strong," said Levin, who helped develop the nation's first education technology plan in 1996. "Inherently, it is a somewhat challenging endeavor."

No test is foolproof, whether on computers or paper, noted Marianne Perie, director of the University of Kansas Center for Educational Testing and Evaluation.

"The same year that we were hit by a cyber attack, UPS also lost a batch of Scantron answer sheets off the back of their truck," Perie said. "They were returned to us torn, dirty, soaked in motor oil and covered in tire tracks. We had to throw several dozen out because they were unreadable, and had to rebubble hundreds of others to get them to go through the machine."

Paper tests also can be more susceptible to cheating, more expensive to administer and less nuanced in depth, said Greg Cizek, a testing expert at the University of North Carolina. Still, many Florida educators have called for a return to paper and No. 2 pencil as a less time-consuming and less glitch-ridden way to check student knowledge.

They have yet to see the value in moving to computers, which were sold as a way to make testing go more smoothly and deliver results more quickly. Neither has happened in Florida.

"At present, there is just no way to get around the problems, the way technology currently is and the way schools are equipped to handle technology," Cizek said.

Florida has experienced interruptions since it first introduced computerized testing to a handful of students retaking the FCAT a decade ago. Regardless of which vendor, test or system was used, the state has seen servers crash, providers implement unsupported changes, even construction crews accidentally cut cables to schools.

And Florida is not alone.

Earlier this month, Tennessee canceled its computerized testing after one day amid major testing platform outages across the state. It is now sending all schools paper tests instead, at its vendor's expense.

"Despite the many improvements to the system in recent months, we lost confidence in the system's ability to perform consistently," said Tennessee Department of Education spokeswoman Chandler Hopper.

Indiana, Minnesota, Virginia and Montana are among several states that had computer testing interruptions in the past year.

"The fact that this has happened so often in Florida and around the country should be a wake-up call to policymakers to go slow on computerized testing and have backups available," Schaeffer said. "Be prepared would be our warning."

The state and districts are trying to prepare.

Florida Department of Education spokeswoman Meghan Collins provided a list of actions the state has taken to prevent problems. It improved its testing servers to combat cyber attacks, developed a system to warn students before a large amount of text is deleted, and enabled students to restore past versions of their responses.

"This is not an exhaustive list of improvements," Collins said via email. "But we hope that it does serve as a reassurance that we take very seriously the concerns expressed last year."

The state's testing vendor, AIR, declined to comment.

Local school officials were quick to note many of the problems students experienced last spring were not caused by districts. Still, they've made improvements where they can.

Pasco County added about 1,000 computers into schools for instruction and testing. That should allow the district to shorten its testing window, testing supervisor Mark Butler said.

The district upgraded networks and equipment, also installing a more advanced defensive service to fend off outside attacks.

Pinellas County schools expanded bandwidth for testing, while increasing its number of computers. Hillsborough County created a special log-in for each school to get into the testing platform, to work around the access troubles they had a year ago.

Miami-Dade, the state's largest school district, will do things like shut down access to YouTube and other sites that tax a school's Internet flow. It has enhanced its filters and alerts to outside attacks so it can move its testing data and, in many instances, avoid slowdowns too.

The district is considering whether to allow more wireless mobile devices for testing, added director of student assessment Sally Shay. She said the district's key concern remains maxing out the testing window, even with 105,000 machines and 180 technicians in the field to tackle issues as they arise.

Cizek, the UNC testing professor, said computerized assessments offered the promise of something better — certain types of questions that can't be delivered on paper, savings in time and money, exams adapted to students' abilities.

One of the reasons it hasn't fully delivered, he said, is because states focused on computerizing tests before they fully integrated technology into instruction. Had they done it the other way around, he added, they would have built up capacity to handle tests while students became accustomed to using the machines for academics.

"They were rushed into the marketplace based on political and ideological agendas, and not academic need and technological readiness," said Schaeffer of FairTest.

Given the history, district officials expected the debut of Florida's new system to hit bumps. But 2015 was "over and beyond anything we could have expected," Shay said.

Feild, the Miami-Dade testing director, said she hoped AIR and others learned enough to at least avoid the same troubles. She wouldn't rule out new ones.

"Hopefully it will be something different," she said, "preferably not something too severe."

Contact Jeffrey S. Solochek at [email protected] or (813) 909-4614. Follow @JeffSolochek.

Testing troubles

Florida is one of several states to experience computerized testing problems over the years. The state's experiences included server outages in 2011 and downed test hosting providers in 2014. In spring 2015, the issues included:

Mid February: Superintendents from across the state send letters to the Florida Department of Education saying their districts weren't ready to give the Florida Standards Assessments online.

March 2: Thirty-six districts report troubles accessing online tests on the first day of the FSA writing portion.

March 5-6: Students across Florida experience blank screens as they test, while others cannot log in. The FDOE blames an outside cyber attack, called a Denial of Service.

April 20: Students struggle to log in to their language arts and math tests. The state's testing vendor, American Institutes for Research, admits making unauthorized technical changes to the system over the weekend. Several districts cancel testing for the day.



Despite fixes, computer testing troubles still likely for Florida schools in 2016 02/19/16 [Last modified: Saturday, February 20, 2016 7:35pm]
Photo reprints | Article reprints

© 2017 Tampa Bay Times

    

Join the discussion: Click to view comments, add yours

Loading...
  1. Tampa heading into several tough budget years

    Local Government

    TAMPA — Less pain now, more pain later.

    The Tampa City Council will hold a final public hearing on the proposed 2018 city budget and property tax rate at 5 p.m. Thursday on the third floor of Old City Hall, 315 E Kennedy Blvd.
  2. The Daystarter: Rick vs. Rick 2.0 tonight; Bucs' McCoy says some fans cross line; Trump associate to testify; helicopter crashes onto Odessa roof

    News

    Catching you up on overnight happenings, and what you need to know today.

     

    Rescuers respond to a crash of a small helicopter on the roof of a home in the Odessa area on Monday. [Hillsborough County Fire Rescue]
  3. No toll lanes north of downtown Tampa in three of four interstate proposals

    Transportation

    TAMPA — Express lanes may not be coming to downtown Tampa after all. Or at least not to the stretch of Interstate 275 that goes north through Bearss Avenue.

    Seminole Heights resident Kimberly Overman discusses the new interstate options with V.M. Ybor resident Chris Vela (left), Hillsborough County Commissioner Pat Kemp and HNTB consultant Chloe Coney during a Tampa Bay Express meeting Monday night at the Barrymore Hotel. [CAITLIN JOHNSTON  |  Times]
  4. Trump associate Roger Stone to talk to House panel in Russia probe

    Nation

    WASHINGTON — The House intelligence panel will interview two of President Donald Trump's associates behind closed doors this week as congressional committees step up their investigations into Russian meddling in the 2016 election.

    Roger Stone talks to reporters outside a courtroom in New York this past March. The House intelligence panel will interview Stone behind closed doors Tuesday as congressional committees step up their investigations into Russian meddling in the 2016 election. Fformer Trump staffer Boris Epshteyn also will talk to the House panel. [Associated Press]
  5. Pinellas commission set to discuss next budget, licensing board

    Local Government

    CLEARWATER –– The Pinellas County Commission will be busy on Tuesday.