A controversial statewide student survey is still on for this spring — but the state has switched its survey vendor.
The online survey will take place from April 2 through May 31, under a new plan endorsed by the State Board of Education Wednesday.
The student survey is part of Idaho’s long-awaited rewrite of its school accountability framework. That framework includes surveys of students, parents and staff. But as a piece of Idaho’s blueprint to comply with the federal Every Student Succeeds Act, Idaho will use student surveys to help identify low-performing schools.
The state will survey students on a variety of topics, such as school safety, learning climate and the relationships between students and teachers.
But like the survey itself, the choice of a vendor has proven to be contentious. In December, state superintendent Sherri Ybarra backed away from the plan to use the Panorama Student Survey, after some administrators said they believed the survey was biased.
Ybarra recommended switching to AdvancED, a survey vendor that already does some work in Idaho schools.
During Wednesday’s State Board meeting, Ybarra pitched AdvancED as a known quantity. “Idaho has a real trust issue sometimes.”
AdvancED also has experience with ESSA compliance. The vendor administered a similar survey in North Dakota in November, as part of that state’s ESSA plan, said Karlynn Laraway, Ybarra’s director of assessment and accountability.
It’s unclear whether the switch will affect the state’s bottom line, since it has no contract yet with AdvancED. The price tag for AdvancED’s survey is estimated at less than $20,000, Ybarra spokeswoman Allison Westfall said Wednesday. Previously, Laraway pegged the cost of the Panorama survey at less than $20,000.
Ybarra and fellow State Board members voted unanimously to switch vendors. But public comments on the switch were more mixed.
A look inside the debate
In advance of Wednesday’s meeting, the State Board released a 44-page packet that included public comments on the student survey and the vendor options. The comments depict a debate not only about the choice of vendor — but about the student survey itself. Here are some highlights:
The raw numbers. The State Department of Education held a webinar on the topic in January, and gathered feedback from 60 respondents. More than two-thirds of respondents favored the move to AdvancED.
Another problematic survey? But the Boise School District isn’t sold on SDE’s new preferred survey method — an AdvancED student engagement survey. In a series of emails, Boise School District administrators said the AdvancED survey is also biased against teachers, with Superintendent Don Coberly saying the survey could cause “as many or more problems than the Panorama survey.”
Mixed reviews from lawmakers. Three House Education Committee members were split on the options.
Rep. Ryan Kerby, a New Plymouth Republican and retired school superintendent, said the AdvancED survey should provide useful data to teachers. “If we as a state want to keep beating teachers up, Panorama is the answer.”
Rep. John McCrostie, a Garden City Democrat and music teacher, said the tone of the AdvancED survey came across as jaded, or overenthusiastic. “I question how honest students could be with this survey.”
Rep. Lance Clow, R-Twin Falls, said he was unimpressed with the AdvancED survey — but seemed more concerned with what will become of the data. “How will the information be used? Is it only for the teacher and principal?”
A ‘weaponized’ survey? The short answer to that question: The SDE has said it will publicly release district- and school-level survey data, and provide more detailed results to schools.
But some administrators said they were worried about the release of student survey data — especially from a survey they consider stacked against educators. Two singled out Idaho Education News directly.
“(The Panorama) survey is a disaster waiting to happen, especially if Idaho Ed News were to get the results of a negatively slanted survey,” said Nezperce district Superintendent Dennis Kachelmier.
Madison School District superintendent Geoffrey Thomas said survey results could be “weaponized” and used against educators.
“I can just read the Idaho Ed News headlines now: ‘Idaho children do not feel cared for by their teachers!’” Thomas wrote. “I would like to say I am being facetious, but I can almost promise that given past history, the survey data will be skewed and used against all of us in the court of public opinion.”