Learning in the Unknown with “Plan-Do-Study-Act”
Turning unexpected obstacles into improvement opportunities. How STRIVE Prep is using the PDSA structure to improve co-teaching observations in the virtual classroom this Fall.
Launched in January 2020, the Charter Students with Disabilities Pilot Community Initiative supports a networked improvement community (NIC) of 10 charter management organizations (CMOs) aiming to improve outcomes for their students with disabilities.
Race and class have a compounding effect on students in special education that creates an experience gap between these students and their peers. This is why the initiative prioritizes CMOs serving a high proportion of students who are Black, Latinx, or experiencing poverty. In honor of the final week of Learning Disabilities Awareness Month, this series spotlights early improvement stories from the field, in partnership with technical assistance provider Marshall Street Initiatives. The pilot community’s goal is to systematically improve the way we serve students with disabilities and bring these solutions back to school systems everywhere.
DENVER, Colo. — When instructional plans switched from in-person to fully online as STRIVE Preparatory Schools prepared to go back-to-school, Krystle Menduke, a Special Education Manager and STRIVE Prep’s Improvement Lead, faced some tough questions about how to proceed with co-teaching in the Fall. How do you improve co-teaching practices using an observation rubric? What might co-teaching look like in the virtual setting? How might the network adapt its co-teaching observation rubric for the virtual setting?
To answer these questions, Krystle and the Improvement Team refocused their learning efforts on co-observations in the virtual setting.
In early August, Krystle and the General Education Director led network-wide training for Special Educators. They honed in on models of co-teaching to improve the remote learning experience for students with disabilities. Following the professional development (PD) session, Krystle conducted classroom visits to observe co-taught virtual classrooms in action. In these virtual classrooms, Krystle conducted a learning cycle, using the Plan-Do-Study-Act (PDSA) structure of improvement science to guide the learning and inform next steps for observations.
Step 1: Plan
Define the objective. Create questions and predictions. Plan who, what, where, and when.
During the planning phase, Krystle tested out the rubric in the online observations. She planned which classrooms to observe, when it would happen and how long to stay. Questions she had about the test included:
- Do I need to stay for an entire block?
- Can I access all student materials in a virtual class? If not, do I need to plan in advance and request them?
- If stations or breakout rooms are used, can I observe more than one group?
Then it was time to jump in.
Step 2: Do
Carry out the plan. Document problems and expected observations.
With the PDSA team aligned on goals, predictions, and process, Krystle joined virtual classrooms in the second week of school. During this phase, she ran into a series of unexpected but valuable learnings, which she documented for further analysis.
Step 3: Study
Complete the analysis and summarize learnings.
Among her co-teaching observations in the first go, Krystle noted the following:
- Feedback given to individual students over private chat on Zoom were not viewable to the co-teaching observer.
- Access to instructional materials was not instantaneous over Zoom. Compared to the physical setting, in which walking into a classroom allows the observer to peer over a student’s shoulder or observe the whiteboard, advanced coordination was required for virtual observations.
- When teachers send students into breakout rooms, the observer did not have the ability to go in and out of breakout rooms — unless they were given co-host access in advance.
Put simply, co-teaching observations were vastly different in the virtual classroom.
Step 4: Act
What changes must be made for the next cycle to be improved?
Realizing that their rubric would not be able to capture everything happening in the class via Zoom and that further testing would be needed, the team decided to adapt the test and begin again. Krystle pushed forward with the second cycle with a plan to coordinate with teachers to conduct pre- and post-observation check-ins. In these check-ins, she prepared questions for teachers, asked for co-host permission to observe student groupings, and requested advance access of instructional materials.
…and Repeat!
After implementing the first test of change, Krystle began seeing improvement in classroom observations. She shares:
“What I thought I would see is not what I actually saw. There’s a need to work with teachers before and after class, which is not as simple as in-person. After being in a lot of classrooms, I’m seeing progress every week: from week 1 to week 2 to week 3.”
Now in the third PDSA cycle, Krystle plans to incorporate teacher voices into the learning process, gradually expanding outward. Down the line, the team aims to build improvement capacity at all levels of STRIVE Prep. From administrators at the network level to Special Education and content coaches at the site level, inclusion lives at the heart of STRIVE’s improvement work.
Already, the Improvement Team’s focus on co-observations with network and site leaders is having a visible impact on STRIVE Prep’s co-teaching practice. As a result of conducting observations in the virtual setting for the first time, educators are “mirroring” what students might experience in a co-teaching model-by going through the same virtual experience as both learners and coaches. As a result, empathy is created for everyone.
Krystle states:
“I received an appreciation from Kam [General Education Director of STEM] for the focus on co-teaching and co-observations and how it is making a difference in classrooms.
In years past there wasn’t a regular cadence of scheduled co-observations between departments and he looks forward to doing this scheduled co-observation every month. Following our observation for September, we added an additional round of co-observations because we felt four weeks was too long in between seeing the feedback we provided in action.”
— Or might we say, an ‘observable’ impact! ■
Improvement advisor Paula Espinoza led the reporting of this story. Daria Zhao writes from Marshall Street Initiatives, a K-12 solutions lab that tackles persistent challenges in American public education. Learn more about Marshall Street’s work in continuous improvement at marshall.org
Originally published by the Bill & Melinda Gates Foundation K-12 Blog at http://k12education.gatesfoundation.org on October 29, 2020.
