Doug Lemov's field notes

Reflections on teaching, literacy, coaching, and practice.

08.18.15About That Mirage: Responding to TNTP’s Report, Part II (Video)

Roberts Worrell

Juliana Worrell and Ashley Roberts: Teammates

Part 2:

Yesterday, I blogged about the important ‘Mirage’ report, in which TNTP, having done some of the best research on public schools (here and here, for example) studied teacher development and found, to its consternation, that massive investments yielded not only unconvincing results—significant improvement by just 3 out of 10 teachers across three large districts—but inscrutable ones. Nothing the districts they studied did reliably correlated to success.  Even in an outlier organization where 7 out of 10 teachers improved, the correlation to specific actions was all noise and no signal.

Deep in the report came what I think was the lede: the primary factor driving improvement within this successful organization was its culture of humility, openness to feedback, and its relentlessness about getting better. The organization was successful because it was constantly doing teacher development even when it wasn’t calling it that. PD was really just a name for the larger system in the schools where everything was designed to help teachers succeed. As it turns out, most PD happens when we don’t realize it’s PD.

Conveniently enough, this brings me to a video I’d like to share, which reveals a moment in the life of a school that embodies this kind of culture. The video features Juliana Worrell, the principal of North Star Alexander Street Elementary in Newark, NJ, a turnaround which recently became an Uncommon School, working with Ashley Roberts, a young and successful kindergarten teacher. Juliana is helping to develop Ashley with the same balance of warmth, support, caring, and tenacity about getting better that she runs the school with.

Practice.GRK.Roberts.Worrell.’Live coaching.’Clip2347 from Uncommon Schools on Vimeo.

In this remarkable clip, Ashley leads a reading group of kindergarteners, teaching them to decode, with a particular emphasis on suffixes. Soon after, they read a story together and discuss the idea of character perspective. She brings energy, positivity, and skill, and these are visible in her interactions with students. Juliana is sitting in on the lesson, not hiding in the back with a dour countenance taking notes; she sits  alongside the students, smiling and exuding positivity. She participates and gives Ashley feedback openly and warmly. Juliana’s methods of giving feedback are fascinating. At one point, she subtly points to a student who is not answering questions to suggest Ashley circle back to him; later, she whispers a suggestion for Ashley to try a Turn and Talk to build engagement and Ratio (see technique 43 in Teach Like a Champion 2.0). But for the most part, she offers suggestions by raising her hand at moments when Ashley’s momentum starts to ebb.  Her use of non-verbals grants Ashley some control—it’s up to her to signal back to Juliana that she’s ready for some feedback. And to the kids, it looks like Ms. Worrell is just joining in the lesson. In the same vein, Ashley is not at all defensive She too is smiling. Ashley knows she’s doing well, but that doesn’t keep her from wanting to do even better. She takes Juliana’s suggestions, tries them, and smiles back. At the end, Juliana whispers to Ashley that she’s done a nice job and that they’ll chat soon about the lesson. (Note: talking about what went well in a lesson is, in my mind, one of the fastest ways to help teachers replicate their successes.)

The techniques we see in this clip arereally good, but it’s the tone and the culture that’s especially striking. I could imagine a principal doing what appears to be the exact same thing—sitting in on a young teacher’s lesson and giving her real-time feedback, and having it be both non-productive and corrosive to the relationship.  But in the hands of a skilled leader like Juliana, we see a coaching session characterized by teamwork, warmth and openness. It is striking, and it demonstrates, I would argue, why it’s hard to see the bread crumbs tracing specific teacher development activities back to growth… because what’s important is the culture- both the part that’s evident here but also the culture within the school of “we’re out to get better” and “my feedback is designed to help you, but you know that without my telling you” and “I’ll watch you every week, and we’ll meet after to chat about your teaching” and “because you are good, we will strive together to get even better.”  The culture even has a language—a shared vocabulary of terms for what happens in the classroom, including but not limited to one like that in Teach Like a Champion—that is powerful in large part because it facilitates productive and efficient conversations about decisions in the classroom.

In my post yesterday, I tried to describe this way what’s powerful about this video: “Workshops don’t develop people, cultures do.”  And what I think we are seeing here is just such a culture. Juliana could use a totally different approach and still be successful: she could for example have a teacher who is a little more reticent to get real-time feedback; she might opt to do weekly video sessions instead where they watch game tape from a lesson and discuss; or they might review lesson plans before the teacher taught, refining and practicing them beforehand to ensure they went well. In such a case, it would be difficult to tie the success back to a specific action. A variety of development approaches work when the culture among the adults is right; the same methods probably don’t when it isn’t.

What we’re seeing in this video, I would argue, is what an organization that’s a positive outlier in teacher development looks like. In teacher development, the adult culture, is likely to be the signal that overwhelms the noise.

5 Responses to “About That Mirage: Responding to TNTP’s Report, Part II (Video)”

  1. Lauren
    August 19, 2015 at 1:33 am

    I coach teachers in a school with a PD culture similar to that of the high-performing school in the study, and I’ve been toying with the idea of live coaching. I work in a high school, however, and the idea that “to the kids, it looks like Ms. Worrell is just joining in the lesson” doesn’t seem to hold water like it does in an elementary school. I fear that a high school student’s perception of live coaching would erode a teacher’s authority in his/her classroom. Any thoughts to get me over this hang-up?

    • Doug Lemov
      August 19, 2015 at 1:19 pm

      Hi, Lauren. Great question. I think live coaching is generally harder with older students and the solutions many people come up with are, let’s say ‘not ideal’ (e.g. teacher wearing and ear piece… don’t want to judge but it’s hard for me to imagine teaching well with one of those in my ear). One thing that might work would be agreeing in advance to co-teach a class and playing a bit of copycat in which case we would agree that i will teach five minutes and model X thing my teacher is working on and then pass it over to the teacher to try it. Another might be agreeing to a super-subtle signal such as me standing in a certain place in the room, which i’d use if i’d like to jump in and model or make a suggestion, which i would do by asking the class a question that the teacher might have asked. when i stand there the teacher then can, if she’s comfortable with it, call on me, saying something like “Doug, do you have any thoughts here?” or “How would you describe the passage?” But she doesn’t have to. I think that’s important. I’d honestly expect most teachers in a good culture to say “yes” to support most of the time and if they aren’t i’d need ot examine why (perhaps my advice isn’t that helpful) but that sense of control over when and how the coach jumps in makes it much more manageable for teachers, i think. But the ideas is a very subtle cue that students wouldn’t see,agreed to in advance and the teacher is in charge enough to “accept” (and so also appears to the class to be fully in charge.) That said, you also might also decide that it’s hard to do live coaching in some settings and that 1) watching video together and asking the teacher to role play how she might do it differently or 2) previewing the lesson together might be more effective in those cases.

      • September 30, 2015 at 12:41 am

        Lauren – I hear you on the hang ups. I had some of them myself.

        I teach and coach in a 9-12 high school in New Orleans, LA. We tend not to do the kind of coaching at the 0:57 mark but often do the kinds of cues at the 1:57 mark.

        One piece of framing I found most helpful was from Jon Bogard – he directs coaching at my school’s network (Collegiate Academies). At the start of the coaching relationship, he says something to teachers along the lines of “in sports… coaches never wait until the end of the game to fix things they can do in live… we shouldn’t miss opportunities to make fixes in real time either.” That sentiment is at the core for why we do a ton of live coaching (we call it RTC or real time coaching).

        We’ll do some messaging with kids too. Coaches actually explicitly get in front of the room and talk through the metaphor as well (having kids make the connections themselves is a nice touch to push for). After that, kids tend to ignore it and the worries around dynamics move out of teachers and kids heads with haste.

        • Doug Lemov
          September 30, 2015 at 12:46 am

          Thanks, Evan! Fascinating details about how Collegiate makes it work!

  2. Brad DSST
    August 20, 2015 at 2:49 am

    Thanks for the reminder! School (and feedback) start tomorrow and it’s so crucial that we school leaders remember how crucial our adult learning culture is over the feedback itself.

Leave a Reply