A year ago, we published theβ―Great Teaching Toolkit: Evidence Reviewβ―(GTT:ER).β―The year since thenβ―has been extraordinary in many ways, manyβ―of themβ―negative.β―However,β―one very positive and exciting thing that hasβ―been quietly happening this year here at EBE is the developmentβ―of the tools and courses that will compriseβ―the first part ofβ―the wider Great Teaching Toolkit. The response we have had so far fromβ―theβ―schools who are working with us β and the results we are beginning to see β make it hard not to feelβ―the anticipation. In this blog, we explore the developments since the Evidence Review, and whatβs next for the Great Teaching Toolkit. You can also find the companion audio interview by scrolling to the bottom of this post, or by searching “The Evidence Based Education Podcast” in your podcast app of choice.Β
In the GTT:ER, we summarised the evidence about what makes a difference to studentsβ outcomes: the things that teachers do,Β knowΒ or believe. The Review identified 17Β suchΒ βElementsβ of Great Teaching, which we grouped into four broadΒ Dimensions. They areΒ all linked by robust evidenceΒ showing that,Β in classrooms where these Elements (the skills, knowledge, beliefs, behaviours and habits of the teacher) are present, students learn more.β―β―Β
We presented our framework as a curriculum for teacher learning: the set of things that teachers should be trying to get better at. We tried to make it clear that this does not imply that theβ―richΒ andβ―wonderfulβ―complexity of great teaching can be reduced to a list of techniques. But,Β as with any curriculum that leads to mastery of a complex domain, breaking down the steps is a necessary part of helping people to learn it.Β Β
Nor, just to be clear, is there any suggestion that the status quo represents any kind of deficit. There is Great Teaching happening in pretty much every school in the land, every single day. Our children are truly lucky to have such a dedicated, skilled, professional bunch of teachers as show up every day to make a difference to their lives.Β That said,Β education and social justice are such powerful forces for empowerment and life outcomes: with the stakes this high, every teacherβ―owes it to those childrenβ―to be the best they can possibly be.β―Related to this,β―my definition of a Great Teacher isΒ one who is willing to do what it takes to beβ―demonstrably more effective next year than this: it is not about how good you are today, but the journey you are onβ―and the commitment toβ―relentless improvement.β―Β
We made the case that a focus on everyday classroom teaching β great teaching, in every lesson, from every teacher, everyΒ day β is our most powerful lever for driving improvement at system-wide level. The top priority for all school leaders and teachers should be to enhance the quality of the teaching and learning interactions that happen in their classrooms every day.β―In an educational setting, nothing else matters asΒ much as this;β―nothing else will make as much difference to the outcomes and equity of the children and young people we serve.β―Β
Β
What have we done since Juneβ―2020?
The Evidence Review provided some hints about the wider Great Teaching Toolkit projectβ―and our plans forβ―its development. One yearΒ on, what have we done and how has our thinking changed?β―Β
First and foremost, we spent a lot of timeβ―researchingΒ andβ―talking to teachers about the barriersβ―and opportunities aroundβ―professionalβ―learning, andΒ inβ―promoting and maintaining everyday Great Teaching.β―Through this process, we identifiedβ―threeβ―key challenges:β―Β
- What to work on?Β It is difficult for teachers and school leaders to determineβ―the how to get the biggest return on their investment when it comes toΒ improvement;
- The challenge of change.Β Changingβ―everydayβ―teaching practices isΒ actually really,Β reallyβ―hard; and
- Is it working?Β Reliable feedback and evaluation (knowing whether what you are doing is working) isβ―oftenβ―absent or misleadingβ―(in both classroom teaching and school leadership).Β
The Great Teaching Toolkit is now focused on addressing these challengesβ―directly,Β overΒ time.Β Β
Β
What to work on? (And is it working?)
Publishing theβ―Great Teaching Toolkit: Evidence Reviewβ―was, in itself,Β aΒ response to the first of theseΒ challenges. Byβ―setting out, in practical andβ―rigorousβ―terms,β―theβ―Elements of practice that make a difference to student outcomes, we hoped toβ―provide someβ―clarity.β―However, there is another limitationβ―that applies to any attempt toβ―clarifyβ―whatβ―Great Teachingβ―is:β―definitionsβ―alone do not define the thing.β―The same argument applies toβ―defining a curriculum or learning aimβ―for students: describing it in words is necessaryβ―ββ―it is a good starting pointβ―ββ―but words aloneβ―cannot define it well enough to avoid confusion.β―Β
The same level of rigour that is required to define a learning aim for students should be applied to our attempts to defineβ―professional learning aims for teachers. WeΒ have toΒ specify a process forβ―determining how far the learning has been achieved.β―β―Β
This is one of the reasons why the mainβ―workstream for the GTT this year has been the development ofβ―measures of theβ―Elements of Great Teaching.β―If we want teachers toβ―focus on a specific aspect of their practiceβ―and to really understand what success looks like in relation to improving it,β―we need to give them the tools to operationalise it, toβ―make that element explicit,Β visibleβ―and real.Β
Of course, creating high-quality measures of Great Teaching was never going to be easy. Perhaps the most obvious, and most widely used, measures of teaching quality depend on lesson observation. But doing this well (as I wrote inβ―a blog in 2014)β―isβ―harder than you think.Β Β
To generate new insight, we have been developingβ―student surveys.β―There is a good body of research that supports theβ―validity of using student surveys as a measure of teaching quality (e.g.,β―Marsh and Roche, 1997;β―Gates Foundation, 2012;β―Spoorenβ―et al, 2013). We reviewed this work andβ―developed our own surveys, structured around theβ―Elements of the GTT identified in the Evidence Review. We currently have aβ―goodβ―selection of teachers and schools whose classes have completed our surveys and are amassingΒ evidence of their validity. WeΒ builtΒ a prototype platform and have received good feedback fromβ―users.β―We began with versions for secondary ageΒ pupils, butΒ are now also working with primary schools; over time, weΒ willΒ extend the range of surveys.Β
WhileΒ developing such reliable and valid measures isΒ no easy task, early indicationsΒ and analysesΒ areΒ veryΒ positive. If theseΒ hold firm as we continue the trialling process,Β teachersΒ using the Great Teaching ToolkitΒ willΒ also be able to address the third of our challenges: is what I have been doing working?Β After identifying an Element to work on, and implementing a strategy forΒ a period of time,Β has my practice improved?Β Are my students benefiting from even greater teaching?Β
Β
The challenge of changeΒ
Put simply, changingβ―everydayβ―teaching practices isΒ actually really,Β reallyβ―hard.Β This is unlikely to be too controversial. A large body of research and experienceβ―establishes that teachersβ practices are determinedβ―and constrainedβ―by traditions,β―normsβ―and expectations, teacherβ―values,β―beliefs and theories,β―teachersββ―skillsΒ and knowledge and, of course, habits β routine, automatic behaviours typically below the level of conscious awarenessβ―(Hobbissβ―et al., 2020).Β
If we want to help teachers to change these practicesβ―then, mostly, it is about teacher learning.β―Helping teachers to gain new knowledge,β―to develop insights and understandings ofβ―relevant underpinningβ―theory, to build skills and techniques, and to acquire and embed new habits, can all beβ―thought of asβ―a learning process.β―That means we are squarely in the territory ofβ―applying what we know about the conditionsβ―thatβ―optimise learningΒ (the principles of the Great Teaching framework)β―to a special case of professional learning.β―β―Β
This comparison between the ways we routinely help pupils to learn hard ideasβ―orβ―processes and the things we do to support teachersβ professional learning provides a useful check on any strategy for CPD:Β for any approach to professional development, would the same method work for pupil learning?Β
Another useful comparison is with learning practical skills such asβ―golf, tennis, football, piano, guitar, cookery,β―orβ―cabinet-making. Here typical approachesβ―involve coaching by an expert, often one-to-one or in a small group, with an emphasis on spending a lot of time in βdeliberate practiceβ of the skill (EricssonΒ and Pool, 2016). If you think you can learn to be a better teacher by reading books and blogs, attending presentations and conferences,Β reflectingβ―and having intense conversations with colleagues, could you see a similar approach working to improve your skill in darts,β―yogaβ―or chess?β―Theseβ―reflectiveβ―activities may be useful, but you wouldΒ likelyΒ need to do a few other things as well.β―Β
Β
Try andΒ learn
We need toβ―build expertise deliberately and systematicallyβ―if we want to see the faithful realisationβ―ofβ―βresearch-basedββ―practices.β―The Great Teaching Toolkit mustβ―followβ―more of an engineeringβ―test-and-learn approach than a grand design. Although we certainly start with a strongβ―rationale and design, the success of our project will dependβ―lessβ―on the initial ideasβ―thanβ―on our responsiveness to what we learnβ―inβ―the process. There are too many cases when the best available research is just not good enoughβ―to tell us what we need to know with certainty.β―The complexitiesβ―and interdependencies of schoolsβ―and classrooms are such that our current theories cannot predict how things will play out in practice.β―Β
For me, the most exciting part of the Great Teaching Toolkit is what we hope to learn.β―Is it possible to create valid measures ofβ―the important elements of teaching quality that can be used at scale?β―Can the feedback from such measures help teachers and school leaders toβ―evaluateβ―how wellβ―they are doing, to understand what great practice looks likeβ―and to focus their efforts to maximise improvement?β―Can we provide them with the structuresβ―and support to make thisβ―learningβ―easyβ―and inevitable?β―Can we identify,β―for individual teachers,β―the high-leverage skills and practicesβ―whose development will make the most difference to their studentsβ outcomes?β―Β
The answer to any of these questions may, of course,β―be no. ButΒ the more work we do on this, the moreΒ I believe we really can do it. While there is a chance it could be yes,β―my colleagues andβ―I willβ―do everythingβ―weβ―can to find a way β andβ―to feelβ―excitedβ―about theΒ prospect.Β
Β
ReferencesΒ
Coe, R. (2014, January 9). Classroom observation:Β ItβsΒ harder than you think. CEM Blog. http://www.cem.org/blog/414/Β Β Β
Ericsson, K. A. & Pool, R. (2016).Β Peak: Secrets from the New Science of Expertise. Boston, MA: Houghton Mifflin HarcourtΒ
Gates Foundation (2012)β―Asking Students about Teaching: Student Perception Surveys and Their Implementation. MET Project Policy and Practice Brief. Bill and Melinda Gates Foundation,Β September,Β 2012.β―β―https://eric.ed.gov/?id=ED566384β―β―Β
Hobbiss, M., Sims, S., & Allen, R. (2020). Habit formation limits growth in teacher effectiveness: A review of converging evidence from neuroscience and social science. Review of Education, rev3.3226.β―Β
Marsh, H. W., Roche, L A. (1997). Making studentsβ evaluations of teaching effectiveness effective: The critical issues of validity,Β biasΒ and utility. American Psychologist, 52, 1187β1197.β―Β
Spooren, P.,β―Brockx, B., &β―Mortelmans, D. (2013). On the validity of student evaluation of teaching: The state of the art.β―Review of Educational Research, 83(4), 598-642.β―Β
Podcast: Play in new window | Download (Duration: 34:52 — 17.7MB)
Subscribe: Apple Podcasts | Spotify
[…] We began developing the secondary school-age version of our student surveys shortly after the GTT: Evidence Review was published, working with schools in New Zealand and the UKβProf Rob Coe has already spoken about this in some detail here. […]