If you have a narrative you want to tell about education, locally or globally, PISA results can probably help confirm it. And for the most part, we do like bad news, so if you like to describe what is happening in education as “concerning” or “worrisome” or gravitate to ideas like “declining” or “falling” there was probably something for you in the latest wave of PISA results. Of course, if you want to see Canada, and more specifically British Columbia, as one of the world’s highest performing jurisdictions this evidence is also present.
PISA 2022 – Canada Fact Sheet (shows Canada in global context)
Canadian Results (showing results for each province)
First, let’s talk about what PISA results are. For those in education, they are a bit like the Education Olympics. They are a tool for comparing jurisdictions around the world. PISA is the OECD’s Programme for International Student Assessment, that measure 15-year-olds’ ability to use their reading, mathematics and science knowledge and skills. If you remember 10-15 years ago when everyone was going to Finland to learn what they were doing in education, this attention started from very strong PISA results.
And, like the Olympics, they are controversial. Criticisms include concerns about the narrow focus on certain skills, potential cultural biases, and the complex nature of education systems, which may not be fully captured by standardized assessments. My doctoral advisor, Yong Zaho is one the loudest critics. He wrote, “PISA is a masterful magician. It has successfully created an illusion of education quality and marketed it to the world.”
It does seem as though PISA results have got less attention this year than in previous waves – maybe that is a statement on fewer journalists covering education, or other global events dominating the news, or maybe the criticisms have some shying away from covering the results.
I have written here several times around the results.
In 2009 – Our World Cup (on reflection, I was much more excited about them than I am today)
In 2013 – Some PISA Thinking (which looked at BC’s results of that time)
In 2016 –It is OK to be Happy About PISA (some celebrating our strong achievements)
I do think they have value – because at a time when it is important to have conversations around learning topics like numeracy and literacy there is little media attention around them. PISA brings these discussions to the provincial, national and even global levels. And while most are looking to tell a story about how we are just not as good as we used to be – so it must be the kids or the teachers, beyond this simplistic silliness there are good conversations worth having. And beyond the front page “Who is winning” comparisons, the survey breaks out data on topics that many are curious about, like the various impacts of COVID on learning, and the impact that home language or gender can have on results in jurisdictions. Some of the conversations that PISA can open up include:
- The need for quality discussions around the use of data – at schools, in the community and with politicians
- Areas of strength and weaknesses in schools and districts. When PISA says X about science in your country, what do we know about science at our school or district – do PISA results surprise us? Do they confirm what we know?
- What do PISA and our local information tell us about equity? As you get into PISA there is a lot of information like the gap between the highest and lowest performing students – the smaller the gap, likely the more equitable, at least on this measure.
- Education as a global topic. The assessing of students around the world is a reminder that our students are part of a global community – they will be competing in the workplace not just with those in their school or neigbourhood but much further afield.
- A discussion about what matters. So, PISA says something about reading, math and science – what else do we value in our system and what other evidence can we use to better understand how we are doing?
- What can we learn from others? Are there particular jurisdictions having success that stand out? (I would like to know what Utah is doing with math instruction as they outperform Finland in PISA). Like the Finland impact of the early part of the century, there may be something we can learn. Even within Canada, this can be useful. We need to see places like Alberta and Quebec as our partners not our competitors in BC.
As with any test results, PISA results are quickly politicized – so everyone spins the results. Often current governments will say the results prove everything is going well, those looking to be the next government will use the same data to say the opposite.
It was in my last post I wrote about the power of networking in British Columbia and how education is not just a competition. I see that PISA does open some of the wrong conversations around this battle between jurisdictions, but I do also think that any attention can be good attention – so let’s take this energy and focus and have real conversations about equity and excellence with numeracy, reading and science – not just for a single jurisdiction but for all learners everywhere.