Sumdog's 2024/25 England Efficacy Study
Using Sumdog from Term 1 to Term 3 showed the following statistically significant results
The number of pupils with SEN working at or above the expected standard
The number of pupils with SEN working at or above the expected standard increased from 28% to 59% (30%+) from Term 1 to Term 3.
Increase in pupils working above expected standard
The number of pupils working above the expected standard increased from 13% to 20.4%.
Increase in pupils working at or above expected standard
The number of pupils working below the expected standard dropped from 38.9% to 32.9%.
About the study
Our England Efficacy Study independently assessed the impact of Sumdog on Year 5 pupils' maths attainment and attitudes towards maths.
Across three terms, we worked with ImpactEd Evaluation to gather attainment and pupil survey data from 14 England primary schools who had not used Sumdog before. We also carried out focus groups with 15 teachers from 11 different schools.
Key findings from the final report
Boosts mathematical fluency
Pupils using Sumdog had made statistically significant improvements in maths attainment between Term 1 and 3. Though not attributed to Sumdog alone, teachers felt Sumdog supported mathematical fluency and was a valuable component of their toolkit for improving progress.
Supports vulnerable learners
Pupils with SEN (Special Educational Needs), lower-attaining pupils and those with lower self-esteem saw increased benefi ts from using Sumdog.
Increases engagement
All teachers reported that pupils enjoyed engaging with maths through Sumdog with optimism that attitudes towards the subject would positively shift over a longer period of use.
Consolidates learning
Sumdog was successfully used as a tool for pupils to practise what they had been taught in class, engage less interested pupils with learning maths and to identify gaps in learning.
Easy to use
Teachers found the platform intuitive, with minimal need for ongoing support after initial setup.
Increased impact for boys
Male pupils saw a statistically signifi cant decrease in their anxiety towards maths and a statistically signifi cant improvement in their maths attainment compared to their female peers.
Promotes mathematical accuracy
Sumdog’s anti-rush technology eff ectively encouraged pupils to apply their mathematical understanding more carefully when answering questions.
Interested in learning more?
Watch the webinar
Nina Vafea, Manager at ImpactEd Evaluation and Tom Owen, Vice President of Sumdog discussed the Sumdog Efficacy Study's methodology, final findings and implications for primary schools in England.
Prefer to listen? Play our podcast episode.
%20(600%20x%20600%20px)%20(1000%20x%201000%20px)%20(1500%20x%201500%20px).png)
Start a Sumdog trial for your school today
Frequently Asked Questions
Th study evaluates how Sumdog was used in schools and explores its impact on Year 5 pupils’ maths attainment and attitudes towards maths. It was independently conducted by ImpactEd Evaluation during the 2024–25 academic year. The pupils had not used Sumdog before taking part in the study.
The evaluation included:
-
14 primary schools in England
-
499 pupils providing maths attainment data
-
239 pupils completing matched baseline and endline surveys
-
15 teachers participating in interviews and focus groups
Yes. Pupils showed a statistically significant improvement in maths attainment between Term 1 and Term 3. There was an increase in the proportion of pupils working above the expected standard and a decrease in those working below expected standard.
However, as the study did not include a comparison group, the findings should be interpreted as evidence of positive progress alongside normal classroom teaching rather than proof of causation.
Yes. Teachers consistently reported that pupils with SEN, lower-attaining pupils, and those with lower self-esteem benefited most from using Sumdog.
Attainment data showed statistically significant progress for pupils both with and without SEN. Teachers highlighted Sumdog’s ability to automatically adapt question difficulty while allowing pupils to participate alongside their peers.
Teachers primarily used Sumdog to:
-
Consolidate learning after lessons
-
Engage pupils who were less motivated by traditional maths activities
-
Identify gaps in pupils’ understanding using real-time data
Many teachers described Sumdog as a valuable addition to their existing teaching toolkit.
Pupils reported high enjoyment and engagement when using Sumdog.
Teachers noted that attitudes towards maths can be deeply ingrained and may take longer to shift, particularly over a single academic year.
Yes. Male pupils showed a statistically significant reduction in maths anxiety over the course of the study. Teachers suggested that the game-based and competitive elements of Sumdog may be particularly engaging for some boys.
Teachers reported that Sumdog was easy to set up and intuitive to use after initial onboarding. They valued its alignment with the National Curriculum and White Rose Maths, and its ability to quickly set, differentiate, and review pupil work without adding to workload.
Some teachers noted that pupils could initially focus more on speed than accuracy when competing with peers. However, recent platform features including Sumdog's anti-rush technology, designed to slow pupils down were viewed positively and helped encourage more careful problem-solving.
From our blog
Understanding Sumdog's Impact: Our Efficacy Study Interim Report
