What percentage of Year 6 students do you think will get the following question right?
Answers will be revealed at the end!
----
Last September, we launched our new Automark website. It uses artificial intelligence to automatically mark and analyse paper-based multiple choice questions.
You can use it for any multiple-choice questions you want, but we have created sets of questions about sentence structure which lots of our schools have used.
In particular, we have created three versions of a quiz about sentence structure. The September quiz gives us a baseline, and then we can check the students’ progress in January and May.
We’ve also provided schools with a set of resources on sentence structure that they could teach to their students across the year.
In total, in the academic year 2022-2023, we've processed just over a million question responses using the site. What have we learned?
Here are two key insights
Our students have made huge progress in their understanding of sentence structure Here's an example: In September, our Year 6 cohort averaged 11/20 on the quiz. By January, that had gone up to 13. That may not sound like much, but in the context of this quiz it is pretty significant. It meant that by January, the Year 6s were doing better on the quiz than the Year 9s had in September! So you could argue that 3 months of targeted instruction have allowed them to improve by 3 years.
But… there are still fundamental aspects of sentence structure that students find very difficult
Although the average score has leapt up, there are some questions that students still really struggle with - including the one you saw at the start of this post.
In September, only 10% of the Year 6s got this right. In January, the exact same cohort took a cloned version of this question and 43% got it right. On the one hand, that’s brilliant: it shows enormous progress, and that the teaching is working. On the other hand, over half of students are still struggling with this question even after dedicated teaching on the topic.
Other questions involving short simple sentences were also some of the hardest on the quiz - for example, this one, which nearly half of Year 6s were still getting wrong in January.
When we’ve spoken to teachers who have carried out these tests and taught the lessons, they say that students often tend to define sentences by length and think that a sentence shouldn’t be too short or too long.
Often, students are unaware of the deeper structures of a sentence. That’s why plenty of our teaching resources focus on identifying verbs and subjects, as these are the building blocks of sentences. But students particularly struggle to identify verbs, even after instruction. Our teachers report that many students focus on the idea that a verb is a ‘doing word’ which makes it hard for them to identify the verb in sentences like the following.
I enjoy swimming.
We like football.
They prefer gymnastics.
In all of these cases, students are very likely to identify ‘swimming’, ‘football’ and ‘gymnastics’ as the verb.
What are the implications for the curriculum?
The quiz question I began this post with may seem incredibly easy and obvious and not worth bothering with. But our data shows that teaching students so that they can reliably get questions like this right is not easy at all. Understanding sentence structure is much harder than we might first assume.
It’s also much harder than the national curriculum assumes. We’ve shown that right up until Year 9, students are struggling to identify simple sentences & verbs, even after receiving targeted instruction. And yet, the national curriculum says that by year 3 & year 4, students should be extending the range of sentences they use with more than one clause, using fronted adverbials and extending noun phrases.
Interestingly, whilst the national curriculum mentions verbs 181 times, at no point does it ever say that students should actually learn what a verb is. For example, in year 1 it says that students should learn how to add suffixes to verbs, in year 2 that they should use progressive forms of verbs, in year 3 that they should use the present perfect form of verbs. Nowhere does it say that they should learn to identify what a verb is.
This feels to me like a recipe for total confusion. Imagine a student who thinks that ‘gymnastics’ is the verb in ‘They prefer gymnastics’ being told to write a sentence using the present perfect.
What next from us?
This first year of data has provided us with incredibly useful insights that will inform our plans for next year.
We’re working on a writing progression map that will cover national curriculum content, but also include some of the vital foundational concepts - like verbs! - that it doesn’t fully address.
We’ll also soon have further analysis from the May version of the test.
Gymnastics is not a doing word!
This reminds me of an experience I had years ago, when I was trying to tutor some 15-year-olds in writing. I wanted to teach them about subject-verb agreement, but I realized they didn't know what a verb was. So I gave a standard definition--"an action word." Then I showed them sentences and asked them to identify the verb in each one.
One girl confidently told me that the verb in a sentence was "concert." When I asked her why she thought that, she said, "Because, you know, when you go to a concert, everyone is moving around a lot." I suspect the same thinking was at work in the choice of "gymnastics" as a verb.
I think the problem is that definitions are too abstract for many students to truly grasp. The only thing that may work is repeated practice in distinguishing sentence "fragments" from complete sentences--and understanding why the fragments are fragments (followed, ideally, by turning them into complete sentences). Anyone familiar with The Writing Revolution may recognize that as one of the sentence-level activities that are part of the method.
I've seen grammar books which focus on the more-technical aspects of the words, such as the positions they can take and whether they conjugate/decline. Often changing something and seeing how it changes the rest, can be useful (Its vs it's particularly!)
For the gymnastics question, perhaps pointing the subject "they" is plural, then asking which word would have to change if it were made singular? They prefer --> He prefers. It shows how subject-verb agreement works, and points out which word is the verb.
I've seen something similar with the adverb/adjective problem. The source pointed out that adverbs can take almost any position in a sentence and can be moved around, while adjectives need to stay close to the noun they modify:
Happily, they danced. They happily danced. They danced happily.
vs
She wore a red dress. She red wore a dress. She wore red a dress. Red she wore a dress.