Are schools ready for the impact of large language models?
really enjoyed this Daisy, thank you. I wanted to ask about point 2 and point 6: every time I've asked it a question similar to the types of question I might ask my students, it's been extremely easy to spot a GPT answer due to length and grammatical/syntactical *accuracy*. of course, i can spend a long time refining the prompt to get it to resemble student work more, but most students won't be doing this (presumably).
when you did your study with the 8 GPT essay-seeds, how much prompting did you have to do before you got an essay that you thought *could* fool a teacher, or were they all in "one take"?
Our school has adopted a structured assessment response to AI:
Red Tasks: No generative AI permissible
Yellow Tasks: Some generative AI is permitted
Green Tasks: generative AI is expected
By focusing on the core assessment constructs of a task helps determine what category they should be.
More explanation here:
> In our future posts we will look at possible ways for educational institutions to respond to this challenge.
The most surefire way for shorter essays is to give the student the topic and two hours at their desk with just a pen and paper.
For more research based approaches with heavy works cited requirements and longer essays, from what I've seen the LLM is far weaker.
I just don’t think there’s any substitution for being a well rounded, knowledgeable individual. It makes you more interesting and usually with a terrific sense of humour. Learning is laborious and it takes A LOT of time. Somewhere along the line we’ve forgotten that, and the example we’re setting for our young learners by this instant gratification, is to set them up for failure along the way.
I disagree a bit with 4. I just used ChatGPT to explain a maths problem I was stuck on and it did an amazing job - I needed to evaluate an infinite geometric series. I attempted it myself but got nowhere. ChatGPT explained the process and gave the answer. I still couldn't get my head around something (an alternating sign in the series). It cleared it up instantly. The maths checks out. It's all right and the explanation is solid. The alternative would be a tedious email dialogue with the professor, or waiting until his office hours next week. I also find LangAI an excellent spanish tutor. Afterall the thing I need correcting is the spelling and grammar (I don't care for the factual correctness of the content in our conversation). Perhaps it's a good maths and language tutor but struggles with other subjects.