You’re only considering one narrow use of LLMs (which they’re bad at). They’re great for things like idea generation, formatting, restructuring text, and other uses.
For example, I tend to write at too high a writing level. I know this about myself, but it’s still hard (with my ADHD) to remain mindful of that while also focusing on everything else that crowds my working memory when doing difficult work. I also know that I tend to focus more on what students can improve instead of what they did well.
So ChatGPT is a great tool for me to get a first pass of feedback for students. I can then copy/paste the parts I agree with for praise, then “turd sandwich” my suggestions for improvement in the middle. Or I can use ChatGPT to lower the writing level for me.
For tests, it’s great to get it to generate a list of essay questions. You can feed GPT 4 up to 50 pages of text, too, so the content is usually really accurate if you actually know how to write good prompts.
I could go on. LLMs are a great tool, and teachers are professionals who (I hope) are using it appropriately. (Not just blindly copying/pasting like our students are… But that’s a whole other topic.)
They may eventually be useful in this space. But for now, they are more work than they’re worth and completely discredited for proper fact-based research. And the teachers my kid has had who used it for testing resulted in completely wrong answers that the teacher didn’t bother to check.
Yes that is the teacher’s fault, but so is using it to generate a test in the first place.
I will die on this hill. LLMs of any kind right now are not something that should be trifled with in a critical thinking-based curriculum. In time, perhaps. But not yet, not when LLMs are so easily manipulated (whether trained on public data or private). The various implementations haven’t earned credible trust despite CEOs drooling over them.
It’s a shame your child’s teacher used the tool incorrectly. That was unprofessional of them.
If it helps, there are people like me running training sessions for educators to let them know what LLMs are (and are not) capable of. The main point I was pushing this year was that LLMs don’t know or understand anything. “The I in LLM stands for Intelligence.”
You’re only considering one narrow use of LLMs (which they’re bad at). They’re great for things like idea generation, formatting, restructuring text, and other uses.
For example, I tend to write at too high a writing level. I know this about myself, but it’s still hard (with my ADHD) to remain mindful of that while also focusing on everything else that crowds my working memory when doing difficult work. I also know that I tend to focus more on what students can improve instead of what they did well.
So ChatGPT is a great tool for me to get a first pass of feedback for students. I can then copy/paste the parts I agree with for praise, then “turd sandwich” my suggestions for improvement in the middle. Or I can use ChatGPT to lower the writing level for me.
For tests, it’s great to get it to generate a list of essay questions. You can feed GPT 4 up to 50 pages of text, too, so the content is usually really accurate if you actually know how to write good prompts.
I could go on. LLMs are a great tool, and teachers are professionals who (I hope) are using it appropriately. (Not just blindly copying/pasting like our students are… But that’s a whole other topic.)
They may eventually be useful in this space. But for now, they are more work than they’re worth and completely discredited for proper fact-based research. And the teachers my kid has had who used it for testing resulted in completely wrong answers that the teacher didn’t bother to check.
Yes that is the teacher’s fault, but so is using it to generate a test in the first place.
I will die on this hill. LLMs of any kind right now are not something that should be trifled with in a critical thinking-based curriculum. In time, perhaps. But not yet, not when LLMs are so easily manipulated (whether trained on public data or private). The various implementations haven’t earned credible trust despite CEOs drooling over them.
It’s a shame your child’s teacher used the tool incorrectly. That was unprofessional of them.
If it helps, there are people like me running training sessions for educators to let them know what LLMs are (and are not) capable of. The main point I was pushing this year was that LLMs don’t know or understand anything. “The I in LLM stands for Intelligence.”
I like that last statement. I might steal it 🤣
Thanks for your insights.