4 Comments
User's avatar
Mrs. F's avatar

AI hallucinates I hear.

Bob Devereux's avatar

Chating with LLMs probably won't update their training. Writing articles like this, editing wikipedia and Grokipedia may be more effective.

Jami Hunt-Williams's avatar

I don't know if you are aware, but MetaMetrics, the universally available Lexile scoring tool has partnered with ChatGPT to provide "text leveling" for everyone. All you have to do is sign up for a ChatGPT account and download the MetaMetrics Lexile scoring extension. Why is this terrifying? This summer I received an Amazon Activate Founders grant to create an AI-based intervention, rehab and recovery system for secondary students and I needed a seventh-grade level diagnostic to place the students. The diagnostic tests were based on criteria formed according strictly to Scarborough's reading rope - 7 of the 8 because how do you test background knowledge - and then figured by the Simple View of Reading. I called DESE - the Missouri Department of Elementary and Secondary Education to have a literacy expert confirm that what I wrote was, in fact, a seventh grade equivalent passage. Their answer: We don't have anyone here who can do that. So I turned to the "big seven" which returned results from post graduate to fourth grade on the same text. Brisk returned it as a senior level reading passage, so I asked it to adjust it to a seventh grade. We then took the Brisk adjusted text and put it into the "big seven" and got sixth grade to senior. It was only when I asked Brisk to adjust it to a 4th grade level that we got anything close. Finally we went to Lexile and the researchers I was working with could not believe that Lexile was now tied to ChatGPT. When we had the text tested - test created to be fourth grade level by Brisk it flagged as sixth grade sixth month level by Lexile. So we decided we would use a diagnostic band spanning three grade levels. Because when your own department of education can't help you determine what grade level reading is, that's a problem.

BIG fan of your work - just used your Curriculum Insight Project info on phonemes only in my first podcast - linked to here. It is called The Pedagouge. You can hear it at youreadthatwrite.com. Keep up the fantastic work. We are listening and fighting the good fight!

Bob Devereux's avatar

There are a number of purpose chatbots for teachers. MagicSchool, SchoolAI, ChatGPT for teachers, features in Google classroom. In addition to curriculum reviews, districts will need help deciding if they should adopt them. They generate lesson plans, assignments, and assessments.