- The PEN Weekly
- Posts
- The Thoughtful Late Adopter
The Thoughtful Late Adopter
800 studies on AI in the classroom. Almost nothing on your students. Here is what that actually means.


MAKING IT EASIER TO BE A BETTER TEACHER
Somewhere in the inbox, wedged between a vendor demo and a PD flyer swearing that artificial intelligence will "transform" the classroom by the time the buses roll back in September, sits a conference keynote a colleague forwarded with the subject line "the future is here."
It is a lot. And underneath all of it is a much quieter question, the one most teachers are actually sitting with this summer: does any of this stuff even work?
Here is the honest answer, not the hype answer.
🔉 But first, this week's sponsor is for teachers who want to keep up with tech without spending hours online.
The brief everyone in tech reads
TLDR is the free daily brief that 7M+ engineers, founders, and operators actually read. Curated by ex-Google and Anthropic engineers. The most interesting stories in tech, summarized in 5 minutes.
And now back to making you an even better teacher. ⬇️
Noteworthy News
Your Inbox Has Achieved Swamp Status
The summer inbox has quietly achieved swamp status. Vendor demos, webinar invites, a flyer promising a September transformation, and every subject line carrying the same rocket-ship energy. Every slide seems to have a big percentage on it. Every email arrives certain that the future has just been invented and is available now for a per-seat license.
Underneath the noise is the question nobody puts in a subject line. Does this actually work? Not "is it exciting," not "is the district excited," but does it move anything for real students in a real room. That question is not cynicism. It is the exact instinct that keeps a classroom running, pointed at a fresh pile of promises.
The good news is that there is a real answer this time, and it turns out to be more useful than any of the marketing. It just points in a direction the flyers would prefer to leave off the slide.
What 800 Studies Actually Found

When Stanford's SCALE team went looking for the evidence, they did the unglamorous thing and actually read it. More than 800 academic papers on AI in K-12 education. The finding underneath all that reading is striking mostly for what it did not contain: no high-quality causal studies of students using AI in United States classrooms.
"Causal" is the word that matters.
It means the tool itself is what moved the needle, not the enthusiastic teacher piloting it, not the eager class that volunteered, not the hundred other things happening in any room on any given Tuesday. Strip those out, and for kids using AI, the cupboard is mostly bare. What remains is vibes and vendor decks, which are lovely at a conference and thin as evidence.
Here is the twist. The one place with real signal is the teacher-facing side. Early studies suggest tools that help with planning and prep may save time without dropping quality.
Read that split slowly, because it is close to the exact reverse of the sales pitch. AI helping teachers work has more behind it than AI teaching students. The marketing keeps the camera on the kids. The evidence keeps pointing it at the grown-ups.
The Two-Question Filter
None of this requires a research degree to act on. It requires two questions, run on any tool before it gets anywhere near a lesson, whether a trusted colleague swears by it or the district rolls it out with a launch email and a countdown clock.
Question one is the kid question: does this make students think more, or think less? A tool that scaffolds a student's reasoning is doing genuinely different work than one that quietly hands over the answer. The second kind removes the effort, and the effort is the whole point, because that is where durable skills actually get built. If it is not clear which one is happening within about thirty seconds of trying it firsthand, that hesitation is the answer.
Question two is the vendor question, and it lands best said exactly like this: "Can you show me the causal study on student outcomes?" Then watch what comes back. Usually it is a case study, a glowing testimonial, or a single slide with an enormous percentage and no methodology anywhere near it, which is the corporate equivalent of a confident shrug in a very nice suit. That is not nothing. But it is not evidence, and now the difference is easy to see. Zero budget, zero prep, and the filter keeps working on every tool for the rest of a career.
The Permission Slip

There is a habit in this profession of treating "early adopter" as the quiet compliment and "late adopter" as the person still printing the sub plans by hand. That habit is worth questioning.
Consider the district technology director who went on record admitting his team, in his own words, drank the AI Kool-Aid. They expected the tools to handle grading. The tools did not. And when they underdelivered, something more expensive than money got spent: staff trust eroded. The overpromising did not just torch a budget line. It burned the goodwill he would later need for the tools that genuinely help. That cost is real, and it tends to land on teachers.
So consider this the permission slip. Waiting for evidence is not timidity. It is professional judgment, the same judgment a teacher exercises roughly forty times a day, now aimed at a shiny thing instead of a seating chart. The strongest move in a classroom is often the one a teacher decides not to make.
Being a thoughtful late adopter beats being an enthusiastic early casualty every single time.
You Are Not Behind
Here is the reframe worth carrying into the fall. Sitting this summer out is not falling behind. It is reading the evidence correctly, which is a different and much rarer skill. The teachers quietly waiting for proof are not the stragglers in this story. They may be the ones who read the room first.
So when the next tool lands on the desk, and it will, give it the thirty-second test and ask for the causal study. Then get back to the iced coffee and the face-down novel. Both have considerably more evidence behind them than most of the inbox.
WHAT DO YOU THINK?
We would LOVE to hear from you!
Reply to this email, or send us a message on Instagram! We’re here to walk with you in these crazy times!
Part of what makes The PEN Weekly community so special is the fact that our readers are teachers from around the world! We’re not going to lie, we think that’s pretty darn cool!
We’ll see you again on Wednesday 🍎
Do you know someone who would appreciate reading the PEN? Share this newsletter with them! Our goal is to reach as many teachers as possible, and to build a community of teachers supporting teachers.




Reply