From My Planning Partner

The Margin

What's real in AI for your classrooms this week, and what's just loud. A weekly digest of the most practical findings and headlines for the K-12 education leader.

Issue No. 18Friday, October 23 · 6 min
How this is made The Margin is compiled by AI against a bar a human set. A pipeline scans a curated list of research, journalism, lab, and policy sources, scores each against a rigorous rubric for whether it should change a leader's mind, and publishes only what clears the bar. I set that bar, audit what goes out, and cut what doesn't hold up. See exactly how it works, with the data →
This week's read
Real the evidence base, counted

Somebody counted the research on AI in K-12. Out of more than 800 papers, 20 produced strong causal evidence.

The read On October 15, 2026, Education Week reported on a federal policy report from the Alliance for Learning Innovation, which it describes as "a coalition of nonprofit organizations, researchers, practitioners, funders, and private-sector leaders focused on advancing education research and development," arguing that the federal government should fund research into AI tools in classrooms. The recommendation is not the story. The number the article cites to justify it is. Stanford's SCALE Initiative, Education Week reports, "analyzed more than 800 academic papers related to AI in K-12 education." Then: "Only 20 of those papers produced strong causal evidence." That is the whole evidentiary floor under every AI decision a district is making this year. The article also reports what the Stanford review did find, and the hedge is the authors' own, so keep it: "the current evidence suggests that tools designed to foster independent reasoning may be more likely to support meaningful learning for students" and, with the same hedge, that AI tools can help educators complete their tasks more efficiently and improve their pedagogical practices. The second half of the story is the machinery that would produce better numbers. The Institute of Education Sciences, the Education Department's research arm, was "among the divisions hardest hit by staff reductions last year, losing about 90% of its employees" as the department overall shrank by about half. It "went more than 15 months without holding any education research grant competitions," announcing a new set only in August. And the Office of Management and Budget "has yet to release more than half of IES' 2026 budget to the agency so it can spend it," against a release that normally takes no more than six weeks after a budget passes. Sara Schapiro, the alliance's executive director, told Education Week: "No state, district, or school should have to answer these questions alone, and the answers shouldn't depend on whether they have the resources to run their own pilots." Ronn Nozoe of the National Principals Association said most school leaders are at least somewhat confident leading AI implementation next year, but that for the less confident ones, "the absence of clear evidence and practical guidance is a real barrier." Where this breaks, and it does in two places. The 800 and the 20 are Education Week's characterization of a Stanford review this newsletter has not independently scored, so the count is reported rather than audited here. And the recommendations come from a coalition of organizations that fund and perform education research, which means they are arguing for their own field to be funded. Neither of those makes the count wrong. Both of them are why the count, and not the ask, is the part to carry.
800+
Academic papers on AI in K-12
education that Stanford's SCALE
Initiative analyzed
20
Of those papers that produced
strong causal evidence
90%
Share of its employees the federal
education research agency lost
in staff reductions last year
All three figures are as reported by Education Week on October 15, 2026. The 800 and the 20 are its characterization of a Stanford SCALE Initiative analysis, which this newsletter has not independently scored, so treat them as a reported count rather than one audited here. "Strong causal evidence" is Education Week's phrasing and the article does not publish the threshold used. The 90 percent is described there as "about 90%" of IES employees lost to staff reductions last year.
What it means for your schools Keep this number in your pocket for the rest of the year. More than eight hundred papers, twenty with strong causal evidence. That is the pile a vendor reaches into when they tell you the research supports their product, and it means the honest answer to what the evidence says about this is usually that almost nothing says anything yet, on this specific question, for students like yours. That is not an argument for doing nothing, and I want to be careful here, because the thin-evidence finding gets used both ways. It is an argument for knowing which of your decisions are bets. Nearly all of them are right now. So size them like bets: shorter contracts, a real exit, and one outcome you wrote down before you bought anything. The harder half of this story is that the gap is not closing on its own. The agency whose job is exactly this research lost about nine in ten of its people, went more than a year without running a grant competition, and is still waiting on over half of this year's money. If your plan is to wait for the definitive study, name the year you expect it to land. Then plan for it not landing, and make your own evidence instead, which is smaller and more boring than a study and worth more to you than one: one tool, one outcome you actually care about, one comparison group, even if the comparison group is the classroom across the hall.

Education Week →

The rundown
Watch

Teachers Pay Teachers says it will ban AI-generated resources, after a reporter found an alphabet worksheet missing the letter F

Chalkbeat's Lily Altavena reported on October 15, 2026 that Teachers Pay Teachers, the marketplace where teachers buy and sell classroom materials, "plans to ban AI-generated resources from its site," announced "in a town hall last week." Chalkbeat reports no effective date and quotes no policy text, calling it a "forthcoming AI policy." It follows the paper's own August reporting, which found listings including "an alphabet coloring worksheet missing the letter F, a poster about the Black inventor of the potato chip with a baffling image of a firefighter and a stoplight, and typos aplenty." A TPT spokeswoman, Sarah Lehman, said the policy will support educators "in keeping teachers' expertise at the heart of the marketplace," that materials "should be unique, expertly crafted, and AI-free," and that "we're building tools that will speed up our ability to identify and remove AI-generated resources from TPT." Read that last clause twice, because the enforcement mechanism is a classifier that does not exist yet, which is the same promise AI detection has been making to schools. The announcement also landed beside a commercial change: a new seller tier with a higher cut of sales, a $60 annual fee, and a requirement to list exclusively on TPT, which TPT's own Q&A attributes to "a growing dynamic impeding the expansion of the marketplace: TPT resources are being increasingly sold on sites outside of TPT." Sellers are protesting both, and the move to ban AI-generated resources has drawn an online petition. The useful part is not whether the ban works. It is that a marketplace this popular with teachers has conceded in public that it cannot tell its customers what they are buying, and those files are already on your shared drives with no record of where they came from. Disclosure, and it is the one I always make: AI-generated teaching materials are exactly my category. I am building My Planning Partner in that lane, so read my take knowing I have a horse in this race. Chalkbeat →

Real

Two more universities are dropping Turnitin, and one said out loud that the checker is largely ineffective against the thing everyone is worried about

Inside Higher Ed, republishing a Times Higher Education report by Georgia Luckhurst on October 15, 2026, reported that Newcastle University and the University of Westminster will not renew their Turnitin contracts, following Southampton earlier this year. Newcastle stops after the 2026 to 2027 academic year, citing its license agreement and the "potential use of colleague and student data for AI purposes from next year." Westminster's stated reasons are the ones to read twice. It said the plagiarism checker offered diminishing value because it was "largely ineffective against the most significant current integrity risk" of students using generative AI to produce work, and that the company's AI detectors were "probabilistic rather than conclusive and carry a recognized risk of false positives." Turnitin disputes the data characterization: a spokesperson said "Turnitin does not train a generative AI model, or LLM. We do train a classifier model, which identifies likely AI-written text and does not produce any content to predict what is AI versus authentically human." Proposed license changes set for July 7 have been postponed to September 2027 after what the article calls sector outcry. Aberdeen is reviewing its use, Aberystwyth has told students that if they are uncomfortable with the service they may submit through Blackboard instead, and Cambridge said it will "not accept any changes to the EULA that impact on data privacy or intellectual property" while keeping the service for now. These are universities, not school districts, and the article notes some believe the data concerns are being used to justify exits wanted on cost grounds, so principle and budget are tangled. It is still the most honest thing to happen in the detection market this year, and the question these institutions answered with their budgets is the one to ask about your own contract: what decision do you make differently because of the score. If a percentage starts a conversation with a student, a revision history does that for free. If it ends one, you have a bigger problem than a renewal. Inside Higher Ed →

Watch

The survey said AI freed up time for nearly two thirds of the teachers who used it. The other third is in the same survey

A Walton Family Foundation and Gallup survey, conducted with The Mattering Institute and released October 14, 2026, polled 1,952 US K-12 educators, defined as "teachers, paraprofessionals and other staff working in classrooms," from the probability-based Gallup Panel. Fieldwork ran online from July 28 to August 14, 2026, with a margin of sampling error of plus or minus 2.7 percentage points. Fifty-nine percent said they used AI tools for their work last school year. Among those who did, Gallup reports that "13% say it gave them a lot more time, and 51% say it gave them somewhat more time" for the parts of teaching that matter most to them. That is the nearly-two-thirds figure the coverage led with, and here is the rest of the same question, from the same respondents: "Just 7% say AI cost them time rather than saving it, while 29% say it had no effect either way." So among educators who actually used AI, more than a third reported no time back or a net loss. Three things bound this. It is self-reported time rather than measured time, and people are poor estimators of their own saved minutes, especially for a tool they chose. The survey's subject is mattering at work, so the AI questions sit inside an instrument built for something else. And the sponsor is a major education funder rather than a neutral party, which does not impeach Gallup's fieldwork but belongs on the label. The useful read is that the tool is not the variable. Something about rollout, training, or which task it got pointed at separated the two thirds who felt a difference from the third who did not, and that is a question you can answer inside your own building for the price of asking two questions. Gallup →

Watch

Two models were asked to read a student's learning style off a chat log, and much of the accuracy was them guessing the most common answer

Samaneh Zamanifard, Sajad Goudarzi and Andrew Robb posted this to arXiv on October 20, 2026. They took short, task-focused problem-solving dialogues between students and an AI, and asked GPT-4o and Gemini 2.0 Flash to infer three Felder-Silverman learning-style dimensions. Ground truth came from the Index of Learning Styles questionnaire filled in by "153 undergraduate participants," with five-fold cross-validation and both zero-shot and few-shot prompting. Where the models posted moderate accuracy and F1, the authors report that performance was often explained by majority-class prediction, which is to say by guessing whichever label was most common. The models under-identified Intuitive and Global learners, few-shot prompting had mixed effects, and the Active-Reflective results were unstable between the two models. Their conclusion: "LLM-generated learner-style labels should be treated as uncertain, bias-prone signals rather than stable learner profiles," and they call for "bias-aware evaluation and uncertainty-sensitive design." The limits are large. The abstract reports no accuracy figures, so the strength cannot be checked from it. These are 153 undergraduates, not school-age children. It is an arXiv preprint with no peer-review status or funding stated on the abstract page. And the strongest counter-argument is about the yardstick rather than the models: the ground truth is a learning-styles questionnaire, an instrument whose own validity is contested in the learning-sciences literature, so a model failing to reproduce those labels is not cleanly a failure of the model. Gate 51 out of 100, Watch, scored in full on the research page. Worth knowing before the feature arrives in a pitch, because learner profiling is coming. Ask what the profile is checked against, and what actually changes in the software when the label changes. arXiv →

A read on trending research
Watch

The practice exercises it generated were rated strong 95.5 percent of the time. Naming what went wrong, 41.1 percent.

Arne Vanhoyweghen and nine coauthors posted "Evaluating LLM-Generated Feedback on Handwritten Mathematics: Feedback Quality and Subsequent Exam Performance" to arXiv on October 20, 2026, and the title is the reason it is here: it asks both halves of the question, which most of this field does not. GPT-5.1 generated feedback and practice exercises from handwritten university mathematics answers and their grades, across six weekly bonus tests in two cohorts, "English (n=343)" and "Dutch (n=236)". On quality, six reviewers scored "157 messages from three English-cohort tasks" against "six criteria scored from 0 to 3". The results split hard by criterion. The abstract reports the split in a single sentence: "The practice exercises received the highest proportion of strong ratings (95.5%), while diagnostic specificity (41.1%) and clarity and tone (33.4%) received fewer." Diagnostic specificity and clarity and tone are most of why a teacher writes in the margin at all. Feedback on the lowest-scoring answers was judged less actionable, which is the inverse of where help is needed most. Then the half almost nobody runs. The authors tested whether getting this feedback improved later exam performance and report "no statistically significant differences after adjustment across four comparisons." They also report that greater attendance and feedback exposure were associated with higher exam scores, and they are explicit that feedback's contribution could not be separated from attendance and practice. The major limits belong here rather than in a footnote, and they cut both ways. This is university mathematics in two cohorts, not a K-12 classroom. The null exam result is weak evidence rather than strong, because the authors themselves say the design cannot separate feedback from attendance and practice, so this is an open question rather than a demonstrated absence of effect. It is a 10-page arXiv preprint with no peer-review status, no preregistration and no funding statement on the abstract page, and the quality ratings rest on 157 messages from three tasks.

95.5%
Strong ratings for the
practice exercises it generated
41.1%
Strong ratings for diagnostic
specificity, which is naming
what actually went wrong
0 of 4
Exam-performance comparisons
that reached significance
after adjustment
What the reviewers rated strong
Share of strong ratings, by criterion
Practice exercises
95.5%
Diagnostic specificity
41.1%
Clarity and tone
33.4%
The content task scored well. The two diagnostic ones did not
Who was in it
University maths students, by cohort
English cohort
343
Dutch cohort
236
No school-age students. This is a caution, not a finding about your classrooms
Every figure is from the paper's abstract. Bar lengths are proportional within each card and are not comparable across cards. The percentages are shares of strong ratings on a 0 to 3 scale from six reviewers, covering 157 messages from three tasks in the English cohort only, so they describe that sample of feedback rather than the tool in general. "0 of 4" restates the abstract's report of no statistically significant differences after adjustment across four comparisons; it is a null result the authors say cannot be separated from attendance and practice, not a finding that the feedback had no effect. Research Integrity Gate 58 out of 100, Watch. The nine-dimension score, the devil's-advocate pass and every flag are on the research page.
What it means for your schools Read this as a map of which part of the job AI feedback is actually doing. Generating more practice on the thing a student got wrong, the reviewers liked, and that makes sense, because it is a content task with a clear specification. Saying precisely what went wrong, and saying it in a way a student can hear, were rated far lower, and those two things are most of why a teacher writes in the margin at all. Do not carry the exam result out of here as proof the feedback does not work. The authors are explicit that they cannot separate it from attendance, and it was university maths. Carry it as a correction to the demo. When a vendor shows you student work with AI feedback attached, the thing they point at is the paragraph of comments. Ask which of these jobs you are buying, and ask for the practice-generation half priced separately, because that is the part with the better rating here and it is probably the cheaper feature. And sit with the detail that should bother you most, because it is the one a pilot will not show you: the feedback got less actionable on the lowest-scoring answers. The students with the most wrong on the page got the least usable help, which is backwards from the entire reason you would buy it. Disclosure, and it is the one I always make: AI-generated practice and teaching materials are exactly my category. I am building My Planning Partner in that lane, so read my take knowing I have a horse in this race.

arXiv →   DOI →

Apply it

This week lines up unusually neatly. Out of more than 800 papers on AI in K-12, 20 produced strong causal evidence, and the federal agency that would fund more of it lost about 90 percent of its staff. A marketplace popular with teachers announced it will ban AI-generated resources and said it is still building the tool to find them. Two British universities are dropping a detection product, one of them saying the checker is largely ineffective against the risk everyone is actually worried about. A Gallup survey found 59 percent of educators used AI, and among those who did, 7 percent said it cost them time and 29 percent said it changed nothing. A fresh preprint rated AI-generated practice exercises strong 95.5 percent of the time and diagnostic specificity 41.1 percent, then found no statistically significant exam differences after adjustment across four comparisons. Notice what they all have in common. In every one of them the deflating detail is published by the source itself: the count of how little causal evidence exists, the marketplace conceding it cannot identify its own inventory, the university's own stated reason for walking away, the share of users who reported no time back, the authors' own null result. None of it came from a critic, and all of it is public. The gap this week is not between evidence and hype. It is between what the sources actually say and the one sentence that gets quoted from them.

Your one move this week Pick the AI claim your district is currently leaning on hardest, the one on the slide, and go find the source document it came from. Not the press release and not the summary. The study, the survey tables, or the policy text. Then read for the part that did not get quoted, because it is usually there: the other third of a survey question, a limitation paragraph, the sentence where the authors say what they could not separate. Give it twenty minutes and write down one sentence the source says that the slide does not. If you cannot find the source document at all, that is the finding, and it is a bigger one than anything in the document would have been.
That's it for this week. See you next Friday. Katie
Brought to you by Planning Partner
A studio for tomorrow's lesson.

Quality AI lesson planning that lifts instructional quality and cuts teacher workload at the same time. It closes the gap between your curriculum and student-ready instruction, and gives leaders visibility into how your instructional model is actually being implemented, without piling more onto teachers.

See Planning Partner →
The Margin · A weekly AI-in-education digest for education leaders
Compiled by AI against a bar a human set
My Planning Partner · @myplanningpartner