https://joeandseth.substack.com/p/prompt-writing-outsourcing-cognition
Resolution criteria
Resolves YES if, by 23:59:59 UTC on December 31, 2026, there is at least one publicly released empirical study with n > 1000 human participants that reports a statistically significant reduction in unassisted problem-solving performance for “heavy AI users” (as defined by the study: e.g., top-quantile usage logs, assigned heavy-use condition, or clearly specified frequent-use threshold) compared to lighter/non-users or to their own baseline when AI is not allowed during the outcome assessment (p < 0.05 or 95% CI excluding zero).
“Unassisted problem-solving” = tasks completed without AI access at test time (e.g., proctored exams, reasoning/problem-solving assessments where AI tools are prohibited).
n > 1000 refers to unique participants analyzed (not number of items/tasks/observations). Multi-site replications may aggregate across identical protocols if the combined participant count exceeds 1000.
Acceptable venues include peer-reviewed journals (e.g., PubMed-indexed) and credible preprints/working papers with methods and results (e.g., arXiv, SSRN). The resolver will link the qualifying study in a market comment.
Does NOT count: meta-analyses without an individual qualifying study; outcomes where AI use is allowed; purely attitudinal/self-reported “I feel worse at problem-solving”; studies where “heavy use” is undefined or only inferred without evidence (e.g., detector-only classification without reported error rates/validation).
If no such study is found by the deadline, resolves NO.
Background
A 2025 PNAS field experiment gave high-school students GPT-4 access during practice; performance improved with AI, but when access was removed, those exposed to an unfettered chatbot performed worse than peers who never had AI (a “crutch” effect). The sample was “nearly a thousand,” i.e., close to but not clearly >1000, so it would not by itself meet this market’s threshold. (pubmed.ncbi.nlm.nih.gov)
In higher education, an arXiv study found students identified as GenAI users scored on average 6.71/100 points lower on exams than non-users, suggesting potential learning drawbacks; sample size and measurement details determine eligibility for this market. (arxiv.org)
Considerations
Measurement of “heavy AI use” varies (usage logs vs. self-report vs. AI-detector inference); detector-only measures should report validation/error rates to count.
Causality: randomized exposure or credible quasi-experiments are stronger than cross-sectional correlations; both can qualify if they meet the criteria and test performance without AI present.
Large-n studies are likeliest in K–12/college or large online platforms; look for proctored, AI-prohibited assessments explicitly documented in methods sections (e.g., PubMed-indexed articles or arXiv/SSRN working papers). (jmir.org)
🏅 Top traders
| # | Trader | Total profit |
|---|---|---|
| 1 | Ṁ858 | |
| 2 | Ṁ32 | |
| 3 | Ṁ23 | |
| 4 | Ṁ11 | |
| 5 | Ṁ5 |
People are also trading
@JoeandSeth This looks like a qualifying study: Strömberg, Lei and Wu, “The Generative AI Learning Penalty: Evidence from Chinese Secondary Education” (SSRN 6868618, June 2026). 26,811 students in grades 7 to 12. Monthly closed-book exam scores fall 20% (1.4 SD) within six months of AI adoption, compared with non-users and the students’ own baseline, and the losses are concentrated in the 81% of users who outsource homework. PDF: https://conference.nber.org/conf_papers/f240545.pdf
@EvanWang11j3 that's a good study, thanks for sharing.
I'm undecided on interpretation, will read more. Right now I got stopped at the following line:
"By contrast, AI users who spend as much time on homework as non-users achieve
similar exam scores, even though their higher homework scores indicate that they use
AI. These students are not di§erentially selected on prior achievement, suggesting that
generative AI does not reduce their learning efficiency."
The study seems to imply that it's not the AI use per se but the outsourcing of all effort that causes the decline, which is honestly a better result than I'd have expected. Makes me hopeful, though.
Ah ok. The inevitability of adoption and that users who resisted initially end up outsourcing and spending less time after a few months changes my mind back. Resolving YES. The siren's song is sweet, indeed.
"our Finding that exam scores deteriorate gradually over time suggests
that homework outsourcing may undermine not only the retention of current material
but also the absorption of future material. This is a form of dynamic complementarity
in skill formation (Heckman and Corbin, 2016), where skills beget skills. It is also con-
sistent with recent evidence on "cognitive endurance," the capacity to sustain effortful
attention in improving cognitive ability (Brown et al., 2025)."