# Problem first, prompt second

- Link: https://arqiv.si/teachers/problem-first/
- Published: 2026-10-02T21:06:56-04:00
- Author: Steven Ryan

[Skip to content](https://arqiv.si/teachers/problem-first/#main-content)

[arqiv](https://arqiv.si/)

[For educators](https://arqiv.si/teachers/)

Teach

 * [Start here](https://arqiv.si/teachers/)
 * [Lessons & printable kits](https://arqiv.si/teachers/resources/)
 * [Classroom labs](https://arqiv.si/teachers/labs/)
 * [Free 20-minute lesson](https://arqiv.si/teachers/free-ai-lesson/)

Plan

 * [Curriculum guide](https://arqiv.si/teachers/curriculum/)
 * [AI Learning Center](https://arqiv.si/teachers/ai-literacy/)
 * [Future of work unit](https://arqiv.si/future-of-work/)
 * [What the research says](https://arqiv.si/teachers/what-works/)
 * [AI education worldwide](https://arqiv.si/teachers/around-the-world/)

Understand

 * [Think First method](https://arqiv.si/teachers/think-first/)
 * [Our approach](https://arqiv.si/research/#our-method)
 * [AI vocabulary](https://arqiv.si/teachers/ai-vocabulary/)

By role

 * [Counselors](https://arqiv.si/counselors/)
 * [School leaders & PD](https://arqiv.si/schools/)
 * [Speaking & workshops](https://arqiv.si/speaking/)
 * [Products](https://arqiv.si/products/)

[Learn AI](https://arqiv.si/ai/topics/)

Start

 * [All AI topics](https://arqiv.si/ai/topics/)
 * [The AI journey, from zero](https://arqiv.si/ai/)
 * [Using AI well](https://arqiv.si/ai/talking-to-ai/)
 * [AI builds](https://arqiv.si/ai-builds/)

AI in the world

 * [Space](https://arqiv.si/space/)
 * [Weather](https://arqiv.si/weather/)
 * [Health](https://arqiv.si/health/)
 * [Engineering](https://arqiv.si/engineering/)
 * [Farming](https://arqiv.si/farming/)
 * [Quantum](https://arqiv.si/quantum/)

What it means

 * [Future of work](https://arqiv.si/future-of-work/)
 * [Your AI path](https://arqiv.si/ai/your-path/)
 * [Research, explained](https://arqiv.si/research/)

[Games & labs](https://arqiv.si/games/)[Research](https://arqiv.si/research/)[Blog](https://arqiv.si/blog/)
[About](https://arqiv.si/about/)

[Search or ask](https://arqiv.si/ai/topics/)[Newsletter](https://arqiv.si/newsletter/)
[ARQIV.FM ↗](https://arqiv.fm/)

Menu

For educators

[For educators: start page →](https://arqiv.si/teachers/)

Teach

 * [Start here](https://arqiv.si/teachers/)
 * [Lessons & printable kits](https://arqiv.si/teachers/resources/)
 * [Classroom labs](https://arqiv.si/teachers/labs/)
 * [Free 20-minute lesson](https://arqiv.si/teachers/free-ai-lesson/)

Plan

 * [Curriculum guide](https://arqiv.si/teachers/curriculum/)
 * [AI Learning Center](https://arqiv.si/teachers/ai-literacy/)
 * [Future of work unit](https://arqiv.si/future-of-work/)
 * [What the research says](https://arqiv.si/teachers/what-works/)
 * [AI education worldwide](https://arqiv.si/teachers/around-the-world/)

Understand

 * [Think First method](https://arqiv.si/teachers/think-first/)
 * [Our approach](https://arqiv.si/research/#our-method)
 * [AI vocabulary](https://arqiv.si/teachers/ai-vocabulary/)

By role

 * [Counselors](https://arqiv.si/counselors/)
 * [School leaders & PD](https://arqiv.si/schools/)
 * [Speaking & workshops](https://arqiv.si/speaking/)
 * [Products](https://arqiv.si/products/)

Learn AI

[Learn AI: start page →](https://arqiv.si/ai/topics/)

Start

 * [All AI topics](https://arqiv.si/ai/topics/)
 * [The AI journey, from zero](https://arqiv.si/ai/)
 * [Using AI well](https://arqiv.si/ai/talking-to-ai/)
 * [AI builds](https://arqiv.si/ai-builds/)

AI in the world

 * [Space](https://arqiv.si/space/)
 * [Weather](https://arqiv.si/weather/)
 * [Health](https://arqiv.si/health/)
 * [Engineering](https://arqiv.si/engineering/)
 * [Farming](https://arqiv.si/farming/)
 * [Quantum](https://arqiv.si/quantum/)

What it means

 * [Future of work](https://arqiv.si/future-of-work/)
 * [Your AI path](https://arqiv.si/ai/your-path/)
 * [Research, explained](https://arqiv.si/research/)

 * [Games & labs](https://arqiv.si/games/)
 * [Research](https://arqiv.si/research/)
 * [Blog](https://arqiv.si/blog/)
 * [About](https://arqiv.si/about/)

[Get the newsletter](https://arqiv.si/newsletter/)

[Start here](https://arqiv.si/teachers/)[Lessons & kits](https://arqiv.si/teachers/resources/)
[Curriculum](https://arqiv.si/teachers/curriculum/)[Labs](https://arqiv.si/teachers/labs/)
[Think First](https://arqiv.si/teachers/think-first/)[AI vocabulary](https://arqiv.si/teachers/ai-vocabulary/)
[For schools](https://arqiv.si/schools/)[Counselors](https://arqiv.si/counselors/)

Lesson · Logic & problem solving

# Problem first, _prompt second_

Students solve a real problem on paper using a four-step method, estimate the answer,
and then perform an “autopsy” on an AI solution that sounds right but isn’t.

**Level 1** AI after thinkingGrades 6–1245 minutesMath · SciencePaper only (AI sample
provided)

The big idea

### If you can’t estimate the answer, you can’t tell when a machine gets it wrong.

**Students will be able to, without AI:**

 * Use a four-step problem-solving method
 * Estimate before calculating
 * Find and explain an error in a confident-sounding solution
 * Explain a solution so a younger student could follow it

Lesson flow · the 5 P’s

## Think first. _Then_ the tool.

Most of the lesson happens on paper. AI appears for one short, structured phase,
and the teacher can run it from a single projector screen. [How the 5 P’s work →](https://arqiv.si/teachers/think-first/)

1

### Ponder

12 min○ Screens off · paper only

Students meet the problem with pencils only. They use George Pólya’s classic four
steps from _How to Solve It_ (1945): understand, plan, solve, look back.

 1. **The problem:** A school has 600 students. Three-quarters ride the bus. Each bus
    holds 54 students. How many buses does the school need?
 2. **Understand:** What do you know? What are you asked? Circle the trap words.
 3. **Estimate:** Before calculating, about how many buses? Write it down.
 4. **Solve:** Work it out on paper.
 5. **Look back:** Does your answer make sense in the real world?

Say to students“Calculators didn’t make math class pointless; they made checking
more important. AI is the same.”

2

### Plan

5 min○ Screens off · paper only

Students write what a correct answer must look like before seeing the AI’s.

 1. A correct answer must be about ___ because ___.
 2. List one mistake you think is easy to make here.

3

### Partner

8 min● AI on · teacher screen or lab

Students receive an AI-written solution (printed on the worksheet, or shown by the
teacher). It is fluent, confident and wrong.

 1. Optional: on the teacher’s screen, ask a current AI the same problem and compare.(
    Today’s AI often gets this right. That’s fine: the skill is checking.)

“First, 3/4 of 600 is 450 students who ride the bus. Next, divide 450 by 54 seats
per bus: 450 ÷ 54 = 8.33. Since you can’t have part of a bus, round to the nearest
whole number. The school needs 8 buses.”

4

### Probe

12 min○ Screens off · paper only

Screens off. Students do an **answer autopsy**.

 1. Check each step. Which steps are correct?
 2. Find the error. (8 buses only carry 432 students, leaving 18 behind. You must round
    _up_ to 9.)
 3. Compare the AI’s answer with your estimate. Would your estimate have caught it?
 4. Write the rule the AI broke in your own words.

5

### Prove

8 min○ Screens off · paper only

Students show they own the skill without any help.

 1. Solve the twin problem on the worksheet with no help.
 2. Explain the bus problem so a 5th grader could understand it.
 3. Exit ticket: “The best way to check an AI’s math is…”
 4. **Teacher key (twin problem):** 920 ÷ 15 = 61⅓ (about 61.33), so 62 vans. 61 vans
    carry only 915 people and leave 5 behind.

Printable

## Student _worksheet_

Print one per student. Everything students hand in is handwritten, so their thinking
is visible.

### Answer autopsy

Solve it yourself first. Then check the AI.

Name:Date:Class:

**1 · Understand: what do I know and what am I asked?**

**2 · My estimate before calculating**

**3 · My solution**

**4 · The AI’s solution**

3/4 of 600 = 450 students ride the bus. 450 ÷ 54 = 8.33 You can’t have part of a
bus, so round to the nearest whole number. Answer: 8 buses.

**5 · Where is the error, and what rule did the AI break?**

**6 · Twin problem: 920 people attend a game. Vans hold 15 people. How many vans
to bring everyone home?**

**7 · Explain the bus problem to a 5th grader**

Assessment

## Grade the _thinking_, not the output

Every row scores something students did themselves. An AI can produce a product;
it can’t produce a student’s reasons.

| Criteria | 4 · Excellent | 3 · Solid | 2 · Developing | 1 · Beginning | 
| Understanding & estimate | Identifies key info and a reasonable estimate with reasoning | Reasonable estimate | Estimate off or unexplained | No estimate | 
| Own solution | Correct with clear steps and correct rounding | Correct with minor gaps | Partially correct | Incorrect | 
| Answer autopsy | Finds the error, explains why it matters in the real world | Finds the error | Senses something wrong but can’t locate it | Accepts the AI answer | 
| Explanation | A younger student could follow it | Mostly clear | Confusing in parts | Missing |

Why this is hard to cheat

The AI answer is supplied, so there’s nothing to gain by looking one up. The twin
problem and the “explain it to a 5th grader” task are done in class on paper.

Adjust it

**Younger students:** Use smaller numbers (60 students, buses of 25) and pictures
of buses to count.

**Older students:** Have students write their own “trap” problem and a fluent but
wrong AI-style solution for a classmate to autopsy.

**No devices at all?** Already device-free. The AI solution is printed on the worksheet.

Discussion questions

 * Why does a wrong answer feel more believable when it’s written confidently?
 * When is a small error dangerous in real life? (Medicine doses, bridge loads, 
   budgets.)
 * Should you trust a calculator? An AI? What’s the difference?
 * What habits help you catch your own mistakes?

Extensions & connections

 * Science version: give an AI-style lab conclusion that ignores a variable and 
   have students find it.
 * Connect to how AI can be confidently wrong: [how transformers predict words](https://arqiv.si/ai/transformers/).
 * Careers: engineers, pharmacists and accountants all check numbers for a living.

[← Previous lesson**The detective’s notebook**](https://arqiv.si/teachers/detectives-notebook/)
[Next lesson →**The thought experiment lab**](https://arqiv.si/teachers/thought-experiment-lab/)

Put curiosity to work

## Read it. Try it. Question it.

Explore new AI research, or take a paper-first investigation into your classroom.

[Classroom starter pack →](https://arqiv.si/teachers/classroom-starter-pack/)[Research explained →](https://arqiv.si/research/)

[arqiv](https://arqiv.si/)

A little understanding changes everything.

[LISTEN: ARQIV.FM, OUR WEEKLY SHOW ↗](https://arqiv.fm/)

Educators

 * [Start here](https://arqiv.si/teachers/)
 * [Lessons & kits](https://arqiv.si/teachers/resources/)
 * [Curriculum](https://arqiv.si/teachers/curriculum/)
 * [Labs](https://arqiv.si/teachers/labs/)
 * [AI vocabulary](https://arqiv.si/teachers/ai-vocabulary/)

For your role

 * [Counselors](https://arqiv.si/counselors/)
 * [School leaders & PD](https://arqiv.si/schools/)
 * [Speaking & workshops](https://arqiv.si/speaking/)
 * [Products](https://arqiv.si/products/)

Learn

 * [Learn AI](https://arqiv.si/ai/topics/)
 * [Games & labs](https://arqiv.si/games/)
 * [Future of work](https://arqiv.si/future-of-work/)
 * [Research](https://arqiv.si/research/)
 * [Headlines](https://arqiv.si/news/)

ARQIV

 * [About & corrections](https://arqiv.si/about/)
 * [Our approach](https://arqiv.si/research/#our-method)
 * [Newsletter](https://arqiv.si/newsletter/)
 * [Privacy](https://arqiv.si/privacy-policy/)
 * [Get in touch](https://arqiv.si/teachers/problem-first/info@arqiv.fm)

Classroom activities collect no student data.[info@arqiv.fm](https://arqiv.si/teachers/problem-first/info@arqiv.fm)
