The illusion-of-fluency check

Find out, in a few minutes, which of the things you feel confident about you actually know.

When to use this: When checking yourself
Learning impact: Highest-leverage move
Learning evidence: Strong research tradition
Where you are with the topic: Checking readiness
How often to use it: Worth repeating often

When to use it

An exam is close and you feel ready about topics you have mostly re-read.
A topic feels comfortable and you want a four-minute test before you tick it off.
AI explanations have been easy to follow and you suspect following is not knowing.

What to ask AI

Say: “I think I understand [topic]. Test me in this order: state unaided; why; unfamiliar angle; where it fails. Don't teach. Be blunt about what I passed.”

Afterwards ask which failures mean you learned the presentation rather than the idea.

Keep notes closed while you answer.

How it helps

Think of a topic you would say you understand, not one you fear; one you would tick off. There is a good chance you cannot explain it, rearrange it, or bound it.

The feeling of understanding and the fact of understanding come apart routinely. That is the expensive failure, and it is invisible from the inside.

Fluency comes from re-reading, clear explanations, recognition, and tidy notes. Comfort maximises the feeling while doing little for command.

Four checks in order: produce; explain why; answer a rearranged question; say what would make it false. Question three catches most people; question four catches the rest.

How to run it

Pick a topic you feel good about, not a panic topic.
Close everything. Run the four prompts in order without teaching breaks.
Fail loudly: mark which step broke.
Study the failed step with a generative method (retrieval, problems), not another fluent re-read.
Re-run the check later on the same topic before you tick it off again.

Example exchange

You

I think I understand why the light-dependent reactions come before the Calvin cycle. Can you test whether I actually do, without teaching it?

Notes closed. State the core idea in about three sentences.

You

Light reactions make energy carriers; Calvin uses them to fix carbon; so light has to come first.

Why must ATP and NADPH be produced before carbon fixation, not merely because the textbook order says so?

You

Calvin's enzymes need those carriers as inputs. Without them the cycle stalls even if CO₂ is present.

One unfamiliar angle: what fails if light reactions run but a Calvin enzyme is inhibited? Answer in your own words.

Copyable prompt

I think I understand [TOPIC]. Test whether I actually do, in this order:
1. ask me to state the core idea unaided;
2. ask me WHY it's true, and tell me if I've just restated the what;
3. give me a question that uses it from an unfamiliar angle;
4. ask me what would make it false, or where it stops applying.
Don't teach me anything. After all four, tell me which I actually passed and be
blunt about it.

The Tell

If you pass every check on everything, you are either testing trivially or answering generously, including letting the AI teach mid-check.

A check that never fails is not a check.

Principle evidence

Strength of the underlying learning idea, not a claim about AI products.

Strong: illusion-of-fluency checks attack mistaking recognition and processing ease for learning, central to desirable-difficulties and retrieval-versus-re-reading research. The principle is about honest production under constraint.

AI delivery evidence

Whether an AI tutor delivers this method well is a separate question.

AI can administer the four prompts. Quality varies: models may teach mid-stream or accept restatements as why-explanations. Delivery speculative; your closed-book answers are the evidence.