Lecture 3-3: Short Checks, Well Made
Contents 31
- Lecture 1-1: Where Teaching Happens
- Lecture 1-2: Starting from the Evidence
- Lecture 1-3: Time, Room and a Plan B
- Lecture 1-4: Who Is in the Room
- Lecture 1-5: Practice Lab: A One-Page Lesson Plan
- Lecture 2-1: The First and the Last Three Minutes
- Lecture 2-2: Activities, Transitions and Clear Instructions
- Lecture 2-3: Room for Everyone
- Lecture 2-4: Teaching Through a Difficult Moment
- Lecture 2-5: Practice Lab, Ten Minutes Taught
- Lecture 3-1: How Do You Know They Learned
- Lecture 3-2: Assessment That Respects the Learner
- Lecture 3-3: Short Checks, Well Made
- Lecture 3-4: After the Lesson: Notes and One Change
- Lecture 3-5: Practice Lab: A Check for Your Plan
- Lecture 4-1: Watching a Lesson
- Lecture 4-2: Feedback to a Teacher
- Lecture 4-3: Hearing the Learners
- Lecture 4-4: Receiving Feedback
- Lecture 4-5: Practice Lab: The Observation Sheet
- Lecture 5-1: Children and Young People
- Lecture 5-2: Adults and Lay Training
- Lecture 5-3: Mixed Ages, Online and Blended
- Lecture 5-4: Lessons in Another Language or Culture
- Lecture 5-5: Practice Lab, One Lesson, Two Rooms
Lectures 3-1 and 3-2 said why to check and how not to harm. This lecture is the craft: how to make a short check that works. Most checks fail for small, ordinary reasons. The question does not match the goal. It asks two things at once. It can be answered "yes" or "no" by someone who understood nothing. Or it asks something so large that nobody knows where to begin.
A good check is usually small. One question, written beforehand, tied to the goal, that a learner can answer in a minute. With one simple scale for reading the answers, and a short record afterwards, a teacher can learn a great deal from a lesson in five minutes.
This lecture teaches five things: how to match a question to a goal, how to keep it to one thing, the difference between closed and open questions, the exit question, and a simple scale for reading what you get back. It ends with the short record that you will keep after each lesson.
What these 19 minutes give you
- Write a check question that matches the verb of a lesson's goal.
- Take a question that asks two things, or that can be answered without understanding, and repair it.
- Explain when a closed question helps and when an open question is needed, and write an exit question.
- Make a simple scale with whole-number levels, and use it to read learners' answers without ranking the learners.
Counsel in the heart of man is like deep water; but a man of understanding will draw it out." — Proverbs 20:5
World English Bible
He said to them, “What are you talking about as you walk, and are sad?”" — Luke 24:17
WEB
So when they had eaten their breakfast, Jesus said to Simon Peter, “Simon, son of Jonah, do you love me more than these?” He said to him, “Yes, Lord; you know that I have affection for you.” He said to him, “Feed my lambs.” He said to him again a second time, “Simon, son of Jonah, do you love me?” He said to him, “Yes, Lord; you know that I have affection for you.” He said to him, “Tend my sheep.” He said to him the third time, “Simon, son of Jonah, do you have affection for me?” Peter was grieved because he asked him the third time, “Do you have affection for me?” He said to him, “Lord, you know everything. You know that I have affection for you.” Jesus said to him, “Feed my sheep." — John 21:15-17
WEB
A question can draw out what a person has in them. The risen Jesus asks a question of two people who are walking and sad, and he asks Peter the same question again and again.
1. Match the question to the verb of the goal
A learning goal has a verb: tell, find, explain, list, use, compare. The check should ask the learner to do that verb.
(An invented example.) The goal is: "Each learner can explain in their own words why the helper in the story was a neighbour to the traveller." The verb is explain.
| Question | Does it match? |
|---|---|
| "Name the two men who passed by the traveller." | No. It asks the learner to name, not to explain. (The story gives their roles, not their names.) |
| "Which man was the neighbour, the priest or the helper?" | Weakly. A guess has a fifty per cent chance of being right, and nothing is explained. |
| "In one or two sentences, say why the helper was a neighbour to the traveller." | Yes. The learner has to explain. |
The most common mismatch is that the goal says explain and the check says name or choose, because those are easier to ask and easier to mark. If your goal is to explain, the learner must explain. If you cannot ask for that in the time you have, change the goal, not the check, and be honest that the lesson no longer aims to teach explaining.
2. One thing at a time
A question that asks for two things makes the answer impossible to read. Suppose a learner gives half an answer. You do not know which half is missing.
(An invented example.) "Who was Timothy, and what did Paul tell him to do about teaching?" The learner says, "A young man." Did she not know who Timothy was? Or did she not know what Paul said? Did she hear the second part at all?
The repair is simply to ask two questions, one after the other, or to choose the one that matters for today's goal. A useful habit is to read each check aloud and count the question marks and the "and"s. If there are two, split it.
3. Closed and open questions
A closed question has a short, right answer: "To which village were the two travellers walking?" An open question has many possible answers: "What do you think the two travellers felt on the road?"
Neither is better. They do different jobs.
| Kind | Use it to | Danger |
|---|---|---|
| Closed | Check a fact or a skill (a name, a place, finding a verse, a step in a prayer) quickly | Can be answered by a lucky guess; can make learners feel they are being tested for the "right" answer |
| Open | Find out how a learner thinks, what they noticed, how they connect the lesson to their life | Hard to read; some learners freeze when there is no single right answer; takes more time |
If the goal is a fact, a closed question is fine. If the goal is understanding or use, you need an open one. Often the best check uses both: a closed question to see that the learner has the facts, and then an open one to see what the learner does with them.
Be careful with the closed question that can be answered "yes" or "no." "Did the helper stop and help?" gets "yes" from anyone who half-listened. Ask "What did the helper do?" and the learner must show that they know.
4. Waiting for the answer
Proverbs 20:5 compares counsel in a person's heart to deep water, and says that a person of understanding will draw it out. A learner's answer is often deep water. It does not come at once.
A teacher who asks a question and answers it three seconds later teaches learners that they do not need to answer. After you ask, wait. Count slowly to ten in your head. Some of your learners are thinking in a second language. Some are shy. Some are working out what they want to say. Waiting costs a little time, and it often gives you the evidence you wanted. Single skills of questioning and of silence are taught in The Art of Teaching (LM402E). Here we only note that a check needs a pause.
5. An open question that starts where the learner is
In Luke 24:17 the risen Jesus comes up beside two people who are walking and says, "What are you talking about as you walk, and are sad?" He does not begin by telling them. He asks them to say what is on their minds, and the following verses show that he listens before he teaches. A check can begin in the same way: "What stayed with you from last week?" is an open question that starts where the learner is, not where the lesson wanted them to be.
6. Asking again
In John 21:15-17, Jesus asks Peter a question, and Peter answers. Jesus asks it again, and Peter answers again. He asks it a third time, and Peter is grieved. Readers have explained this scene in several ways, and we do not need to choose among them here. A plain point that a teacher may take is this: a question may be asked more than once, and the first answer need not be the last. A learner who gave a short answer may give a fuller one when asked again, in other words, after a pause or in a different way. A good teacher does not decide on the first answer.
7. The exit question
An exit question is one question, asked in the last two or three minutes, whose answer the learner gives on the way out: on a slip, aloud to a partner, or in a word to you at the door. It tells you, before the next lesson, whether the aim was met.
A good exit question has four marks.
- It matches the goal.
- It asks one thing.
- It can be answered in under a minute.
- It does not need a name on it.
Examples (all invented):
- "Write one sentence: what did the helper in the story do?"
- "Find John 3:16 in your Bible and put your finger on it." (A skill check: you can see it at a glance.)
- "Tell the person next to you one thing you will remember from today."
Do not make exit questions into tests. They are a quick look. If learners can see that you read them and that nothing bad comes of a wrong one, they will answer honestly.
8. A simple scale for reading what you get back
When you have a pile of slips, you need a way to read them. A rubric is a short description of what an answer looks like at a few levels. It is a tool for the teacher. It is not a mark for the learner, and it does not rank the learner. It tells you how the lesson did.
Keep it small. Three or four whole-number levels are enough. Describe each in words you can see in an answer.
(An invented example.) For the goal "explain in own words why the helper was a neighbour", the scale is:
| Level | What the answer shows |
|---|---|
| 3 | Says what the helper did and gives a reason (he saw the need and acted, at a cost) |
| 2 | Says what the helper did, without a reason |
| 1 | Gives a part of the story that does not answer the question |
| 0 | No answer, or an answer that does not relate to the story |
Now go through the slips. Make a tally, not a list of names: perhaps eight slips at level 3, six at level 2, three at level 1, one at level 0. What does that tell you? If most answers are at level 2, the lesson got the learners to the facts but did not carry the reason. That is useful, and it points to what to change in the lesson.
Three cautions. Do not give fractions or half-points: whole numbers keep the scale simple and honest. Do not add up the levels into a "class score" and hang it on the wall. And do not use the levels to say anything about a learner's faith. A level 1 answer means the explanation was thin, nothing more.
9. A short record after the lesson
After the lesson, write four lines. Lecture 3-4 shows how to keep and use them.
- The goal (copy it).
- The evidence (what you saw or heard, in numbers if you tallied).
- Where they stuck.
- One thing to change.
10. Before and after
(An invented example.) A teacher is leading an evening group on the account of Jesus and the two travellers in Luke 24. The goal: "Learners can tell what the two travellers did when they recognised Jesus, and say one way the story could shape a person's evening."
Before. "Wasn't that a lovely story? Any questions? Do you all see how it applies to your life?" The room is silent. The teacher is pleased, and has learned nothing.
After. At the end the teacher says: "Write one sentence. What did the two travellers do when they recognised him? Then, if you like, write one thing the story might mean for an evening in your own week. Do not put your name." She gathers the slips as people leave, reads them at home and makes a tally against a three-level scale.
The second version takes four minutes. It asks for a specific act (tell what they did), it asks one thing at a time, it gives permission to leave the second part, and it keeps names off. It also gives her something to read.
Diagram 1. Repairing a check question
Diagram 2. The after-lesson record
| Line | Write |
|---|---|
| The goal | Copy it from your plan |
| The evidence | What you saw or heard (a tally, if you used a scale) |
| Where they stuck | The point at which answers thinned |
| One thing to change | One change only |
In short
- Match the question to the verb of the goal. If the goal says explain, the check must ask for an explanation.
- Ask one thing at a time. Count the question marks and the "and"s, and split any question that asks two things.
- Closed questions check facts and skills quickly; open questions show how a learner thinks. A "yes or no" question tells you little.
- An exit question is one short question tied to the goal, answerable in a minute, with no name on it.
- A simple scale with whole-number levels reads the answers for the teacher. Tally the answers; do not rank the people.
- After each lesson write four lines: the goal, the evidence, where they stuck, one thing to change.
| Front | Back |
|---|---|
| What a check question must match | The verb of the goal: if the goal is to explain, the learner must explain. |
| Closed and open questions | Closed: a short, right answer for facts and skills. Open: many answers, to see how the learner thinks. |
| An exit question | One question tied to the goal, answered in about a minute, with no name on it. |
| The four lines after a lesson | The goal, the evidence, where they stuck, one thing to change. |
One sentence to remember A good check asks one thing, matches the goal, and gives the teacher something to read.
This week's action Write one exit question for your next lesson. Test it with the four tests in the diagram, read it aloud, and split it if it asks two things.
Check yourself
Not "did you read it" but "can you explain it". Ticks are kept on this device only.
Reflection and discussion
- Take one goal from a lesson you know. What is its verb? Write a check question that asks the learner to do that verb.
- Find a question you have asked, or heard, that asked two things at once. How would you split it?
- When would you choose a closed question, and when an open one? Give an example of each.
- Why does it help to read the answers as a tally and not as a list of names?
- Why does a teacher wait for ten seconds after a question, and what would make that hard in your place?