Lecture 6-1: Piloting and Revising
Contents 31
- Lecture 1-1: A Curriculum Is a Promise
- Lecture 1-2: Looking at What You Already Have
- Lecture 1-3: Who Plans With You
- Lecture 1-4: Starting Small: A One-Year Frame
- Lecture 1-5: Practice Lab: A One-Page Survey of What We Have
- Lecture 2-1: Knowing, Doing, Becoming
- Lecture 2-2: Writing Goals You Can Observe
- Lecture 2-3: Goals and Your Tradition's Teaching
- Lecture 2-4: Goals for People Who Start From Different Places
- Lecture 2-5: Practice Lab: Three Goals for One Group
- Lecture 3-1: The Big Picture Across Ages
- Lecture 3-2: The Shape of a Year
- Lecture 3-3: Designing One Unit
- Lecture 3-4: Order, Pace and Return
- Lecture 3-5: Practice Lab: One Unit on One Page
- Lecture 4-1: Judging a Published Curriculum
- Lecture 4-2: Adapting and Making Your Own
- Lecture 4-3: One Room, Many Ages
- Lecture 4-4: Cost, Time and Language
- Lecture 4-5: Practice Lab: Checking One Material
- Lecture 5-1: What to Look For
- Lecture 5-2: Asking Teachers
- Lecture 5-3: Hearing Learners and Parents
- Lecture 5-4: Records and Privacy
- Lecture 5-5: Practice Lab: Three Questions to Look Back on One Unit
Imagine a coordinator who has spent the winter writing a plan for the whole children's programme. It has goals, a scope chart and eight unit frames. In September she gives it to six teachers and tells them to begin. By November two teachers have quietly dropped a unit because it needed materials nobody had. One unit runs far too long. One unit works so well that the children ask for more. The coordinator did not know any of this when she wrote the plan. She could not have known. A plan on paper has been checked only against the mind of its author.
This lecture is about the step between writing a plan and trusting it. That step is a pilot: you try a piece of the plan with one group or one unit, you watch honestly, you keep short notes, and you change what the trial shows must change. After the pilot comes revision, which is not a sign that the plan was bad. Revision is how a plan becomes a curriculum that fits real people.
This links to the central claim of the course: a curriculum is a promise, so look honestly at what is, start small, plan with the people, and rewrite it every year. Piloting is "start small" put into practice. Revising is "rewrite it every year" put into practice.
What these 22 minutes give you
- Explain what a pilot is and why a small trial comes before a full launch.
- Choose one group or one unit as a pilot and say what you will watch for.
- Keep simple pilot notes in a form a busy teacher can use.
- Sort the findings of a pilot into what to keep, what to change and what to cut.
- Say why a curriculum is a document that is rewritten, and not a monument.
For which of you, desiring to build a tower, doesn’t first sit down and count the cost, to see if he has enough to complete it? Or perhaps, when he has laid a foundation, and is not able to finish, everyone who sees begins to mock him, saying, ‘This man began to build, and wasn’t able to finish.’" — Luke 14:28-30
World English Bible
Commit your deeds to Yahweh, and your plans shall succeed." — Proverbs 16:3
WEB
In the morning sow your seed, and in the evening don’t withhold your hand; for you don’t know which will prosper, whether this or that, or whether they both will be equally good." — Ecclesiastes 11:6
WEB
The first passage is about counting before building, which a pilot does at small scale. The second asks that plans be handed over to God, not held as our own possession; that is a good attitude for a plan that will be changed. The third is a gardener's honesty: we do not know which seed will grow, so we sow in more than one place and look.
1. Why not simply begin?
A reader may ask why a pilot is needed at all. The plan was written with care, with the teachers, after a survey. Why not use it?
There is a strong reason for this view, and it deserves a fair statement. A pilot costs time. A small congregation may have only one group per age band, so a "pilot with one group" is the whole programme. Teachers may be tired of changes and want a plan to follow, not a trial. Some traditions also hold that the teaching of the church is not an experiment: the faith is received, and a programme that teaches it should not be treated like a test.
All of that is true in its place. This lecture does not say that the faith is a trial. It says that the plan for teaching the faith is made by people, and people make plans that do not fit. A pilot tests the plan, not the faith. The units, the timing, the room, the length of a session, the reading level of a handout and the number of helpers needed are all things a plan can get wrong without any doctrine being at stake.
The tower in Luke 14 is a picture of what a pilot protects against. The builder who stops half-way is mocked. The cost of a half-finished curriculum is not mockery only. It is teachers who are tired, learners who were told one thing and given another, and a congregation that stops believing the next plan. A small trial lets you count the cost before the whole tower goes up.
2. What can be piloted
You can pilot at three sizes. Choose the smallest that will teach you something.
| Size | What you try | Good for | Weakness |
|---|---|---|---|
| One session | A single lesson or activity from a unit | Checking timing, wording, whether an activity works | Tells you little about the whole unit |
| One unit | A whole six-to-eight-week unit with one group | Checking the shape, pace and fit with the goals | Needs a willing teacher and a willing group |
| One group for a term | Everything planned for one age band for a term | Checking how units follow each other and how the teacher copes | Takes a long time; a mistake lasts for weeks |
Most congregations will do best with one unit. A single session is too small to show how a unit's pace feels. A whole term is too large to correct if something goes wrong.
A small assembly with only one mixed-age group has one option, and it is a good one: pilot a single unit, and tell everyone that it is a trial. A cathedral parish with a large programme may pilot a unit in one class of an age band while the other classes carry on with what they had. A liturgical community may choose a unit that follows one season of the church year, such as a unit for Lent, so that the pilot and the season fit together. A free-church community may choose the next unit that begins after a break, such as the start of a term.
When you choose a pilot, think about three things.
- A willing teacher. Do not ask a teacher to pilot something she doubts. A reluctant teacher will give you a reluctant pilot, and you will not know whether the plan failed or whether the teacher was unconvinced.
- A group that is not unusual. A group of unusually quiet, unusually lively or unusually small learners will teach you about that group. If you cannot find an ordinary group, say so in your notes.
- A unit that matters. A pilot of a minor unit that nobody cares about will produce minor attention. Choose a unit that carries a real goal from your plan.
3. Say what the pilot is for
Before the pilot begins, write down on a half page what you want to learn. A vague "let's see how it goes" is not a plan. Choose three or four questions, such as these.
- Did the unit fit into the time we gave it?
- Could the teacher prepare it in the time she had, with the materials she could get?
- Could the learners do what the goals say? (See what can be seen; lecture 5-1 explains how to look.)
- Was there something in the unit that confused, bored or troubled learners?
- What did the teacher need that we did not give her?
The questions turn the pilot from a hope into a test. They also tell the teacher what you will be looking at, so that she knows the pilot is about the unit and not about her. This point is important and is worth saying aloud. A pilot judges the plan, never the teacher. Say it at the start, and say it again at the end.
4. Keep notes that can be kept
Pilot notes fail for one reason: they take too long to write. A volunteer teacher after a session is tired and wants to go home. If the notes take twenty minutes, they will not be written.
A good pilot note takes five minutes and has five lines.
A five-line pilot note (an invented example)
Date and session: 14 October, session 3 of 7. What happened as planned: The story reading and the questions worked; the children spoke freely. What did not: The craft took twenty-five minutes, not ten. We ran out of time for the closing prayer. What I saw (not guessed): Four of the six children could retell the story in their own words. Two could not. One change I would make: Cut the craft to a simple drawing, and keep the prayer.
Look at what this note does and does not do. It records what happened, separately from what the teacher guessed. It names no child. It ends with one change, so that the note leads somewhere. And it can be written by someone who is tired.
Who writes the note? Ideally the teacher, but a helper or the coordinator may write it after a short talk. In a very small group where there is one teacher and no helper, a few lines written the same evening, or spoken to the coordinator by telephone, will do. Do not ask for more than the teacher can give.
5. Deciding what to change
At the end of the pilot you have notes, perhaps a short conversation with the teacher, and perhaps a few words from learners or parents (lectures 5-2 and 5-3 describe how to ask). Now comes the difficult part: deciding what to do.
A beginner's mistake is to change everything that went wrong. A second mistake is to change nothing because the pilot "mostly worked". A better way is to sort every finding into one of three piles.
Keep. What worked and fits the goals. Mark it, so that nobody removes it in a later revision without a reason.
Change. What did not work, but where the goal behind it is still right. The craft ran too long, but the goal of letting children make something with their hands is a good one; so change the craft, not the goal.
Cut. What did not work and is not needed. If a section serves no goal in your plan, a pilot is a good moment to see that and let it go.
Each finding should be tested by three questions, in this order:
- Does it touch one of our goals? If a finding has nothing to do with a goal, it is a matter of taste. Note it, but do not rewrite the plan for it.
- Did we see it, or were we told? A thing seen in two or three sessions is stronger than a remark made once. A remark is still worth hearing, but it is a lead, not a proof.
- Can we fix it with what we have? A finding that needs money, a room or a teacher you do not have must be placed on a waiting list, not into this year's revision.
The third question is for the small congregation above all. A long list of improvements that nobody can carry out is worse than a short one that will be done.
6. Revise a little, and write the change down
Make the changes while the pilot is fresh, within two or three weeks. Write the revised unit on a new page and keep the old page beside it, with a date. The old page is not clutter. It is the record of why the plan changed, and it will save a later coordinator from re-making a mistake. Lecture 6-3 says more about keeping the record.
Then tell the people who were involved what you changed and why. A teacher who gave notes and sees nothing change will give fewer notes next time. A teacher who sees that a note cut the craft to a drawing will give more.
Resist the wish to pilot again, and again, and again. A second pilot is useful when a change was large. A third is rarely useful. At some point the plan must be used by everyone, with the knowledge that it will be revised again after the next year. Perfect plans are not available. A plan that is honest about its limits and rewritten when needed is better than one that is waiting for perfection.
7. A curriculum is a document you rewrite
Proverbs 16:3 says: "Commit your deeds to Yahweh, and your plans shall succeed." The verse is sometimes read as a promise that if we pray, our plans will work as written. A more careful reading, and one many traditions share, is that the plan is offered to God, not defended against change. A plan offered in this way can be changed without grief, because it was never ours to guard.
The same attitude helps with Ecclesiastes 11:6. "You don't know which will prosper." The teacher who sows a unit in the morning and another in the evening is not showing a lack of faith. She is doing what a gardener does. After the season she looks at what grew.
For the coordinator, then, a curriculum is not a monument. It is closer to a recipe book in a working kitchen: the pages are stained, the margins carry notes, some dishes are crossed out and some are marked with a star. That is a sign that the book is in use.
A boundary. A pilot tests how the plan works. It does not decide what the church teaches. What your tradition holds about God, Scripture and the faith is not revised on the strength of a pilot. If a pilot shows that learners misunderstood a teaching, the right response is to ask whether the unit explained it well, not to change the teaching. How to write goals that are faithful to your tradition is the work of lecture 2-3.
For the theory of why a curriculum changes and how it relates to what a church intends, the course on Christian education (PT5E) is the right place. For how a single teacher gives a single lesson more effectively, see LM402E.
Diagram 1. The pilot cycle
In short
- A pilot tries a small piece of the plan, usually one unit with one group, before the whole plan is used; it tests the plan, not the faith and not the teacher.
- Before the pilot, write three or four questions it must answer; a vague "let's see how it goes" teaches little.
- A good pilot note takes five minutes, separates what was seen from what was guessed, names no learner, and ends with one change.
- Sort findings into keep, change and cut, and test each by three questions: does it touch a goal, was it seen, can we fix it with what we have?
- Revise within a few weeks, keep the old page beside the new one, and tell the teachers what changed.
- A curriculum is a document you rewrite; revision is how a plan becomes fitted to real people.
| Front | Back |
|---|---|
| What is a pilot? | A small trial, usually one unit with one group, that tests the plan before it is used everywhere. |
| Keep, change, cut | Keep what works and serves a goal; change what fails where the goal is right; cut what serves no goal. |
| Three questions for a finding | Does it touch a goal? Did we see it? Can we fix it with what we have? |
| Who is judged in a pilot? | The plan, never the teacher. |
One sentence to remember Try it small, write down what you see, change a few things, and keep the old page beside the new one.
This week's action Choose one unit of your plan to try first, and write on half a page the three questions the trial must answer.
Check yourself
Not "did you read it" but "can you explain it". Ticks are kept on this device only.
Reflection and discussion
- If you had to pilot one unit in your congregation next term, which would you choose, and why that one and not another?
- What would make a teacher in your community feel that a pilot was a judgement on her? What could you say or do to prevent it?
- Write one pilot note for a session you remember, using the five lines. Which line was hardest to write honestly?
- Think of a plan or programme in your community that was launched in full and then quietly dropped. What might a pilot have shown beforehand?
- Where does your tradition draw the line between what a pilot may change (timing, activity, wording) and what it may not (the teaching itself)?
- In a very small group, who could be the "second pair of eyes" for a pilot note?