FREE

Course certificates are free until March 31, 2027.

PT737E Understanding AI for Ministry

Lecture 2-4: Building a Checking Plan

Contents 31
PT737E Understanding AI for Ministry
Chapter 0 · Introduction: A Tool That Continues Words
  1. Introduction: A Tool That Continues Words
Chapter 1 · Week 1: What AI Is
  1. Lecture 1-1: What the Word "AI" Points To
  2. Lecture 1-2: How a Language Model Makes Words
  3. Lecture 1-3: Sounding Right Is Not Knowing
  4. Lecture 1-4: Reading a Conversation Closely
  5. Lecture 1-5: Practice Lab, Read an AI Answer
Chapter 2 · Week 2: Limits and Errors
  1. Lecture 2-1: Invented Facts
  2. Lecture 2-2: Old Knowledge, Missing Sources, Uneven Coverage
  3. Lecture 2-3: Scripture and Theology, Where to Be Most Careful
  4. Lecture 2-4: Building a Checking Plan
  5. Lecture 2-5: Practice Lab, Find the Errors
Chapter 3 · Week 3: Asking, Checking, Protecting
  1. Lecture 3-1: Asking Well
  2. Lecture 3-2: Checking What You Are Given
  3. Lecture 3-3: What Must Never Be Typed In
  4. Lecture 3-4: Keeping Notes and Giving Credit
  5. Lecture 3-5: Practice Lab, Mend the Prompts, Mark the Secrets
Chapter 4 · Week 4: Ministry Work: Administration and Teaching
  1. Lecture 4-1: Hand It Over, Help With It, Keep It
  2. Lecture 4-2: Office Work and Communication
  3. Lecture 4-3: Teaching and Study Materials
  4. Lecture 4-4: Where Teachers and Leaders Draw the Line
  5. Lecture 4-5: Practice Lab: Hand Over, Help, or Keep
Chapter 5 · Week 5: Preaching and Care
  1. Lecture 5-1: Preaching and AI: A Theological Question
  2. Lecture 5-2: Care and Counselling
  3. Lecture 5-3: When Members and Young People Use AI
  4. Lecture 5-4: The Minister's Own Life
  5. Lecture 5-5: Practice Lab: Judge the Scene, Write a Position Paragraph
Chapter 6 · Week 6: Staying Responsible for the Long Run
  1. Lecture 6-1: The Learner's Honesty
  2. Lecture 6-2: A Community's Policy
  3. Lecture 6-3: Technology That Keeps Changing
  4. Lecture 6-4: Writing Your Own Rule
  5. Lecture 6-5: Practice Lab, My Personal Guidelines

Jump to the key points ↓

15 min

The first three lectures of this chapter described how an AI tool goes wrong. This lecture is about what a minister does about it. The answer is not a rule such as "never trust it", which nobody keeps, nor "trust it when it sounds sure", which fails. The answer is a checking plan: a short, ordered habit that decides, before you use an answer, what must be confirmed, against what, and by whom.

Chapter 3 will give the details of asking and checking in everyday tasks. Here we build the frame that those details hang on. A plan matters because checking is hard work, and tired people skip it. A plan fixed beforehand does not depend on how you feel on Saturday night.

What these 15 minutes give you

  • Name the kinds of source that can settle a question, and say why a second AI tool is not one of them.
  • Choose what to check first by asking what is said to others, what is hard to take back, and what the point rests on.
  • Decide among three outcomes for any claim: confirmed, unconfirmed and left out, or replaced with something you can stand behind.
  • Write a short checking plan for a piece of work before you begin it.
  • Judge when checking would cost more than doing the work yourself.

Now these were more noble than those in Thessalonica, in that they received the word with all readiness of the mind, examining the Scriptures daily to see whether these things were so." — Acts 17:11

World English Bible

For which of you, desiring to build a tower, doesn’t first sit down and count the cost, to see if he has enough to complete it?" — Luke 14:28

WEB

Where there is no counsel, plans fail; but in a multitude of counselors they are established." — Proverbs 15:22

WEB

The Bereans heard a teacher and went to the text to see whether it was so. They were not unfriendly; they received the word readily and examined it. That is a good picture of the temper of a checking plan: willing to hear, careful to confirm. Luke 14:28 is about counting the cost before building, and a plan counts the cost of checking before work starts. Proverbs 15:22 reminds us that plans stand better with counsel, which is also the last line of any checking plan: a person who knows.

1. What can settle a question

A check needs something to check against. Not every source is able to settle a question. In rough order of weight, these can:

  1. The primary text. For Scripture, the Bible itself in a translation your community uses. For your church's teaching, the , confession, or other document it holds as its own. For a historical document, the document or a reliable edition of it.
  2. A reliable reference work. A good Bible dictionary, a lexicon, an encyclopedia of your tradition's choosing, a recognised commentary. It matters that the work has an author, an editor and a place in a community of scholars or teachers; that is what gives it some standing.
  3. An official or current source. For present-day facts: the organisation's own notice, an official page, a letter, a phone call to the office concerned.
  4. A knowledgeable person. A pastor, priest, teacher, librarian, colleague who reads the language, or a member of the community the question concerns.

Another AI tool is not on this list. It is tempting to put the same question to a second tool, and if both agree, to feel confirmed. But agreement between two tools shows only that both continued the words in a similar way. They may have learned from overlapping text, and they may share the same mistakes. Two tools that both invent a quotation can easily invent the same one. A second tool can sometimes suggest what to look up. It cannot be what you look it up in.

Nor is a search result a source. A search finds pages; some of the pages repeat the same error, because they too were written from memory or by a tool. A page counts as a source only if you can say who stands behind it.

2. What to check first

You cannot check everything, and you should not need to. A good plan sorts claims. Four questions help.

Will it be said to others? A claim used only to give you an idea can be rough. A claim that will be spoken in a sermon, printed in a notice, taught in a class or sent to a family must be right.

Is it hard to take back? A printed handout, a spoken quotation and a message sent to many people are difficult to correct. A note on your desk is easy.

Does the point rest on it? Some details are decoration, and some carry the weight. If a lesson depends on a particular quotation, that quotation comes first.

Is it specific? Lecture 2-1 showed that specifics are where invention occurs. Names, numbers, dates, verses, quotations and sources go to the top of the list.

One more mark is worth remembering: be most careful of what you most want to be true. An answer that fits your argument perfectly, a quotation that says exactly what you hoped to find, deserves a second look. We believe such things easily.

3. Three outcomes

Once you have checked a claim, it can end in one of three places.

  • Confirmed. You found it in a source that can settle the question, and it says what the tool said. You may use it, and you now have a reference of your own for it.
  • Not confirmed, so left out. You could not find it, or the source says something different. You do not use it. You do not say "some say" or "it is often said" to soften a claim you could not confirm, because that borrows an authority you do not have.
  • Replaced. The claim was wrong, but the question was a good one. You found the right answer in a source, and you use that, with the source.

There is no fourth outcome of "probably fine". A claim that has not been checked is, for the purposes of your work, a claim that has not been made.

The rule behind the plan

Use what you could check. Leave out what you could not. Do not use the tool's confidence to fill the gap.

4. A short plan, written first

A plan can be as short as five lines, written before you start work with the tool. It has the following parts.

Part Question
The use What is this for, and who will hear or read it?
The claims that matter Which specifics will I need to rely on?
The sources What will I check each against?
The person Who will read it before it goes out?
The stop What will I leave out if I cannot confirm it?

Here is an example. (An invented example.) A volunteer is asked to prepare a one-page handout for an adult class on a famous council of the early Church. She plans to ask a chat assistant for a draft. Her plan:

  • Use: a handout for about fifteen adults in the parish hall, printed.
  • Claims that matter: the date, the place, the main question the council settled, two names, and any quotation.
  • Sources: the encyclopedia of the Church's history in the parish library; the creed as printed in the hymnal; the priest's own notes.
  • Person: Father or the reads it before printing.
  • Stop: any quotation she cannot find is cut; any name she cannot confirm is dropped.

She has not yet seen the assistant's draft. When it arrives, she knows what she is looking for and what she will do with it. The plan has already turned the draft from "a handout" into "a list of claims to settle".

5. When checking costs too much

Luke 14:28 asks about cost. A plan includes a quick sum: how long will the checking take, compared with doing the work yourself?

For some work, the tool saves time even after checking. For other work, it does not. If a task needs every sentence checked against several sources, as with a careful treatment of a contested doctrine, the checking may take as long as writing from your own reading, and the writing will teach you something. In such cases, the honest decision is not to use the tool for that task.

Also ask whether you are able to check at all. If you cannot read the language, do not know where to look, or have no one to ask, a draft you cannot check is not a help. It is a risk you are carrying for others. That is not a failure. It means the task belongs somewhere else: to a colleague, a teacher or a book.

A limit of this lecture. It sets out a habit and not a procedure with fixed amounts; how much to check depends on what is at stake. Chapter 3 gives checklists for particular tasks, and chapter 4 returns to the question of what to hand over and what to keep.


Diagram 1. A checking plan in four steps

A Checking Plan Decide before you use, not after 1. Plan use, sources, person, stop 2. List the claims that carry weight 3. Check against a source that can settle it 4. Decide confirm, leave out, or replace Sources that can settle a question The primary text A reliable reference work An official or current source A person who knows Not sources A second AI tool that agrees A page with no one behind it A confident tone "Probably fine"

Diagram 2. What to check first

Ask If yes, check it earlier
Will it be said or printed for others? Yes
Is it hard to take back once said? Yes
Does the main point rest on it? Yes
Is it a name, number, date, verse, quotation or source? Yes
Is it exactly what I hoped to find? Yes

In short

  • A checking plan is made before you use an answer, so that tiredness does not decide what gets checked.
  • A source that can settle a question is a primary text, a reliable reference work, an official or current source, or a knowledgeable person.
  • A second AI tool is not a source: agreement shows only that both continued the words alike.
  • Check first what will be said to others, what is hard to take back, what the point rests on, and what is specific.
  • Be most careful of what you most want to be true.
  • A claim ends confirmed, left out, or replaced; there is no "probably fine".
  • If you cannot check a task or the checking costs more than the work, it is not a task for the tool.
Front Back
Checking plan A short plan made first: the use, the claims that matter, the sources, the person, the stop.
Sources that can settle Primary text; reliable reference work; official or current source; a person who knows.
Is another AI a check? No. Agreement only shows that both continued the words alike.
Three outcomes Confirmed, left out, or replaced.
Rule behind the plan Use what you could check; leave out what you could not.

One sentence to remember A claim that has not been checked is, for the purposes of your work, a claim that has not been made.

This week's action Write a five-line checking plan for one piece of work you may do with an AI tool, naming the source for each claim and the person who will read it first.

Review every summary in this course →

Check yourself

Not "did you read it" but "can you explain it". Ticks are kept on this device only.

Reflection and discussion

  • Why is agreement between two AI tools not a check?
  • In the Acts 17:11 picture, what is the difference between being unfriendly to a teacher and examining what the teacher says?
  • Which of the four questions about what to check first matters most in your own work?
  • What is wrong with softening an unconfirmed claim by saying "it is often said"?
  • Write a five-line checking plan for a piece of work you might do soon.
  • When would you decide that checking costs more than doing the work yourself?

Sign in to write and keep your answers

What next

The lecture ends here. What follows was written by its readers.