FREE

Course certificates are free until March 31, 2027.

PT737E Understanding AI for Ministry

Lecture 3-2: Checking What You Are Given

Contents 31
PT737E Understanding AI for Ministry
Chapter 0 · Introduction: A Tool That Continues Words
  1. Introduction: A Tool That Continues Words
Chapter 1 · Week 1: What AI Is
  1. Lecture 1-1: What the Word "AI" Points To
  2. Lecture 1-2: How a Language Model Makes Words
  3. Lecture 1-3: Sounding Right Is Not Knowing
  4. Lecture 1-4: Reading a Conversation Closely
  5. Lecture 1-5: Practice Lab, Read an AI Answer
Chapter 2 · Week 2: Limits and Errors
  1. Lecture 2-1: Invented Facts
  2. Lecture 2-2: Old Knowledge, Missing Sources, Uneven Coverage
  3. Lecture 2-3: Scripture and Theology, Where to Be Most Careful
  4. Lecture 2-4: Building a Checking Plan
  5. Lecture 2-5: Practice Lab, Find the Errors
Chapter 3 · Week 3: Asking, Checking, Protecting
  1. Lecture 3-1: Asking Well
  2. Lecture 3-2: Checking What You Are Given
  3. Lecture 3-3: What Must Never Be Typed In
  4. Lecture 3-4: Keeping Notes and Giving Credit
  5. Lecture 3-5: Practice Lab, Mend the Prompts, Mark the Secrets
Chapter 4 · Week 4: Ministry Work: Administration and Teaching
  1. Lecture 4-1: Hand It Over, Help With It, Keep It
  2. Lecture 4-2: Office Work and Communication
  3. Lecture 4-3: Teaching and Study Materials
  4. Lecture 4-4: Where Teachers and Leaders Draw the Line
  5. Lecture 4-5: Practice Lab: Hand Over, Help, or Keep
Chapter 5 · Week 5: Preaching and Care
  1. Lecture 5-1: Preaching and AI: A Theological Question
  2. Lecture 5-2: Care and Counselling
  3. Lecture 5-3: When Members and Young People Use AI
  4. Lecture 5-4: The Minister's Own Life
  5. Lecture 5-5: Practice Lab: Judge the Scene, Write a Position Paragraph
Chapter 6 · Week 6: Staying Responsible for the Long Run
  1. Lecture 6-1: The Learner's Honesty
  2. Lecture 6-2: A Community's Policy
  3. Lecture 6-3: Technology That Keeps Changing
  4. Lecture 6-4: Writing Your Own Rule
  5. Lecture 6-5: Practice Lab, My Personal Guidelines

Jump to the key points ↓

15 min

An answer from a chat assistant is a draft that nobody has checked, including the tool. Week 2 showed how invented facts, old knowledge and confident mistakes arise. This lecture is the working answer to that problem. It is a method of checking, small enough to use on a Tuesday afternoon.

The method does not need technical skill. It needs three things: knowing what kind of claim you are holding, knowing where the matching source is, and being willing to throw away what you could not check. The last one is the hardest. An answer that reads well is tempting to keep. The rule of this lecture is plain: what you could not check, you do not use as if it were true.

What these 15 minutes give you

  • Sort the claims in an answer into kinds, and say which need checking first.
  • Compare a quotation or a Bible reference with the real text.
  • Treat a source the tool names as a lead to be found, not as proof.
  • Use a second route or a human expert when a claim matters.
  • Apply a short checklist to an answer before using it.

Test all things, and hold firmly that which is good." — 1 Thessalonians 5:21

World English Bible

Now these were more noble than those in Thessalonica, in that they received the word with all readiness of the mind, examining the Scriptures daily to see whether these things were so." — Acts 17:11

WEB

Paul's instruction is short and wide: test. The people of Berea in Acts did not accept a new teaching because it was well spoken, and they did not reject it either. They went to the Scriptures and looked. We apply the same habit to a different matter. The verses do not speak of AI, and nothing in them says what to think about it. They give a pattern of care that fits any claim brought to us.

1. Sort the claims first

An answer is not one thing. It is a bundle of claims, and they are not equally risky. Before you check, read the answer and sort what you find.

  • Checkable facts: names, dates, numbers, places, quotations, references, titles of books, what a council decided.
  • Claims about meaning: what a passage says, what a word means, what a tradition teaches.
  • Advice and judgement: what you should do, what is best.
  • Plain wording: sentences that carry no claim, such as a friendly opening or a rewrite of your own text.

Lecture 2-1 explained why the first group is the most likely to contain invented material: specific names, numbers and sources are exactly what a tool fills in plausibly when it does not have them. Start there. Plain wording needs only a read for tone and sense.

2. Compare with the source text

When an answer quotes Scripture, open the Scripture. Read the verse in the translation your community uses, not in the tool's version. Ask three questions:

  1. Is this verse really where the answer says it is?
  2. Do the words match, or has the tool mixed two translations or blended two passages?
  3. Does the verse say what the answer claims it says, in its own setting?

The third question is the one a quick check misses. A verse can be real and quoted correctly, and still be used for a point it does not make. Read the sentences around it.

The same applies to a quotation from a church father, a council, a or a creed. Find the text in a printed edition or in your community's own authorised collection. If the quotation is not there, you have learned something important about the answer. Do not search until you find a similar line and then decide the tool was nearly right. A near match is not the quotation.

3. A named source is a lead, not proof

You can ask a tool to give its sources. It will usually give you some: a book title, an author, a year. Treat each as a lead. Two things can go wrong. The source may not exist, because a tool can produce a believable title. Or the source may exist, and say something different from what the answer claims.

So the steps are: find the source in a library, a catalogue or a publisher's list; open it; find the passage; read what it says. If you cannot find the source after a reasonable search, say to yourself that the claim is unsupported. Do not say that the source is probably real and move on.

An answer that names no source is no worse than one that names a false one. A false source is worse, because it looks like a check has been done.

4. A second route

For a fact that matters, find it by a different path from the first. Look it up in a reference you trust: a good dictionary of the Bible, your community's catechism, a standard history of the Church, an official record kept by your own community. Do not use a second chat conversation as the second route. Another run of the same kind of tool can repeat the same error, or produce a different one, and agreement between two runs is not a source.

Where the question is about doctrine, the second route is usually your own tradition's authority and the people who hold it. A Catholic reader may ask what the Catechism or a bishop's teaching office says. An Orthodox reader may ask a priest and look to the Fathers and the liturgical texts. A Protestant reader may go to the confession of their church and to a pastor. The course does not rank these. It asks only that the claim be tested against something that stands outside the tool.

5. A human expert

Some questions need a person: a hard point of Greek or Hebrew, a legal matter, a medical matter, the history of a particular local church. Ask a person who knows. The tool can help you prepare the question, but it cannot be the final word on something where being wrong would hurt someone.

This is not a sign of weakness. Asking a colleague "Is this right?" is part of the work of ministry. A short note to a teacher, a priest, a pastor or a librarian costs little.

6. What you could not check

Sometimes you cannot find a source, no expert is at hand, and the claim is still sitting in the answer. There are three honest choices:

  1. Leave it out. Often the sentence was not essential.
  2. Say it plainly as unchecked. "I have not been able to confirm this" is an honest thing to write in notes for yourself.
  3. Replace it with a claim you did check.

There is a fourth choice, which is not honest: to use the claim as if it were certain because it sounded right. This is the one this lecture warns against. The cost of leaving something out is small. The cost of passing on an invented quotation to a congregation, a class or a family is larger, and you will not always know that it happened.

7. Match the care to the risk

You cannot check everything with equal effort, and you should not try. Ask: what happens if this is wrong?

  • A friendly rewrite of a notice: a quick read is enough.
  • A date or a place in a public announcement: check it against your own calendar.
  • A quotation or doctrine that will be taught: check against the source, with a second reader.
  • Anything that touches a person's health, safety, money or legal position: do not use a tool to settle it. Go to a qualified person.

Low risk, light check. High risk, a full check or a person. The point is that a decision about care is made on purpose, not by how pleasant the answer was to read.

8. A simple checklist

Use this before you use anything.

  1. Did I read the whole answer, not only the first lines?
  2. Did I mark every name, number, date, place, quotation and reference?
  3. Did I open the source for each marked claim that matters?
  4. Does each Bible verse say what the answer says it does, in its setting?
  5. Is any claim here a place where traditions differ? Have I stated the difference fairly?
  6. Did I leave out, or mark as unchecked, whatever I could not check?
  7. Would I be willing to say what I used and how I checked it?

If you cannot answer yes to questions 3 and 6 for a claim that matters, do not use that claim.

9. A short invented case

(an invented example) A small-group leader asks a chat assistant for a short background note on a feast day. The answer includes a date for the feast, a quotation attributed to an early church writer, and a sentence that the feast "has always been celebrated in the same way". The leader sorts the claims. The date she checks in her community's calendar and it is right. The quotation she cannot find in any collection her priest owns, so she leaves it out. The sentence "always the same way" she recognises as an overreach and replaces with something narrower that her priest confirms. The note she hands to the group is shorter than the one the tool produced, and every line of it has been seen by a person.


Diagram 1. The checking route

The Checking Route From an answer you were given to something you may use 1. Sort Mark names, dates, numbers, quotations, references. 2. Open the source The real verse, the real text, the real record. Not the tool's copy. 3. Read in setting Does it say what the answer claims it says, in its own place? 4. Second route or person A trusted reference, your community's own authority, a teacher. Not another chat run. 5. Decide Checked: use it. Not checked: leave it out or mark it. Never use it as true. What you could not check, you do not use as if it were true.

Diagram 2. Risk and care

If this is wrong... Then check...
Little changes (a friendly rewrite) A careful read.
A public detail is wrong (date, place) The record kept by your own community.
A teaching or quotation is wrong The real text, with a second reader.
A person could be hurt Do not settle it with a tool. Go to a qualified person.

In short

  • Sort an answer into names, dates, numbers, quotations, meanings, advice and plain wording; check the specific claims first.
  • Compare a verse or quotation with the real text, and read the setting to see whether it says what the answer claims.
  • A source the tool names is a lead to be found and read, not proof that the claim is true.
  • A second route is a reference or an authority outside the tool; another chat run is not one.
  • What you could not check, you leave out or mark as unchecked; you do not use it as if it were true.
Front Back
Check first Names, numbers, dates, places, quotations and references.
A named source A lead to find and read; it may not exist, or may say something else.
A second route A reference or authority outside the tool, not another chat run.
What you could not check Leave it out, mark it as unchecked, or replace it with something you did check.

One sentence to remember What you could not check, you do not use as if it were true.

This week's action Take one answer you were given and check one quotation or reference against the real text.

Review every summary in this course →

Check yourself

Not "did you read it" but "can you explain it". Ticks are kept on this device only.

Reflection and discussion

  • Why is a source that does not exist worse than no source at all?
  • A verse is quoted correctly but used for a point it does not make. How would you find that out?
  • Who is the "second route" for doctrinal questions in your own community?
  • When have you kept a sentence because it sounded good? What would have been the cost if it were wrong?
  • Why is a second chat conversation not a second route?

Sign in to write and keep your answers

What next

The lecture ends here. What follows was written by its readers.