Deepa Shenoy explains: How AI Hallucinations Happen and How to Mitigate Them

Deepa Shenoy explains that a hallucination is a fluent answer containing false or unsupported information, and that plausible wording is not evidence. A made-up country example shows the gap, followed by mitigation steps and a source-citation exercise.

1:28 video3 min readWatch on YouTube

In this video Deepa Shenoy, with narration by Liam on her behalf, looks at how AI can sound confident and still be wrong. A language model can give a convincing answer without checking every claim in it. The video explains why plausible wording and verified facts are different things, and calls that difference the gap.

What a hallucination is

An AI hallucination is a fluent answer that includes false or unsupported information. The fluency is what makes it hard to catch, since the sentence reads as well as a correct one would. The video's point is that how an answer sounds tells you little about whether it is true.

Why it happens

A language model predicts tokens from patterns learned during training. That process can produce useful text. But ordinary generation does not automatically check each new claim against a trusted source. The model is following patterns, not looking facts up, so a claim can be produced because it fits the pattern even when nothing supports it.

A made-up example

To make the gap concrete, the video uses a fictional country called Belora. Asked for its capital, an AI confidently answers Lumen. Both names are invented, so there is no capital to find, yet the answer arrives in a confident sentence. The lesson drawn from it is that a confident sentence is not evidence.

Why it matters

This matters when people rely on invented citations, instructions or details in consequential decisions. A made-up reference or a wrong instruction is just as easy to read past as a correct one, and the cost shows up later, when someone acts on it.

What reduces the risk

The video lists a few steps:

  • Check important claims against reliable sources.
  • Give the model useful context.
  • Use retrieval, which can bring relevant documents into an answer when appropriate.

It is careful about the limits. These steps reduce risk, but they cannot guarantee truth. The summary line is to remember that plausible is not verified, and to treat important claims as questions to check.

A prompt exercise

The video ends with a practical test you can run with Claude. Ask it to answer your question using only the sources you paste, and to cite each claim to a passage. Have it mark unsupported claims. Then remove one source and compare the two answers. The comparison shows which claims depended on the source you removed, and whether the model is willing to say that something is no longer supported.

Key takeaways

  • A hallucination is a fluent answer that includes false or unsupported information.
  • Language models predict tokens from patterns learned during training.
  • Ordinary generation does not automatically check each claim against a trusted source.
  • A confident sentence is not evidence.
  • Invented citations, instructions and details are especially risky in consequential decisions.
  • Checking sources, giving context and using retrieval can reduce risk but cannot guarantee truth.
  • Treat important claims as questions to check.

Try it yourself

Run the exercise from the video on your own question and your own sources. Paste the sources, ask Claude to answer using only those and to cite each claim to a passage, and have it mark any unsupported claims. Then remove one source and compare what changes in the answer.

Chapters

  1. 0:00The Gap Between Plausible Wording and Verified Facts
  2. 0:25What Is an AI Hallucination?
  3. 0:50Fictional Example: The Bellora & Lumen Case
  4. 1:15Why Plausible Sentences Are Not Evidence
Full transcript(auto-generated, with timestamps)

The Gap Between Plausible Wording and Verified Facts

[0:00]Hi, I am Deepa Shenoy and this video is about how AI can sound confident and still be wrong. This is Liam narrating for Deepa. A language model can give a convincing answer without checking every claim. Let's see why plausible wording and verified facts are different. That is the gap. An AI hallucination is a fluent answer that includes false or unsupported information. A language model predicts tokens from

What Is an AI Hallucination?

[0:25]Patterns learned during training. That can produce useful text, but ordinary generation does not automatically check each new claim against a trusted source. Fictional example, imagine a made-up country called Belora. Asked for its capital, an AI confidently answers Lumen. Both names are invented. A confident sentence is not evidence. That matters when people rely on invented citations, instructions, or

Fictional Example: The Bellora & Lumen Case

[0:50]Details in consequential decisions. Check important claims against reliable sources. Give useful context. Retrieval can bring relevant documents into an answer when appropriate. These steps reduce risk. They cannot guarantee truth. Remember, plausible is not verified. Treat important claims as questions to check. Your turn. Ask Claude, using only these sources I paste, answer my question and cite each claim to a passage. Mark

Why Plausible Sentences Are Not Evidence

[1:15]Unsupported claims. Remove one source and compare. Run it on your own question and sources. How AI hallucinations happen. This is Liam narrating for Deepa for Humanitarian's AI.

More from Humanitarians AI Fellows

Humanitarians AI Lyrical Literacy Project