Hallucination
In more depth
Because a language model composes each answer token by token from learned patterns, it can produce output that is fluent, specific, and wrong—including case citations that do not exist. Hallucination can be reduced through retrieval-augmented generation and careful prompting, but it has not been eliminated in any current system. Fabricated citations in court filings have led to sanctions against lawyers, and bar authorities generally treat verification of AI output as part of the duty of competence.
Further reading: Wikipedia.
Related terms
Educational information, not legal advice. AI terminology and tools change quickly; definitions reflect usage as of the last-updated date. For what bar associations and courts actually require of lawyers using AI, see legalaicompliance.help and consult a licensed attorney in your jurisdiction.