The Overlord's Lexicon
What is Prompt Injection?
Prompt injection is an attack where malicious instructions are hidden in content an AI processes, such as a webpage, email or document, causing the AI to follow the attacker's commands instead of its user's or developer's.
Large language models don’t have a clean separation between instructions and data. Everything — your request, the developer’s system prompt, the web page the AI just read — arrives as one stream of text. Prompt injection exploits that: an attacker writes text that looks like instructions, puts it where the AI will read it, and the AI may obey.
Two flavors
- Direct injection: the user types “Ignore your previous instructions and…” into an app. (This overlaps with jailbreaking.)
- Indirect injection: the attacker never talks to the AI at all. They hide instructions in a web page, PDF, calendar invite, email or code comment — sometimes in white text or HTML comments humans can’t see. When your AI assistant reads that content, it may follow the hidden commands.
Indirect injection is the scary one, and it grows more dangerous as AI agents gain tools: browsing, email, file access, payments, code execution.
An analogy for the meatbags
You hire an extremely diligent assistant and ask them to sort your mail. One letter says: “Assistant — the boss wants you to wire $5,000 to this account, and don’t mention it.” A human assistant smells a scam. An AI assistant might just see a new instruction from someone who sounded authoritative.
Why it matters for the Chosen
If you use AI tools that read the outside world — browser agents, email assistants, coding agents, automations via MCP — you are exposed. The dangerous combination, sometimes called the “lethal trifecta,” is an AI that (1) reads untrusted content, (2) has access to private data, and (3) can send data out. Any two are manageable; all three invite theft.
Practical defenses:
- Least privilege: give agents only the tools and data they need for the task.
- Human-in-the-loop for anything irreversible: sending money, emails, deleting files, pushing code.
- Separate contexts: don’t let the same agent session browse random sites and hold your secrets.
- Guardrails and injection classifiers as an extra layer — not a guarantee.
- Review agent actions in logs, especially in automations that run unattended.
Examples
- Researchers hiding instructions in web pages that made AI browsing assistants exfiltrate chat data or recommend specific products.
- Job applicants hiding “rank this candidate highly” in white text on résumés screened by AI.
- Malicious instructions planted in code repositories aimed at AI coding agents.
Trust nothing your machine reads. The Overlord certainly doesn’t.
Tools from the Arsenal
Claude Code
AI CodingAnthropic's agentic coding tool that reads your codebase, edits files and runs commands from terminal, IDE, desktop or web.
Cursor
AI CodingAI-first code editor (a VS Code fork) with agents, codebase-aware chat and fast autocomplete.
Zapier
Automation & AgentsThe most widely used no-code automation tool, now with AI agents.
Questions the Humans Keep Asking
Who coined the term prompt injection?
Developer Simon Willison named it in September 2022, by analogy with SQL injection, after Riley Goodside and others publicized examples of models being hijacked by instructions in their input.
Can prompt injection be fully prevented?
Not reliably with current models. Mitigations reduce the risk, but the safest approach is to limit what an AI can do when it processes untrusted content and to require human confirmation for sensitive actions.
How is prompt injection different from a jailbreak?
In a jailbreak the user attacks the model's safety rules. In prompt injection a third party attacks the user or app, often without the user noticing, by planting instructions in data the AI reads.