In one sentence
PerplexityBot is the web crawler operated by Perplexity AI. Perplexity uses it to search the web in real time when generating answers.
What does it look like in practice?
For example, when you ask Perplexity a question, PerplexityBot searches the web in real time and returns something like:
[Answer body]
Sources: ○○ Research, △△ Report
It answers while explicitly showing citation URLs.
A key feature of Perplexity is that these citation URLs are displayed as clickable links. When you are cited, it leads directly to referral traffic to your own site via Perplexity.
Why it matters
- Citation = direct traffic: Unlike other AIs (ChatGPT / Claude), Perplexity always shows URL links explicitly
- Perplexity is popular among experts and knowledge workers: You can expect high-quality traffic
- It's a search crawler, not a training crawler: There's almost no benefit to disallowing it
How to configure it
User-agent: PerplexityBot
Allow: /
Characteristics of Perplexity's citation behavior
| Aspect | Detail |
|---|---|
| URL display | Excellent (shown as clickable links) |
| Real-time nature | Excellent (web search on every question) |
| User base | Experts, researchers, knowledge workers |
| Contribution to traffic | High (easy to click directly) |
See also Perplexity for more detail.