PerplexityBot
Perplexity AI's web crawler that indexes content for use in Perplexity's AI-powered search responses.
What is PerplexityBot?
PerplexityBot is the crawler Perplexity uses to build the index that its answer engine retrieves from. Perplexity publishes the user-agent string and the IP ranges the crawler uses, and states that it respects robots.txt. Perplexity also documents a second agent, Perplexity-User, which fetches a specific page when a user's query requires it; that agent is described as acting on the user's behalf and may fetch pages that PerplexityBot itself would skip.
Perplexity is unusual among the major engines in how heavily it leans on live retrieval and how prominently it shows citations. Almost every answer carries numbered sources, and the engine tends to draw on a wide range of domains, including community discussions, documentation and niche publications, rather than only high-authority sites. That makes PerplexityBot access a direct lever: a page the crawler can index and a user-triggered fetch can retrieve has a realistic chance of being cited for the questions it answers.
As with other AI agents, PerplexityBot does not execute JavaScript, so content that is only rendered client-side is invisible to it, and its visits only appear in server-side logs. Sites that see Perplexity citations to competitors but never to their own pages should check robots.txt, rendering and whether the page states its answer clearly before anything else.
Why it matters for AI search
Perplexity is a heavily citation-driven engine, and it is a common research tool for technical and B2B buyers. Being indexable by PerplexityBot and fetchable by Perplexity-User is the entry ticket. Because Perplexity shows sources so visibly, citations there also carry more click-through than on engines that bury links, which makes it one of the better platforms for turning GEO work into measurable referral traffic.
Related terms
Perplexity AI
An AI-powered search engine that provides conversational answers with citations. A key platform for AEO optimization.
Robots.txt
A file that tells web crawlers (including AI bots) which pages to access or avoid. Critical for managing AI visibility.
Synthetic Traffic
Web traffic where the primary visitor is an AI agent or crawler acting on behalf of a user.
AI Citation
When an AI platform references or links to your content as a source in its response. Citations drive traffic and establish authority.
Frequently asked questions
What is the difference between PerplexityBot and Perplexity-User?+
PerplexityBot crawls proactively to build Perplexity's search index. Perplexity-User fetches a page on demand when a user's question needs it. Perplexity documents both, and a site that wants to be cited should allow both.
Why does Perplexity cite competitors but not my site?+
The usual causes are robots.txt rules blocking PerplexityBot, pages that render content only via JavaScript, or pages that do not answer the specific question directly. Compare the cited competitor page's structure with yours and check logs for whether PerplexityBot visits at all.