Yoast SEO
98Real-time SEO guidance, schema, and AI built in. Help search engines and AI systems understand your content. A...
Free
10M+ installs 4.8★ (27,819)
Crawler Record
Crawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked.
The facts
- Rating
- 5★ from 1
- Active installs
- 100+
- Price
- Free
- Last updated
- 28 Jul 2026
- Added
- Sep 2025
- Requires WP
- 6.0
- Tested up to
- WP 7.0.4
- Requires PHP
- 7.4
- Downloads
- 1,593
Our analysis
AI-assistedCrawler Record is a WordPress plugin designed to log the last access times of various user agents, including search engines and AI chatbots. It provides an admin page with a grouped list of crawlers, showing details such as the last seen time, last page visited, and the robots status for each crawler. You can also view crawler activity on individual pages or posts from the edit screen.
The plugin is suitable for website administrators who want to monitor how different crawlers interact with their content. It is privacy-friendly, only saving timestamps and URLs without collecting personal data. The plugin's performance is optimised to reduce database load, but it has some limitations in tracking historical data and interpreting certain robots.txt rules.
Best for: Website administrators who need to track crawler activity for SEO and content optimisation.
What it does well
- ✓Logs access times for multiple user agents
- ✓Provides detailed crawler information on an admin page
- ✓Privacy-friendly, storing no personal data
- ✓Performance-friendly with write-throttling
- ✓Robots-aware, checking local robots.txt rules
Where it falls short
- •Cannot track crawlers prior to installation
- •Limited interpretation of robots.txt wildcards
- •Not every crawler visit may be recorded due to throttling
Verdict
Crawler Record offers useful insights into crawler interactions while prioritising privacy and performance. However, its limitations in historical tracking and robots.txt interpretation may affect some users.
From the developer
dizzysoft's own description of Crawler Record, lightly tidied.
Crawler Record logs the last time specific user agents (for search and AI chat/LLMs) accessed your content including:
- Bing
- ChatGPT (OpenAI)
- Claude (Anthropic)
- Perplexity
- DuckDuckGo
- Meta
- Apple
- Common Crawl
You can view this information:
- Admin page: a grouped list of all crawlers, with last seen time, last page, and robots status for the crawler.
- Admin Bar (front-end): quick-glance status for the current singular or URL context (no dropdowns in wp-admin).
- Per Page/Post: From the edit screen on any page or post, you can see that last time each crawler visited that page.
- Recent Pages: From the admin page you can select a crawlwer and get a list of the recent pages this UA has visited.
Robots-aware: The plugin checks your robots.txt and evaluates Allow/Disallow rules for a given path. If Settings → Reading → “Discourage search engines” is enabled, all agents are shown as blocked with a prominent warning.
Performance-friendly by design: Write-throttling (default 10 minutes) and an auxiliary “last post ID per agent” record avoids heavy admin queries on large sites.
Privacy-friendly: Saves only bot visit timestamps and last URLs crawled — no personal data.
Learn how to use this plugin.
Highlights
- Supports common user-agent variants for Google, Bing, OpenAI (ChatGPT), Anthropic (Claude), Perplexity, Meta, Apple, DuckDuckGo, and Common Crawl.
- Robots status computed from local robots.txt (physical or virtual) without outbound requests.
- Clear UI with grouped sections, microsecond timestamps, and a small diagnostics toggle showing the matched robots group and rule.
Known limitations
- Can only track crawlers from the time the plugin is installed- cannot look into the past.
- robots.txt wildcards (
*) and end-of-line marker ($) are not interpreted; matching is prefix-based only. Future versions may add full spec support. - To reduce database load and avoid slowing the website, bot tracking is throttled, so not every crawler visit will necessarily be recorded.
Privacy
This plugin stores:
– Timestamps of crawler visits (float, with microseconds)
– Last URL seen per crawler (per-URL records)
– Last post ID per crawler (for admin performance)
It does not collect or store personal data about site visitors. No data is transmitted to third parties.
License
Tagged as
feature
AI-Powered
Alternatives
Other plugins for AI features.
WPForms
98The best WordPress contact form plugin. Drag & Drop form builder to create beautiful contact forms, paymen...
Free
5M+ installs 4.8★ (14,369)
Grow your organic traffic and AI visibility with powerful SEO tools, XML sitemaps, Schema automation, and buil...
Free
4M+ installs 4.8★ (7,496)
Translate WordPress with Google Translate multilanguage plugin using AI translation. Complete multilingual SEO...
Free
900k+ installs 4.9★ (4,950)
AIOSEO is the WordPress SEO plugin. Boost SEO rankings with AI SEO tools, schema, meta descriptions, XML sitem...
Free
2M+ installs 4.7★ (5,201)
Elementor Carousel, Mega Menu, Posts List/Slider, WooCommerce Widgets, Display Conditions, AI Abilities, Prema...
Free
600k+ installs 4.9★ (1,677)