Yoast SEO
98Real-time SEO guidance, schema, and AI built in. Help search engines and AI systems understand your content. A...
Free
10M+ installs 4.8★ (27,819)
Multipart robots.txt editor
Customize your site's robots.txt and include remote content to it
The facts
- Rating
- 3.3★ from 3
- Active installs
- 1k+
- Price
- Free
- Last updated
- 17 Feb 2018
- Added
- Sep 2014
- Requires WP
- 4.7
- Tested up to
- WP 4.9.31
- Downloads
- 56,583
Our analysis
AI-assistedThe Multipart robots.txt editor is a WordPress plugin that allows you to edit your robots.txt file and incorporate remote content. It is designed for users who manage multiple sites and wish to maintain a centralised robots.txt configuration.
You can include or exclude WordPress’ default robots.txt output, as well as control the output from plugins and add custom records. However, the plugin requires more documentation for effective use, and it is important to note that robots.txt is treated as a virtual URL by WordPress.
Best for: This plugin suits website administrators managing multiple WordPress sites.
What it does well
- ✓Allows editing of robots.txt file
- ✓Supports inclusion/exclusion of WordPress and plugin outputs
- ✓Can include remote text files
- ✓Enables addition of custom records
Where it falls short
- •Lacks comprehensive documentation
- •Requires at least one 'Disallow' field in the robots.txt file
- •Not effective for subdirectory installations
Verdict
The Multipart robots.txt editor provides basic functionality for managing robots.txt files but suffers from a lack of documentation and clarity on certain features.
From the developer
Viktor Szépe's own description of Multipart robots.txt editor, lightly tidied.
This plugin needs more documentation!
You can edit your robots.txt and add remote content to it.
E.g. you have several sites and want to use a centralized robots.txt.
Features
- Include or exclude WordPress’ own robots.txt (core function)
- Include or exclude plugins – e.g. sitemap plugins – output to robots.txt (filter output)
- Include or exclude a remote text file (the common part)
- Include or exclude custom records from the settings page (the site specific part)
Where is robot.txt?
WordPress handles robots.txt as a virtual URL – just the same way as posts and pages.
So when you browse to https://example.com/robots.txt WordPress generates robots.txt on the fly.
Todo
- add more description here
- add a video too
- add an admin notice for subdir installs (robots.txt is useless in a subdir)
- ‘At least one “Disallow” field must be present in the robots.txt file.’ – check for that
Links
Development of this plugin goes on on GitHub.
Tagged as
Alternatives
Other plugins for indexing control.
Grow your organic traffic and AI visibility with powerful SEO tools, XML sitemaps, Schema automation, and buil...
Free
4M+ installs 4.8★ (7,496)
AIOSEO is the WordPress SEO plugin. Boost SEO rankings with AI SEO tools, schema, meta descriptions, XML sitem...
Free
2M+ installs 4.7★ (5,201)
Generate multiple types of sitemaps to improve SEO and get your website indexed quickly.
Free
1M+ installs 4.8★ (2,233)
SEOPress
93WordPress SEO plugin with AI SEO metadata, schema, XML sitemap, redirections & Search Console. Privacy-fir...
Free
300k+ installs 4.8★ (1,246)
SureRank SEO
90Lightweight SEO assistant for meta tags, schema and structured data, XML sitemaps, Open Graph previews, robots...
Free
400k+ installs 4.8★ (41)