This plugin provides a
robots.txt for a Shopware 6 shop. Currently it is not possible to distinguish different user-agents. Note that in general only the
robots.txt at the root will be considered.
Currently there exist the following default rules
If you need to modify them this should be done by a template modification. If there are other general rules which are useful for others, consider creating a pull request.
It is possible to configure the
Allow rules in the plugin configuration. Each line needs to start with
Disallow: followed by the URI-path. The generated
robots.txt will contain each path prefixed with the absolute base path.
For example suppose you have two "domains" configured for a sales channel
example.com/en and the plugin configuration
In addition to the rules the sitemaps containing the domain will be linked. Again suppose we have the domains
example.com/en configured, the
robots.txt will contain