By default, /robots.txt on an Odoo installation with website module installed will allow indexing by webcrawlers.
This module will overwrite view that generates /robots.txt and won’t allow to index.
Table of contents
Configuration
- You can enable crawler by editing the default system parameter «website.crawler.disable» (in the menu Settings > Parameters > System Parameters).
Usage
No useable features for an user are available. To view the results, visit /robots.txt on your site.
Bug Tracker
Bugs are tracked on GitHub Issues. In case of trouble, please check there if your issue has already been reported. If you spotted it first, help us to smash it by providing a detailed and welcomed feedback.
Do not contact contributors directly about support or help with technical issues.
Credits
Contributors
- Roel Adriaans <roel.adriaans@b-informed.nl>
- Ernesto Tejeda
- Kaushal Prajapati <kbprajapati@live.com>
- Giovanni Serra <giovanni@gslab.it>
Maintainers
This module is maintained by the OCA.
OCA, or the Odoo Community Association, is a nonprofit organization whose mission is to support the collaborative development of Odoo features and promote its widespread use.
This module is part of the OCA/website project on GitHub.
You are welcome to contribute. To learn how please visit https://odoo-community.org/page/Contribute.