• Welcome to XF2 Addons. You can buy my Premium membership for $35 per year, and this gives you access to download any or ALL of the 335 add-ons that I have developed for Xenforo 2.x. In addition, Premium members will get technical support. Once the Premium membership has expired you can continue to use the installed addons on your forum as long as you like.

Robots

Robots 2.6

No permission to download
Note
Compatible XF 2.x versions: 2.0, 2.1, 2.2
Description:

Disallows robots from indexing your site unless explicitly allowed.

(Robots link in Visitors tab)

211


(Example of Robots page)

2133


(Example of Options page)

2224


(Example of User group permissions)

215


Features:
  • All phrases start with robots_ for your convenience.
User group permissions:

Normally only the Administrative user group is set the 'Yes' in order to see the Robots link in the visitor tab menu.

Questions and Answers:

Q: What is the purpose of this add-on?
A: Lots of robots crawling your forum will slow it down.

Q: I noticed a robot crawling my site but it's identified as a guest.
A: You need to add the name to the Blacklist field in the Options page.

Q: What happens if a robot which is not allowed comes to my site?
A: It receives a blank page.

Q: Why not use the robots.txt file to restrict robots?
A: Because robots ignore this file.

Database modifications:

This add-on will create a table called xf_andy_robots in your database.
Author
Andy
Downloads
186
Views
1,176
First release
Last update
Rating
5.00 star(s) 2 ratings

Share this resource

Latest updates

  1. See description

    Robots v2.6 changes: Fixed issue with Cron entry not deleting old data.
  2. See description

    Robots v2.5 changes: Now using finder for performing database queries.
  3. See description

    Robots v2.4 changes: Updated setup to use schema manager.

Latest reviews

I was getting far too many bots from sites that have no benefit to me eg Yandex and Sougu. This add-on was easy to install and configre. Straight away I had less bandwith use.
Great solution for demo sites, without keeping it as close
Top