v1.6-v1.7 BLACKHOLE FOR BAD BOTS - to automagically ban bad robots who doesn't follow robots.txt instruction

Pipo87

Active member
Elite
XNullUser
Joined
May 12, 2022
Messages
36
Reaction score
130
Points
33
NullCash
305
Link : https://store.getdatakick.com/en/modules/blackhole-for-bad-bots

This is very simple free module for prestashop and thirtybees platforms. It is based on a very simple idea:

  1. you instruct all robots visiting your website NOT to open specific url
  2. this module will add hidden link from all pages on your website to this forbidden page. This link is perfectly visible to all robots, but normal visitors will not notice it at all (without looking into web page source code)
  3. when anyone access this forbidden page, his IP address will be immediately added to blacklist
  4. blacklisted visitor are forbidden from viewing content from your website
  5. shop administrator is notified about new entries to blacklist. They will receive email with WHOIS information about the visitor - his IP address, location, network, etc.
And that’s it. This trap will not affect any good robots who are following robots.txt directives. On other hand, all bad bots and crawlers will be eventually trapped and forbidden from ever collecting information from your site again.

MODULE ACTIVATION​

  1. edit robots.txt file in the root directory
Before you install this module, you need to edit your robots.txt file, and add following two lines

User-agent: *
Disallow: /blackhole/

  1. install module
  2. optionally, you can test it by navigating to http://www.yourdomain.com/blackhole/. You should be banned from your own site. To lift the ban, reset module from your back office.

MODERATION​

At the moment there isn’t any UI to manage blacklist. If you want to remove some IP address from blacklist, you have to make manual changes in database table called PREFIX_blackholebots_blacklist
 

Attachments

  • blackholebots-ps17-1.0.2.zip
    25.8 KB · Views: 0

x50902Ty

Active member
Elite
XNullUser
Joined
Mar 21, 2021
Messages
900
Reaction score
171
Points
43
NullCash
167
Thank you very much for this module!!
 

4ngeluxpunk

Member
XNullUser
Joined
Feb 16, 2020
Messages
646
Reaction score
0
Points
16
NullCash
444
Thank you very much for this module!!
 

Sillumin

Well-known member
Pro
Master
Diamond
Elite
Joined
Jun 18, 2021
Messages
3,620
Reaction score
744
Points
113
NullCash
5,960
Exact name of the module is: Blackhole For Bad Bots by DataKick
 

SpinLoL

Member
XNullUser
Joined
Sep 12, 2020
Messages
304
Reaction score
0
Points
16
NullCash
0
This is great share man thank you so much
 

GUAGUA

New member
XNullUser
Joined
May 31, 2022
Messages
28
Reaction score
1
Points
1
NullCash
7
This is great share man thank you so much
 

unique

Well-known member
Diamond
Elite
XNullUser
Joined
Dec 12, 2020
Messages
1,799
Reaction score
407
Points
83
NullCash
510
he said before

This is very simple free module for prestashop and thirtybees platforms. It is based on a very simple idea:
 

hxcode

Well-known member
Master
Diamond
Elite
Joined
Aug 16, 2020
Messages
3,302
Reaction score
364
Points
83
NullCash
17
thx bro for sharing. i will try it.
 
Top