[VPM] link 'bot' protection

[Matt Elrod]

Honeypots - One could also provide an invisible link, anchored by
an invisible gif for example, expressly forbid access to what it
links to in robots.txt, and then temporarily ban any IP that
trespasses.  That would separate the robot.txt ignoring spiders
from the rest.

Matt

http://en.wikipedia.org/wiki/Web_scraping#Technical_measures_to_stop_bots

mock wrote:

> Tarpits - You can make an invisible neverending link generator which spiders
> will descend into infinitely.  This can make a nice way of spotting bots and
> then banning their IP.  However it will only work once.  A suffiently 
> motivated attacker will just code around your tarpit.