[sf-perl] 406 Not Acceptable

[David Alban]

thanks, mike.

it looks as though any agent string i specify is prepended to the
libwww-perl/...  string, and doesn't replace it.

   'def_headers' => HTTP::Headers=HASH(0xa32bf64)
      'user-agent' => 'Firefox/3.0.11 libwww-perl/5.816'

and it still comes back with 406:

      'server' => 'Apache/2.2.11 (Unix) mod_ssl/2.2.11
OpenSSL/0.9.8e-fips-rhel5 mod_auth_passthrough/2.1 mod_bwlimited/1.4
FrontPage/5.0.2.2635 mod_jk/1.2.25'
      'title' => '406 Not Acceptable'
   '_msg' => 'Not Acceptable'
   '_protocol' => 'HTTP/1.1'
   '_rc' => 406


On Sat, Jul 11, 2009 at 2:09 PM, Michael
Friedman<friedman at highwire.stanford.edu> wrote:
> I wonder if they started blocking the user agent 'libwww-perl/5.816'. When
> my company finds someone illegally spidering our sites, if they're using an
> uncommon user agent string, we often block based on that, so that others
> using the same spidering software can't get in.
>
> Try changing your user agent and see if that helps.

-- 
Live in a world of your own, but always welcome visitors.