[sf-perl] 406 Not Acceptable
extasia at extasia.org
Sat Jul 11 14:26:46 PDT 2009
it looks as though any agent string i specify is prepended to the
libwww-perl/... string, and doesn't replace it.
'def_headers' => HTTP::Headers=HASH(0xa32bf64)
'user-agent' => 'Firefox/3.0.11 libwww-perl/5.816'
and it still comes back with 406:
'server' => 'Apache/2.2.11 (Unix) mod_ssl/2.2.11
OpenSSL/0.9.8e-fips-rhel5 mod_auth_passthrough/2.1 mod_bwlimited/1.4
'title' => '406 Not Acceptable'
'_msg' => 'Not Acceptable'
'_protocol' => 'HTTP/1.1'
'_rc' => 406
On Sat, Jul 11, 2009 at 2:09 PM, Michael
Friedman<friedman at highwire.stanford.edu> wrote:
> I wonder if they started blocking the user agent 'libwww-perl/5.816'. When
> my company finds someone illegally spidering our sites, if they're using an
> uncommon user agent string, we often block based on that, so that others
> using the same spidering software can't get in.
> Try changing your user agent and see if that helps.
Live in a world of your own, but always welcome visitors.
More information about the SanFrancisco-pm