[Nottingham-pm] Monitoring website uptimes

auto@jwdt.co.uk auto at jwdt.co.uk
Tue Jul 29 12:07:06 PDT 2014


I've done it in bash before a while ago, using wget. Though it was more a "download this page every minute and take some data from it" script, there was a bit of error reporting in there too. If I can find it I might be able to bring something to the table. :-)

Sent from my HTC

----- Reply message -----
From: "Duncan Fyfe" <duncanfyfe at domenlas.com>
To: "The Nottingham Perl Mongers" <nottingham-pm at pm.org>
Subject: [Nottingham-pm] Monitoring website uptimes
Date: Tue, Jul 29, 2014 19:45

On 29/07/14 18:35, James Green wrote:
> Hey folks,
> 
> Rather than my usual meeting-arranging blather on this list ... I have
> an actual Perl-related question! OK, it's not very Perl related.
> 
> Following a bunch of recent conversations about the future of
> search.cpan.org, and the fact it was seemingly down all the time, I've
> started gathering stats on when both it, and metacpan.org, are
> unreachable.
> 
> Unfortunately I'm getting a lot of what I suspect are false positives.
> I'm using LWP::UserAgent to get() a specific search page from each
> site, timing out after 30s, and if it hasn't loaded, considering it
> "down" until the next check. This process runs every 2 minutes, from
> cron. Quite often a site will fail to load just once, then be back up
> the next time -- which is as likely to be a transient routing problem
> at my end as an issue at theirs.
> 
> Does anyone have experience monitoring the availability of websites,
> or exciting ideas for better approaches to this data?
> 

Quick check, details below, but for starters it looks like there might
be a reverse DNS problem with metacpan.org. I'll have a more detailed
look later.

Have fun,
Duncan

=== DETAILS ===
nslookup search.cpan.org
Server:  194.168.4.100
Address: 194.168.4.100#53

Non-authoritative answer:
search.cpan.org canonical name = cpansearch.perl.org.
Name: cpansearch.perl.org
Address: 207.171.7.59
Name: cpansearch.perl.org
Address: 207.171.7.49

wget http://search.cpan.org/search?query=Moose&mode=all
OK
wget http://207.171.7.59/search?query=Moose&mode=all
OK
wget http://207.171.7.49/search?query=Moose&mode=all
OK

nslookup metacpan.org
Server:  194.168.4.100
Address: 194.168.4.100#53

Non-authoritative answer:
Name: metacpan.org
Address: 23.235.37.143
Name: metacpan.org
Address: 23.235.33.143

wget https://metacpan.org/search?q=Moose
OK

wget --no-check-certificate https://23.235.37.143/search?q=Moose
--2014-07-29 19:04:46--  https://23.235.37.143/search?q=Moose
Connecting to 23.235.37.143:443... connected.
The certificate's owner does not match hostname ‘23.235.37.143’
HTTP request sent, awaiting response... 500 Domain Not Found
2014-07-29 19:04:46 ERROR 500: Domain Not Found.


wget --no-check-certificate https://23.235.33.143/search?q=Moose
--2014-07-29 19:05:15--  https://23.235.33.143/search?q=Moose
Connecting to 23.235.33.143:443... connected.
The certificate's owner does not match hostname ‘23.235.33.143’
HTTP request sent, awaiting response... 500 Domain Not Found
2014-07-29 19:05:15 ERROR 500: Domain Not Found.

nslookup 23.235.37.143
Server:  194.168.4.100
Address: 194.168.4.100#53

** server can't find 143.37.235.23.in-addr.arpa: NXDOMAIN

nslookup 23.235.33.143
Server:  194.168.4.100
Address: 194.168.4.100#53

** server can't find 143.33.235.23.in-addr.arpa: NXDOMAIN

ping -q -c 10 23.235.37.143
PING 23.235.37.143 (23.235.37.143) 56(84) bytes of data.

--- 23.235.37.143 ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 9014ms
rtt min/avg/max/mdev = 25.587/27.657/37.575/3.352 ms


ping -q -c 10 23.235.33.143
PING 23.235.33.143 (23.235.33.143) 56(84) bytes of data.

--- 23.235.33.143 ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 9013ms
rtt min/avg/max/mdev = 29.846/32.689/43.296/3.717 ms



_______________________________________________
Nottingham-pm mailing list
Nottingham-pm at pm.org
http://mail.pm.org/mailman/listinfo/nottingham-pm
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/nottingham-pm/attachments/20140729/fc7fa85f/attachment.html>


More information about the Nottingham-pm mailing list