Perl 5.8 threads and sockets problem

Jeremy Aiyadurai jeremygwa at hotmail.com
Thu Feb 27 13:08:43 CST 2003


Hi all,
Thanks for all your help so far. Is there any easy way to do this.
I've looked at POE (Perl Object Environment), but it is too confusing.

The script I am using is to test the use of sockets and threads or (forks)(I 
prefer perl 5.8 threads over forks because of memory). Basically, I would 
like to get this working so I can incorporate it into a program I am working 
on that will be a Win32 service (or unix Daemon) that checks many mail 
(pop3) accounts for new messages at the same time, every few minutes or 
seconds.

So that is the scoop.

Your help "has been" and "is" greatly appreciated.
Thanks,

Jeremy A.

The following script works for a couple seconds\minutes then exits (i dont 
know why)
#----------------------------

use IO::Socket qw(:DEFAULT :crlf);
use Strict;


my $pop3C;
my @thr = ();
my @Data = (
	 { 'UID' => "Jeremy", 'SVR' => "mail.host.com", 'PORT' => "110",
'LOGIN' => "jerdoe", 'PASS' => "****" },
	 { 'UID' => "Jon", 'SVR' => "mail.host.net", 'PORT' => "110",
'LOGIN' => "jondoe", 'PASS' => "*******" },
);
my $i = 0;

Startup();




sub Startup {
	$| = 0;
	for (;;) {
		foreach my $account (@Data) {
			if (-f $account->{'UID'}.".acc") {
	 			next;
  			}
			print "Forking $account->{UID}\n";

			#child
			my $pid = fork();
			if ($pid == 0){
				print "Child $account->{UID}\n";
				go($account);
				$account = undef;
				exit(0);
			}

                }

              sleep(1);
        }
  }



sub go() {
	my $ac = shift;
open(X,">".$ac->{UID}.".acc");
$pop3C = IO::Socket::INET->new(Proto => 'tcp', PeerAddr =>
	$ac->{SVR},
	PeerPort => $ac->{PORT} , Timeout => 0)
	and close(X) or pop3CError ($ac->{SVR},$ac->{PORT});
print "in $ac->{UID}\n";
$pop3C->close;
unlink($ac->{'UID'}.".acc");
$ac->{'UID'} = undef;
$ac->{'SVR'} = undef;
$ac->{'PORT'} = undef;
$ac->{'LOGIN'} = undef;
$ac->{'PASS'} = undef;
$pop3C = undef;
}

sub pop3CError ($$) {
close(X);
print "Cannot connect to the the Pop3 server:$_[0], port:$_[1]\n";
exit;

}
--------------------------------------
>From: "Jeremy Aiyadurai" <jeremygwa at hotmail.com>
>To: victoria-pm at pm.org
>Subject: Re: Perl 5.8 threads and sockets problem
>Date: Tue, 25 Feb 2003 16:28:55 -0800

>Hi all,
>
>Thanks for all your help so far.
>
>I am still having having problems with the forking.
>the script will only run for 30 or so seconds,
>before it exits.
>
>I am stumped on how to keep it running continously.
>
>The following is the code
>...............................................
>use IO::Socket qw(:DEFAULT :crlf);
>
>
>my $pop3C;
>my @thr = ();
>my @Data = (
>	 { 'UID' => "Jeremy", 'SVR' => "mail.h.y", 'PORT' => "110",
>'LOGIN' => "jerdoe", 'PASS' => "******" },
>	 { 'UID' => "Jon", 'SVR' => "mail.h.t", 'PORT' => "110",
>'LOGIN' => "jondoe", 'PASS' => "****" },
>);
>my $i = 0;
>
>Startup();
>
>
>sub Startup {
>               $| = 0;
>               for (;;) {
>		foreach my $account (@Data) {
>			if (-f $account->{'UID'}.".acc") {
>	 			next;
>  			}
>			print "Forking $account->{UID}\n";
>			my $pid = fork();
>			if ($pid == 0){
>                                # in child
>				print "Child $account->{UID}\n";
>				go($account);
>				$account = undef;
>				exit(0);
>			}
>
>                }
>
>              sleep(1);
>        }
>  }
>
>
>
>sub go() {
>	my $ac = shift;
>
>$pop3C = IO::Socket::INET->new(Proto => 'tcp', PeerAddr =>
>	$ac->{SVR},
>	PeerPort => $ac->{PORT} , Timeout => 0)
>	or pop3CError ($ac->{SVR},$ac->{PORT});
>open(X,">".$ac->{UID}.".acc");
>close(X);
>print "in $ac->{UID}\n";
>$pop3C->close;
>unlink($ac->{'UID'}.".acc");
>$ac->{'UID'} = undef;
>$ac->{'SVR'} = undef;
>$ac->{'PORT'} = undef;
>$ac->{'LOGIN'} = undef;
>$ac->{'PASS'} = undef;
>$pop3C = undef;
>}
>
>sub pop3CError ($$) {
>
>print "Cannot connect to the the Pop3 server:$_[0], port:$_[1]\n";
>exit;
>
>}
>..................................................
>
>
>Your help is much appreciated.
>Thanks,
>
>Jeremy A.
>
>
>
>
>
>
>>From: abez <abez at abez.ca>
>>To: Jeremy Aiyadurai <jeremygwa at hotmail.com>
>>CC: victoria-pm at pm.org
>>Subject: Re: Perl 5.8 threads and sockets problem
>>Date: Sun, 23 Feb 2003 22:10:03 -0800 (PST)
>>
>>
>>Well uncomment these lines, so that you "locking" works.
>> > 			#if (-f $account->{'UID'}.".acc") {
>> > 	 		#	next;
>> >   			#}
>>
>>I don't know WIN32 too well to guess about the memory but you might want 
>>to
>>print before that exit where $account = undef; exit; Just print you're 
>>closing
>>you might get better information.
>>
>>Also print debugging info to STDERR if possible it's default unbuffered.
>>
>>call wait() before you call sleep(1) and it will make sure your processes
>>aren't zombified.
>>
>>
>>On Sun, 23 Feb 2003, Jeremy Aiyadurai wrote:
>>
>> >
>> > Hi again,
>> >
>> > Thanks for all your help so far.
>> > I monitored my memory usage while running the script.
>> > It appears to slowly eat up memory. If i were to run this script day 
>>and
>> > night as long as I keep my computer on like a server, It would probably
>> > crash my system even though I have alot of SDRAM.
>> > Also, the script will run for a while, then crash and exit, does this 
>>have
>> > to do with fork (thread) races?
>> > eg. it ends like this
>> > "
>> > in Jeremy
>> > in Jon
>> > Forking Jeremy
>> > Forking Jon
>> > Child Jeremy
>> > Child Jon
>> > in Jeremy
>> > in Jon
>> > Forking Jeremy
>> > Child Jeremy
>> > in Jeremy" - exits here? don't know why? when three jeremy's are in
>> > sequence, the program terminates.
>> >
>> > Your Help is greatly appreciated
>> >
>> > Thanks,
>> > Jeremy A.
>> >
>> > here is the script now with the prints "Forking $UID","Child $UID" and 
>>"in
>> > $UID".
>> > ---------------------------
>> > use IO::Socket qw(:DEFAULT :crlf);
>> > use Win32;
>> >
>> >
>> > my @thr = ();
>> > my @Data = (
>> > 	 { 'UID' => "Jeremy", 'SVR' => "mail.host.net", 'PORT' => "110",
>> > 'LOGIN' => "jerdoe", 'PASS' => "********" },
>> > 	 { 'UID' => "Jon", 'SVR' => "mail.host.net", 'PORT' => "110",
>> > 'LOGIN' => "jondoe", 'PASS' => "*****" },
>> > );
>> > my $i = 0;
>> >
>> > Startup();
>> >
>> > #foreach my $account (@Data) {
>> > #	$str = " rm -f $account->{UID}.acc ";
>> > #	`$str`;
>> > #}
>> >
>> >
>> > sub Startup {
>> > 	for (;;) {
>> >       #Win32::Sleep(4000);
>> > 		$| = 0;
>> > 		foreach my $account (@Data) {
>> > 			#if (-f $account->{'UID'}.".acc") {
>> > 	 		#	next;
>> >   			#}
>> > 			print "Forking $account->{UID}\n";
>> > 			my $pid = fork();
>> > 			if ($pid==0) { #child
>> > 				print "Child $account->{UID}\n";
>> > 				go($account);
>> > 				$account = undef;
>> > 				exit();
>> > 			}
>> >
>> >                 }
>> >                 sleep(1);
>> >         }
>> >   }
>> >
>> >
>> >
>> >
>> > sub go() {
>> > 	my $ac = shift;
>> >
>> > my $pop3C = IO::Socket::INET->new(Proto => 'tcp', PeerAddr =>
>> > 	$ac->{SVR},
>> > 	PeerPort => $ac->{PORT} , Timeout => 0)
>> > 	or pop3CError ($ac->{SVR},$ac->{PORT});
>> > open(X,">".$ac->{UID}.".acc");
>> > close(X);
>> > print "in $ac->{UID}\n";
>> > Win32::Sleep(4000);
>> > $pop3C->close;
>> > $ac->{'UID'} = undef;
>> > $ac->{'SVR'} = undef;
>> > $ac->{'PORT'} = undef;
>> > $ac->{'LOGIN'} = undef;
>> > $ac->{'PASS'} = undef;
>> > $pop3C = undef;
>> > unlink($_[1].".acc");
>> > }
>> >
>> > sub pop3CError ($$) {
>> >
>> > print "Cannot connect to the the Pop3 server:$_[0], port:$_[1]\n";
>> > exit;
>> >
>> > }
>> >
>> >
>> >
>> >
>> > >From: abez <abez at abez.ca>
>> > >To: Jeremy Aiyadurai <jeremygwa at hotmail.com>
>> > >CC: victoria-pm at pm.org
>> > >Subject: Re: Perl 5.8 threads and sockets problem
>> > >Date: Sun, 23 Feb 2003 20:35:24 -0800 (PST)
>> > >
>> > >
>> > >
>> > >Here's what I'd do:
>> > >
>> > >use IO::Socket qw(:DEFAULT :crlf);
>> > >
>> > >my @thr = ();
>> > >my @Data = (
>> > >	 { 'UID' => "abez", 'SVR' => "lycos.com", 'PORT' => "80",
>> > >'LOGIN' => "abez", 'PASS' => "******" },
>> > >	 { 'UID' => "casper", 'SVR' => "www.metafilter.com", 'PORT' => "80",
>> > >'LOGIN' => "casper", 'PASS' => "*****" },
>> > >);
>> > >my $i = 0;
>> > >
>> > >Startup();
>> > >
>> > >foreach my $account (@Data) {
>> > >	$str = " rm -f $account->{UID}.acc ";
>> > >	`$str`;
>> > >}
>> > >
>> > >$| = 0;
>> > >sub Startup {
>> > >	for (;;) {
>> > >       #Win32::Sleep(4000);
>> > >		foreach my $account (@Data) {
>> > >			#if (-f $account->{'UID'}.".acc") {
>> > >  	 		#	next;
>> > >   			#}
>> > >			print "Forking $account->{UID}\n";
>> > >			my $pid = fork();
>> > >			if ($pid==0) { #child
>> > >				print "Child $account->{UID}\n";
>> > >				go($account);
>> > >				exit();
>> > >			}
>> > >                 }
>> > >		sleep(10);
>> > >         }
>> > >   }
>> > >
>> > >
>> > >
>> > >
>> > >sub go($$$$$) {
>> > >	my $account = shift;
>> > >
>> > >my $pop3C = IO::Socket::INET->new(Proto => 'tcp', PeerAddr =>
>> > >	$account->{SVR},
>> > >	PeerPort => $account->{PORT} , Timeout => 60)
>> > >	or pop3CError ($account->{SVR},$account->{PORT});
>> > >open(X,">".$account->{UID}.".acc");
>> > >close(X);
>> > >print "in $account->{UID}\n";
>> > >print $pop3C "GET /\n";
>> > >my @out = <$pop3C>;
>> > >print join("", at out[0..10]),"\n";
>> > >$pop3C->close;
>> > >
>> > >$pop3C = undef;
>> > >unlink($_[1].".acc");
>> > >}
>> > >
>> > >sub pop3CError ($$) {
>> > >
>> > >print "Cannot connect to the the Pop3 server:$_[0], port:$_[1]\n";
>> > >exit;
>> > >
>> > >}
>> > >
>> > >
>> > >
>> > >On Sun, 23 Feb 2003, Jeremy Aiyadurai wrote:
>> > >
>> > > > hi All,
>> > > >
>> > > > Thanks for your help so far.
>> > > >
>> > > > I tried threads->create, it made no difference,
>> > > > as mentioned in the manpage, "The new() method is an alias for 
>>create().
>> > >"
>> > > >
>> > > > Your Help is much appreciated,
>> > > > thanks
>> > > >
>> > > > Jeremy A.
>> > > >
>> > > > >From: abez <abez at abez.ca>
>> > > > >To: Jeremy Aiyadurai <jeremygwa at hotmail.com>
>> > > > >CC: victoria-pm at pm.org
>> > > > >Subject: Re: Perl 5.8 threads and sockets problem
>> > > > >Date: Sun, 23 Feb 2003 18:38:16 -0800 (PST)
>> > > > >
>> > > > >
>> > > > >First of all try threads->create, rather than new. Other than that 
>>I'm
>> > >too
>> > > > >dizzy to really help right now (flu).
>> > > > >
>> > > > >On Sun, 23 Feb 2003, Jeremy Aiyadurai wrote:
>> > > > >
>> > > > > >
>> > > > > > Hello all,
>> > > > > >
>> > > > > > I am new to the group.
>> > > > > > I have a problem involving sockets and threads.
>> > > > > >
>> > > > > > Basically, I want to be able to do two or more pop3 sessions
>> > > > >simultaniously
>> > > > > > using a list of different pop3 accounts.
>> > > > > > my problem is, I can logon to the first account, but when
>> > > > > > it comes to the second account's turn (in the second thread), 
>>the
>> > >socket
>> > > > > > cannot be created.
>> > > > > >
>> > > > > > I am new to using threads and have little knowledge of sockets.
>> > > > > >
>> > > > > > Your Help is much appreciated,
>> > > > > >
>> > > > > > Thanks,
>> > > > > >
>> > > > > > Jeremy A.
>> > > > > >
>> > > > > > Below is my test script I am having trouble with.
>> > > > > >
>> > > > > >
>> > > > > > #-----------------------------------------------------
>> > > > > > use threads;
>> > > > > > use Win32;
>> > > > > > use IO::Socket qw(:DEFAULT :crlf);
>> > > > > >
>> > > > > >
>> > > > > > my @thr;
>> > > > > > my @Data;
>> > > > > > $Data[0] = { 'UID' => "Jeremy", 'SVR' => "mail.host.net", 
>>'PORT' =>
>> > > > >"110",
>> > > > > > 'LOGIN' => "account1", 'PASS' => "******" };
>> > > > > > $Data[1] = { 'UID' => "Dave", 'SVR' => "mail.bost.com", 'PORT' 
>>=>
>> > >"110",
>> > > > > > 'LOGIN' => "account2", 'PASS' => "*****" };
>> > > > > > my $i = 0;
>> > > > > >
>> > > > > > sub Startup {
>> > > > > >     while (1) {
>> > > > > >       Win32::Sleep(4000);
>> > > > > >         foreach my $account (@Data)
>> > > > > >         {
>> > > > > >                 if(!open(T,"".$account->{'UID'}.".acc"))
>> > > > > >                 {
>> > > > > >   		Win32::Sleep(40);
>> > > > > >   		if($i != 0)
>> > > > > >   		{
>> > > > > >   		 $i = $i + 1;
>> > > > > >   		}
>> > > > > >   		$thr[$i] =
>> > > > > >
>> > > >
>> > > 
>> >threads->new(\&go,$account->{'UID'},$account->{'SVR'},$account->{'PORT'},$account->{'LOGIN'},$account->{'PASS'});
>> > > > > > 		$thr[$i]->join;
>> > > > > >                 }else
>> > > > > >                 {
>> > > > > >                         close(T);
>> > > > > >                 }
>> > > > > >                 $i = $i - 1;
>> > > > > >
>> > > > > >         }
>> > > > > >   }
>> > > > > >   @AC = -1;
>> > > > > > }
>> > > > > >
>> > > > > > Startup();
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > sub go($$$$$) {
>> > > > > > print "$_[0],$_[1],$_[2],$_[3],$_[4],$_[5],$_[6]\n";
>> > > > > >
>> > > > > > my $pop3C = IO::Socket::INET->new(Proto => 'tcp', PeerAddr =>
>> > >"$_[1]",
>> > > > > > PeerPort => $_[2], Timeout => 60) or pop3CError ($_[1],$_[2]);
>> > > > > > open(X,">".$_[1].".acc");
>> > > > > > close(X);
>> > > > > > print "in $_[1]\n";
>> > > > > > sleep(1);
>> > > > > > pop3close($pop3C);
>> > > > > > $pop3C = undef;
>> > > > > > unlink($_[1].".acc");
>> > > > > > }
>> > > > > >
>> > > > > >
>> > > > > > sub pop3CError ($$) {
>> > > > > >
>> > > > > > print "Cannot connect to the the Pop3 server:$_[0], 
>>port:$_[1]\n";
>> > > > > > exit;
>> > > > > >
>> > > > > > }
>> > > > > >
>> > > > > >
>> > > > > > sub pop3close ($) {
>> > > > > > 	if ($_[0]) {
>> > > > > > 	 shutdown ($_[0], 2);
>> > > > > > 	}
>> > > > > > }
>> > > > > > #-----------------------------------------------------
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > 
>>_________________________________________________________________
>> > > > > > The new MSN 8: smart spam protection and 2 months FREE*
>> > > > > > http://join.msn.com/?page=features/junkmail
>> > > > > >
>> > > > >
>> > > > >--
>> > > > >abez ------------------------------------------
>> > > > >http://www.abez.ca/ Abram Hindle (abez at abez.ca)
>> > > > >------------------------------------------ abez
>> > > >
>> > > >
>> > > > _________________________________________________________________
>> > > > Add photos to your messages with MSN 8. Get 2 months FREE*.
>> > > > http://join.msn.com/?page=features/featuredemail
>> > > >
>> > >
>> > >--
>> > >abez ------------------------------------------
>> > >http://www.abez.ca/ Abram Hindle (abez at abez.ca)
>> > >------------------------------------------ abez
>> >
>> >
>> > _________________________________________________________________
>> > Help STOP SPAM with the new MSN 8 and get 2 months FREE*
>> > http://join.msn.com/?page=features/junkmail
>> >
>>
>>--
>>abez ------------------------------------------
>>http://www.abez.ca/ Abram Hindle (abez at abez.ca)
>>------------------------------------------ abez
>
>
>_________________________________________________________________
>Help STOP SPAM with the new MSN 8 and get 2 months FREE*   
>http://join.msn.com/?page=features/junkmail
>


_________________________________________________________________
Tired of spam? Get advanced junk mail protection with MSN 8.  
http://join.msn.com/?page=features/junkmail




More information about the Victoria-pm mailing list