[Chicago-talk] Limiting system impact.

[Dave Viner]

How about BSD::Resource?

http://search.cpan.org/~jhi/BSD-Resource-1.28/Resource.pm

another approach would be to process smaller segments of the data at  
a time... maybe process only 10,000 records, output results, erase  
them from memory, repeat until eof().

dave

On May 9, 2007, at 12:54 PM, tiger peng wrote:

> Nice may not be a nice solution. Try if the file can be chopped  
> down to small pieces
>
> ----- Original Message ----
> From: Don Drake <don at drakeconsult.com>
> To: Chicago.pm chatter <chicago-talk at pm.org>
> Sent: Wednesday, May 9, 2007 2:17:15 PM
> Subject: Re: [Chicago-talk] Limiting system impact.
>
> # man nice
>
> -Don
>
> -----Original Message-----
> From: chicago-talk-bounces+don=drakeconsult.com at pm.org
> [mailto:chicago-talk-bounces+don=drakeconsult.com at pm.org] On Behalf  
> Of Jim
> Jacobus
> Sent: Wednesday, May 09, 2007 2:13 PM
> To: chicago-talk at pm.org
> Subject: [Chicago-talk] Limiting system impact.
>
>
> Is there any way to limit, from within the Perl script, the amount of
> memory or CPU a Perl process utilizes? I've got a script on a Redhat
> Linux system that crunches a lot of data. Script and output are ok,
> but the process can take up to 30 minutes wall clock time. As a
> result the system appears to slow down considerably until the the
> script finishes. I tried adding a few WAIT commands in the script,
> but it didn't help much. The system reads some really large files,
> parses the info and stores it in some hashes for later processing. So
> I'm using I/o, memory and CPU. It would be good if I could lower the
> process priority of the script when it's running so the O/S could
> give more weight to other processes.
>
> _______________________________________________
> Chicago-talk mailing list
> Chicago-talk at pm.org
> http://mail.pm.org/mailman/listinfo/chicago-talk
>
> _______________________________________________
> Chicago-talk mailing list
> Chicago-talk at pm.org
> http://mail.pm.org/mailman/listinfo/chicago-talk
>
>
>
> _______________________________________________
> Chicago-talk mailing list
> Chicago-talk at pm.org
> http://mail.pm.org/mailman/listinfo/chicago-talk