[Pdx-pm] DBI middle ground

[Michael Rasmussen]

I'm querying a large data set.  The current code works something like:

   while( @lease_information = $lease->fetchrow_array) {
         modification of data, plugging in defaults where currently null
         ensuring constraints are met
         # another_db_sth is an update command
         $another_db_sth->execute(@lease_information);
   }

I don't have control over the source database, so the changes need to be made in
my code.

This takes longer to execute than I'd like.  I can't just do a fetchall or
selectall because the dataset is larger than my available memory.  Nor have I
found a middle ground.

Is there one?  If so, that I may study up, what are references to it?

-- 
   Michael Rasmussen, Portland, Ore, USA
  Be Appropriate && Follow Your Curiosity
        http://www.patch.com/words/