[Kc] Threads/fork/Event-based programming oh my (anyevent/coro)

[Peter Karman]

djgoku at gmail.com wrote on 11/1/12 10:50 PM:
> I haven't started writing code yet, but wanted input on where to start.
> 
> What I want to do is read in an input file, splice the input into
> configurable amount of chunks. Create a number of workers also configurable
> that go off and do work returning results or maybe even saving results to a
> database. After finishing wait for more work until all work is done and the
> last worker is finished and exit.
> 

lots of ways to approach this, depending on how you want to define "worker."

Gearman (and its ilk) is one way.

For less-heavy infrastructure, I like Parallel::Iterator.

-- 
Peter Karman  .  http://peknet.com/  .  peter at peknet.com