SPUG: Sorting a big file

Dan Ebert mathin at mathin.com
Fri Aug 27 14:53:29 CDT 2004


I have a large file (~1 million lines, ~142MB) which I need to sort (any
order is fine, just so the lines are in a repeatable order).

Just using perl's 'sort' on the file read into an array eats up all the
RAM and swap on my box and crashes.  I'm also trying tying the file as an
array, but it looks like that is also going to use up all the memory. Does
anyone know some other methods I could try?

Thanks,


Dan.
----------------------------------------------------------
Immigration is the sincerest form of flattery.
	- Unknown
----------------------------------------------------------





More information about the spug-list mailing list