[San-Diego-pm] odd chars in file "Killing" my console
pm at bionikchickens.com
Wed Nov 10 19:57:10 PST 2010
Chris, are you able to post the file to a public place for us to look? Feel
free to PM me as well.
On Wed, Nov 10, 2010 at 6:56 PM, Christopher Hahn <xrz1138 at gmail.com> wrote:
> Hey team,
> I am trying to parse a huge (7 Gb) file that is line oriented but has
> large sections
> that are any kind of binary character.
> (this is a p42svn dump file of a large perforce repository)
> I tried several smarter things, but found the after running for a while
> my console would just close....dead, gone:
> administrator at cmSVNDumper-09:/p42svn/testing$ ./p4dump-parse-new.pl
> I am sure that there are odd chars in the file that are doing this....
> I tried setting binmode on the input file handle, and just loading the
> file into a buffer, just as a test, as we have enough memory to do this.
> The result:
> open(OUTF, ">SM_amanda_238037_fixed.dump")
> or die "Opening output file failed: $!";
> open(INF, "SM_amanda_238037_bad.dump")
> or die "Opening input file failed: $!";
> binmode INF;
> my @buffer = <INF>;
> print OUTF @buffer;
> I watched using "top" and after the memory used climbed to a tad
> more than the size of the file, the "Killed" message appeared and the
> console closed itself.
> I have to stay at work until this is done, and so am just hoping the
> someone if online and can give me the kick in the head that I need.
> In any case, thanks for the attention,
> Realisant mon espoir, je me lance vers la gloire.
> Christopher Hahn == xrz1138 at gmail.com
> San-Diego-pm mailing list
> San-Diego-pm at pm.org
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the San-Diego-pm