Using subversion's diff library as a standalone tool

Hello,

I'm currently scripting up a nightly process which takes several large
files (in the 500-900MB range) and does some sorting and diffing on them
compared to the corresponding files from the night before. The files are
plain text pipe separated data.

I've just been using gnu sort and diff, but the files have grown to the
stage where that is no longer ideal; in particular the gnu diff process
is running out of memory. I expect the data to grow pretty soon to be 5x
bigger.

A colleague suggested that the subversion diff implementation performed
well on big files, that there was some interest in a streaming version,
and it making is usable as a standalone tool.

Is the library suitable for my particular use? Has it been wrapped as a
standalone tool?

Regards,
Niall

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Received on Wed May 18 22:47:52 2005