Fast diff command for large files?

Chuck Swiger cswiger at mac.com
Fri Nov 4 16:23:00 GMT 2005


Kirk Strauser wrote:
> I need to routinely find the diffs between two multigigabyte text files 
> (exporting a set of FoxPro tables to a PostgreSQL database without doing a 
> complete dump/reload each time, in case you were wondering).  GNU diff from 
> the base system and from ports chokes.  The textproc/2bsd-diff works OK, 
> but is glacially slow.

Multigigabyte?  Find another approach to solving the problem, a text-base diff 
is going to require excessive resources and time.  A 64-bit platform with 2 GB 
of RAM & 3GB of swap requires ~1000 seconds to diff ~400MB.

-- 
-Chuck


More information about the freebsd-questions mailing list