Managing very large files

[Steve Bertrand]

> Check out Tie::File on CPAN. This Perl module treats every line in a
> file as an array element, and the array element is loaded into memory
> when it's being requested. In other words: This will work great with
> huge files such as these, as not the entire file is loaded into memory
> at once.
> 
> http://search.cpan.org/~mjd/Tie-File-0.96/lib/Tie/File.pm

Thanks everyone who replied to me regarding this issue.

The above appears to be my best approach.

Although I have not the time yet to look into Tie::Find (and I've never
used that module before) but I will.

So long as I can read chunks of the file, load the data into variables
(I like the array approach above) and process each array independently
without loading all of them at once into memory, and without having to
load the entire file into memory.

Tks!

Steve