Storing a lot of little files

Jens Schweikhardt schweikh at schweikhardt.net
Tue Jun 15 21:39:36 GMT 2004


I'm just brainstorming here, but...

#   I need to store a lot (hundreds of millions) of very little files (from 8 bytes
#   to 50K) in my filesystem.
#   What's the best way to optimize it?

What about not using a file system at all, but a database that maps
file names to contents? I'm not sure how well dbm(3) scales, or other
similar "simple" databases, but it might prove workable.

Regards,

	Jens
-- 
Jens Schweikhardt http://www.schweikhardt.net/
SIGSIG -- signature too long (core dumped)


More information about the freebsd-current mailing list