Re: Storing a lot of little files

From: Jens Schweikhardt <schweikh_at_schweikhardt.net>
Date: Tue, 15 Jun 2004 20:17:05 +0200
I'm just brainstorming here, but...

#   I need to store a lot (hundreds of millions) of very little files (from 8 bytes
#   to 50K) in my filesystem.
#   What's the best way to optimize it?

What about not using a file system at all, but a database that maps
file names to contents? I'm not sure how well dbm(3) scales, or other
similar "simple" databases, but it might prove workable.

Regards,

	Jens
-- 
Jens Schweikhardt http://www.schweikhardt.net/
SIGSIG -- signature too long (core dumped)
Received on Tue Jun 15 2004 - 19:39:36 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:37:57 UTC