redhat abe

[Jeff Pitman]

On Saturday 29 January 2005 02:44, seth vidal wrote:
> so tell me again how much saving you're going to get?

The exercise is to attempt a method in which you save computation of md5 
or sha1, as these are one of the time consuming steps of createrepo.  
The save would be in a 100k package repository: (100,000 - N) * 
Time(sum_calc), where N equals the number of packages that *need* to 
generate sums for. A parameterized list of package names passed into 
createrepo would be sufficient to figure out what composes the N list.  
An external process, such as a Manifest list, would then be used to 
mitigate a set of packages through the entire build process.  Apt uses 
a md5sum cache, but having fine-tuned controlled of the process would 
be more stable and directed. This is how much saving you'd get for #2.

Now for #1, to save tremendously on xml read in and write out, would 
require a re-think for the on-disk format. I know some are looking at a 
possible sqlite store .. which will be interesting ... berkley db with 
its binary tree store--allowing fast inserts--would also be 
interesting .. but I think our real win, at this time, would be #2.

-- 
-jeff