[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: ext3 2.4.21 htree tests



I am seeing about a 10 percent improvement with htree and
these are without any further tweaking which I hope to improve
a bit more.  I am real curious to see how it performs over NFS
which is in my queue of tests I want to run.

Without htree:

PostMark v1.5 : 3/27/01
pm>set number 50000
pm>set transactions 30000
pm>set location /mnt/scsi
pm>run
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Time:
        663 seconds total
        455 seconds of transactions (65 per second)

Files:
        65003 created (98 per second)
                Creation alone: 50000 files (253 per second)
                Mixed with transactions: 15003 files (32 per second)
        14944 read (32 per second)
        15051 appended (33 per second)
        65003 deleted (98 per second)
                Deletion alone: 50006 files (4546 per second)
                Mixed with transactions: 14997 files (32 per second)


With htree:

PostMark v1.5 : 3/27/01
pm>set number 50000
pm>set transactions 30000
pm>set location /mnt/scsi
pm>run
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Time:
        601 seconds total
        403 seconds of transactions (74 per second)

Files:
        65003 created (108 per second)
                Creation alone: 50000 files (265 per second)
                Mixed with transactions: 15003 files (37 per second)
        14944 read (37 per second)
        15051 appended (37 per second)
        65003 deleted (108 per second)
                Deletion alone: 50006 files (5000 per second)
                Mixed with transactions: 14997 files (37 per second)

So far I am happy with the results but I will continue to test.


Steve


Stephen C. Tweedie wrote:


Hi,

On Wed, 2003-06-18 at 12:02, glen wrote:




Files spread over 100 directories:

Create : 1764, N/A, 1078
Remove : 611, N/A, 1310

Ok so results are not that great - better to use more directories.

Files spread over 1000 directories:

Create: 409, 305, 284
Remove: 138, 96, 141



Why use more directories? That just means that you spend more time updating more metadata for more directories. The point of htree is to let the fs do this work itself, as efficiently as possible: if you try with _1_ directory, you should see the best benefit from htree.

However, the performance still doesn't look that good, especially on the
100 dirs case (10,000 files per dir) --- are you sure you set the
dir-index flag on the filesystem to enable htree operation?

Cheers,
Stephen


_______________________________________________ Ext3-users mailing list Ext3-users redhat com https://www.redhat.com/mailman/listinfo/ext3-users









[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]