[dm-devel] RE: [Bugme-new] [Bug 7158] New: Out of memory happen in snapshot
kevin Cheng
kevin_cheng at thecus.com
Fri Sep 15 03:25:29 UTC 2006
Dear Alasdair:
Thanks for your help. We have capture the info about you want in the
follow.
And we have try to use chunk size 64KB ,it seens useful . And we get the
slabinfo in the next follow.
But the speed is very slow ,DISK IO throughtput just down to 1.68MB/s .
Have any to solve it?
Thanks!!
Kevin
----------------------------------------------------------------------------
-----------------
root at 127.0.0.1:~# /app/dmsetup info -c
Name Maj Min Stat Open Targ Event UUID
vg0-2006--09--15--10--32--35 253 7 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOOh53h60HLMcWIqLfCSt8vWO9B6DRhE5c
vg0-lv0-real 253 3 L--w 9 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOW1BfYcHj2lYmvnb1TzyRCzp9hUwHsRl1-real
vg0-2006--09--15--10--32--48 253 17 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VO2ryv6q3C0AxF4WxKdK0wNsgfaJW15uYA
vg0-2006--09--15--10--32--50 253 19 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOdLWwX9RWix7ufflxxcU8pYJ7ugTiTqcr
vg0-2006--09--15--10--32--46-cow 253 14 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOz0IxXWp1V2yB1E2GVNNuStIKS4HGDKul-cow
vg0-syslv 253 0 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOgjsjzAhmgflRymCKspDrRAWEtKTvxGC2
vg0-2006--09--15--10--32--37-cow 253 8 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOXgG6ht87GUFzownX6qboGAjj3aMoDdmB-cow
vg0-2006--09--15--10--32--29 253 5 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOK8ZP2bR28O99DZEXzZF5QmEIHtEyIt28
vg0-2006--09--15--10--32--46 253 15 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOz0IxXWp1V2yB1E2GVNNuStIKS4HGDKul
vg0-2006--09--15--10--32--50-cow 253 18 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOdLWwX9RWix7ufflxxcU8pYJ7ugTiTqcr-cow
vg0-2006--09--15--10--32--29-cow 253 4 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOK8ZP2bR28O99DZEXzZF5QmEIHtEyIt28-cow
vg0-2006--09--15--10--32--44 253 13 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOaSFou8q5Xb3asN9U8WN2RiXaHb9jjVT4
vg0-lv1 253 2 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VO5SUSILIIEM2gLYakhI8maNb1UFI21b1h
vg0-2006--09--15--10--32--48-cow 253 16 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VO2ryv6q3C0AxF4WxKdK0wNsgfaJW15uYA-cow
vg0-2006--09--15--10--32--39-cow 253 10 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOAR6hd59N2ljEz0QIfaEwDgpxNTFENo0B-cow
vg0-lv0 253 1 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOW1BfYcHj2lYmvnb1TzyRCzp9hUwHsRl1
vg0-2006--09--15--10--32--39 253 11 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOAR6hd59N2ljEz0QIfaEwDgpxNTFENo0B
vg0-2006--09--15--10--32--37 253 9 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOXgG6ht87GUFzownX6qboGAjj3aMoDdmB
vg0-2006--09--15--10--32--44-cow 253 12 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOaSFou8q5Xb3asN9U8WN2RiXaHb9jjVT4-cow
vg0-2006--09--15--10--32--35-cow 253 6 L--w 1 1 0
LVM-tyDxlOveI21xekkD63t1eYO42UhWM4VOOh53h60HLMcWIqLfCSt8vWO9B6DRhE5c-cow
root at 127.0.0.1:~# /app/dmsetup table
vg0-2006--09--15--10--32--35: 0 161906688 snapshot 253:3 253:6 P 128
vg0-lv0-real: 0 161906688 linear 9:0 2097536
vg0-2006--09--15--10--32--48: 0 161906688 snapshot 253:3 253:16 P 128
vg0-2006--09--15--10--32--50: 0 161906688 snapshot 253:3 253:18 P 128
vg0-2006--09--15--10--32--46-cow: 0 34603008 linear 9:0 360087936
vg0-syslv: 0 2097152 linear 9:0 384
vg0-2006--09--15--10--32--37-cow: 0 34603008 linear 9:0 256278912
vg0-2006--09--15--10--32--29: 0 161906688 snapshot 253:3 253:4 P 128
vg0-2006--09--15--10--32--46: 0 161906688 snapshot 253:3 253:14 P 128
vg0-2006--09--15--10--32--50-cow: 0 35446784 linear 9:0 429293952
vg0-2006--09--15--10--32--29-cow: 0 34603008 linear 9:0 187072896
vg0-2006--09--15--10--32--44: 0 161906688 snapshot 253:3 253:12 P 128
vg0-lv1: 0 23068672 linear 9:0 164004224
vg0-2006--09--15--10--32--48-cow: 0 34603008 linear 9:0 394690944
vg0-2006--09--15--10--32--39-cow: 0 34603008 linear 9:0 290881920
vg0-lv0: 0 161906688 snapshot-origin 253:3
vg0-2006--09--15--10--32--39: 0 161906688 snapshot 253:3 253:10 P 128
vg0-2006--09--15--10--32--37: 0 161906688 snapshot 253:3 253:8 P 128
vg0-2006--09--15--10--32--44-cow: 0 34603008 linear 9:0 325484928
vg0-2006--09--15--10--32--35-cow: 0 34603008 linear 9:0 221675904
root at 127.0.0.1:~# /app/dmsetup status
vg0-2006--09--15--10--32--35: 0 161906688 snapshot 5669120/34603008
vg0-lv0-real: 0 161906688 linear
vg0-2006--09--15--10--32--48: 0 161906688 snapshot 5669120/34603008
vg0-2006--09--15--10--32--50: 0 161906688 snapshot 5669120/35446784
vg0-2006--09--15--10--32--46-cow: 0 34603008 linear
vg0-syslv: 0 2097152 linear
vg0-2006--09--15--10--32--37-cow: 0 34603008 linear
vg0-2006--09--15--10--32--29: 0 161906688 snapshot 5669120/34603008
vg0-2006--09--15--10--32--46: 0 161906688 snapshot 5669120/34603008
vg0-2006--09--15--10--32--50-cow: 0 35446784 linear
vg0-2006--09--15--10--32--29-cow: 0 34603008 linear
vg0-2006--09--15--10--32--44: 0 161906688 snapshot 5669120/34603008
vg0-lv1: 0 23068672 linear
vg0-2006--09--15--10--32--48-cow: 0 34603008 linear
vg0-2006--09--15--10--32--39-cow: 0 34603008 linear
vg0-lv0: 0 161906688 snapshot-origin
vg0-2006--09--15--10--32--39: 0 161906688 snapshot 5669120/34603008
vg0-2006--09--15--10--32--37: 0 161906688 snapshot 5669120/34603008
vg0-2006--09--15--10--32--44-cow: 0 34603008 linear
vg0-2006--09--15--10--32--35-cow: 0 34603008 linear
----------------------------------------------------------------------------
----------------------------------------
Before:
kcopyd-jobs 512 525 264 15 1 : tunables 54 27 0 :
slabdata 35 35 0
dm-snapshot-in 128 177 64 59 1 : tunables 120 60 0 :
slabdata 3 3 0
dm-snapshot-ex 8 145 24 145 1 : tunables 120 60 0 :
slabdata 1 1 0
dm_tio 5120 5278 16 203 1 : tunables 120 60 0 :
slabdata 26 26 0
dm_io 5120 5239 20 169 1 : tunables 120 60 0 :
slabdata 31 31 0
journal_head 1 72 52 72 1 : tunables 120 60 0 :
slabdata 1 1 0
biovec-(256) 15 16 3072 2 2 : tunables 24 12 0 :
slabdata 8 8 0
biovec-128 23 25 1536 5 2 : tunables 24 12 0 :
slabdata 5 5 0
biovec-64 39 40 768 5 1 : tunables 54 27 0 :
slabdata 8 8 0
biovec-16 39 40 192 20 1 : tunables 120 60 0 :
slabdata 2 2 0
biovec-4 39 59 64 59 1 : tunables 120 60 0 :
slabdata 1 1 0
biovec-1 100 1218 16 203 1 : tunables 120 60 0 :
slabdata 6 6 0
bio 295 1050 128 30 1 : tunables 120 60 0 :
slabdata 35 35 0
buffer_head 1419 7560 52 72 1 : tunables 120 60 0 :
slabdata 105 105 0
After:
kcopyd-jobs 512 1290 264 15 1 : tunables 54 27 0 :
slabdata 86 86 0
dm-snapshot-in 129 1121 64 59 1 : tunables 120 60 0 :
slabdata 19 19 0
dm-snapshot-ex 97904 98020 24 145 1 : tunables 120 60 0 :
slabdata 676 676 0
dm_tio 5121 8526 16 203 1 : tunables 120 60 0 :
slabdata 42 42 0
dm_io 5121 6760 20 169 1 : tunables 120 60 0 :
slabdata 40 40 0
journal_head 15 576 52 72 1 : tunables 120 60 0 :
slabdata 8 8 0
biovec-(256) 15 16 3072 2 2 : tunables 24 12 0 :
slabdata 8 8 0
biovec-128 23 25 1536 5 2 : tunables 24 12 0 :
slabdata 5 5 0
biovec-64 40 70 768 5 1 : tunables 54 27 0 :
slabdata 14 14 0
biovec-16 40 140 192 20 1 : tunables 120 60 0 :
slabdata 5 7 0
biovec-4 40 118 64 59 1 : tunables 120 60 0 :
slabdata 2 2 0
biovec-1 81 2030 16 203 1 : tunables 120 60 0 :
slabdata 10 10 0
bio 318 2250 128 30 1 : tunables 120 60 0 :
slabdata 75 75 0
buffer_head 1331 12960 52 72 1 : tunables 120 60 0 :
slabdata 180 180 0
----------------------------------------------------------------------------
----------------------------------------
-----Original Message-----
From: Alasdair G Kergon [mailto:agk at redhat.com]
Sent: Thursday, September 14, 2006 9:33 PM
To: kevin Cheng
Cc: 'Andrew Morton'; 'bugme-daemon at kernel-bugs.osdl.org';
dm-devel at redhat.com; agk at redhat.com; mbroz at redhat.com
Subject: Re: [Bugme-new] [Bug 7158] New: Out of memory happen in snapshot
What is the output of these three commands?
dmsetup info -c
dmsetup table
dmsetup status
The current snapshot implementation does require a lot of kernel memory to
store each snapshot's exception table, which grows as there is new I/O.
Eight snapshots means eight times the memory needed by one snapshot.
Are you using the default chunk size? If so, try a larger one (lvcreate
-c).
Alasdair
--
agk at redhat.com
More information about the dm-devel
mailing list