memory problem

lingu hicheerup at gmail.com
Mon Oct 13 11:24:16 UTC 2008


Hi,

  Its clearly indicates you are running out of memory and in the
syslog its indicating the oracle is the process eating up your memory
causing the OOM killer to kill that process and retains the operating
system in normal state.

 Try to find out the cause of the memory hang, and also check the swap
space also  during this type of scenario swap space will be fully
utilized.

>From system side you have to check top,sar,vmstat for load and i/o and
 swap in an swap out stats respectively.

  Also try to check for oracle logs becasue in my case we facerd the
same  issue and later found that   certain queries from application
server casuing 1000 instances on the databse.

 In my case  DBA team fixed those issue, also if you are running
critical application increase you physical ram to another 8GB will
give you some temp  solution.But check   your oracle part.

Note: Also dont create swap size of more than 4 GB it make your system
little slow because of some HUGE I/O for bigger space.





On Fri, Oct 10, 2008 at 12:34 PM, Koray Sonmez [Oytek]
<ksonmez at oytek.com.tr> wrote:
> Hi,
>
>
>
> One of my server got below messages and restart. I think it is a memory
> problem. I try to understand is this physically problem or insufficient
> memory?
>
>
>
> Regards,
>
>
>
>
>
> Oct 10 07:06:59 erpdb kernel: Swap cache: add 58162, delete 58008, find
> 23885/27181, race 0+0
>
> Oct 10 07:06:59 erpdb kernel: 0 bounce buffer pages
>
> Oct 10 07:06:59 erpdb kernel: Free swap:       32766196kB
>
> Oct 10 07:06:59 erpdb kernel: 8650752 pages of RAM
>
> Oct 10 07:06:59 erpdb kernel: 7602176 pages of HIGHMEM
>
> Oct 10 07:06:59 erpdb kernel: 332197 reserved pages
>
> Oct 10 07:06:59 erpdb kernel: 21261599 pages shared
>
> Oct 10 07:06:59 erpdb kernel: 154 pages swap cached
>
> Oct 10 07:06:59 erpdb kernel: Out of Memory: Killed process 23557
> (oracle).
>
> Oct 10 07:06:59 erpdb kernel: oom-killer: gfp_mask=0xd0
>
> Oct 10 07:06:59 erpdb kernel: Mem-info:
>
> Oct 10 07:06:59 erpdb kernel: DMA per-cpu:
>
> Oct 10 07:06:59 erpdb kernel: cpu 0 hot: low 2, high 6, batch 1
>
> Oct 10 07:06:59 erpdb kernel: cpu 0 cold: low 0, high 2, batch 1
>
> Oct 10 07:06:59 erpdb kernel: cpu 1 hot: low 2, high 6, batch 1
>
> Oct 10 07:06:59 erpdb kernel: cpu 1 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 2 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 2 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 3 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 3 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 4 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 4 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 5 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 5 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 6 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 6 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 7 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 7 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 8 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 8 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 9 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 9 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:00 erpdb kernel: cpu 10 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 10 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 11 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 11 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 12 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 12 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 13 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 13 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 14 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 14 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 15 hot: low 2, high 6, batch 1
>
> Oct 10 07:07:01 erpdb kernel: cpu 15 cold: low 0, high 2, batch 1
>
> Oct 10 07:07:01 erpdb kernel: Normal per-cpu:
>
> Oct 10 07:07:01 erpdb kernel: cpu 0 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:01 erpdb kernel: cpu 0 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:01 erpdb kernel: cpu 1 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:01 erpdb kernel: cpu 1 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:01 erpdb kernel: cpu 2 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:01 erpdb kernel: cpu 2 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 3 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 3 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 4 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 4 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 5 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 5 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 6 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 6 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 7 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 7 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 8 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 8 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 9 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 9 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 10 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 10 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 11 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 11 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:02 erpdb kernel: cpu 12 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 12 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 13 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 13 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 14 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 14 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 15 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 15 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: HighMem per-cpu:
>
> Oct 10 07:07:03 erpdb kernel: cpu 0 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 0 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 1 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 1 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 2 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 2 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 3 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 3 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 4 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 4 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 5 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 5 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 6 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 6 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:03 erpdb kernel: cpu 7 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 7 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 8 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 8 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 9 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 9 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 10 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 10 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 11 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 11 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 12 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 12 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 13 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 13 cold: low 0, high 32, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 14 hot: low 32, high 96, batch 16
>
> Oct 10 07:07:04 erpdb kernel: cpu 14 cold: low 0, high 32, batch 16
>
> Oct 10 09:20:29 erpdb syslogd 1.4.1: restart.
>
> Oct 10 09:20:29 erpdb syslog: syslogd startup succeeded
>
> Oct 10 09:20:29 erpdb kernel: klogd 1.4.1, log source = /proc/kmsg
> started.
>
> Oct 10 09:20:29 erpdb syslog: klogd startup succeeded
>
> Oct 10 09:20:29 erpdb kernel: Linux version 2.6.9-55.ELhugemem
> (brewbuilder at ls20-bc2-14.build.redhat.com) (gcc version 3.4.6 20060404
> (Red Hat 3.4.6-3)) #1 SMP Fri Apr 20 17:20:11 EDT 2007
>
> Oct 10 09:20:29 erpdb kernel: BIOS-provided physical RAM map:
>
> Oct 10 09:20:29 erpdb kernel:  BIOS-e820: 0000000000000000 -
> 000000000009bc00 (usable)
>
> Oct 10 09:20:29 erpdb kernel:  BIOS-e820: 000000000009bc00 -
> 00000000000a0000 (reserved)
>
> Oct 10 09:20:29 erpdb kernel:  BIOS-e820: 00000000000e0000 -
> 0000000000100000 (reserved)
>
> Oct 10 09:20:29 erpdb kernel:  BIOS-e820: 0000000000100000 -
> 00000000bff4b380 (usable)
>
>
> Bu e-mail'in tum icerigi gonderenin kisisel tasarrufu ile olusturulmus ve gonderilmistir. Oyak Teknoloji Bilisim ve Kart Hizmetleri A.S. bu e-mail icerigi hakkinda sorumluluk kabul etmez.
> This e-mail has been sent by the sender under his/her own individual discretion. Oyak Teknoloji Bilisim ve Kart Hizmetleri A.S. accepts no responsibility.
> --
> redhat-list mailing list
> unsubscribe mailto:redhat-list-request at redhat.com?subjectunsubscribe
> https://www.redhat.com/mailman/listinfo/redhat-list
>




More information about the redhat-list mailing list