[Linux-cluster] RHEL 5 standard installation

Asim Husanovic asim.husanovic at gmail.com
Wed Feb 13 16:35:58 UTC 2008


Hi

I install RHEL 5 standard installation

# uname -a
Linux yildiz.hermes.si 2.6.18-8.el5 #1 SMP Fri Jan 26 14:15:21 EST
2007 i686 i68   6 i386 GNU/Linux

with:

gfs-utils-0.1.11-1.el5
cman-2.0.60-1.el5
system-config-cluster-1.0.39-1.0
rgmanager-2.0.23-1
gnbd-1.1.5-1.el5
openais-0.80.2-1.el5
gfs2-utils-0.1.25-1.el5
lvm2-cluster-2.02.16-3.el5
kmod-gfs-0.1.16-5.2.6.18_8.el5
perl-Net-Telnet-3.03-5

# fdisk -l

Disk /dev/sda: 21.4 GB, 21474836480 bytes
255 heads, 63 sectors/track, 2610 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          13      104391   83  Linux
/dev/sda2              14        2610    20860402+  8e  Linux LVM

Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1        1044     8385898+  8e  Linux LVM

Disk /dev/sdc: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1               1        1044     8385898+  8e  Linux LVM

# vgdisplay -v /dev/VG_SHARE
    Using volume group(s) on command line
    Finding volume group "VG_SHARE"
  --- Volume group ---
  VG Name               VG_SHARE
  System ID
  Format                lvm2
  Metadata Areas        2
  Metadata Sequence No  3
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                1
  Open LV               0
  Max PV                0
  Cur PV                2
  Act PV                2
  VG Size               15.99 GB
  PE Size               4.00 MB
  Total PE              4094
  Alloc PE / Size       1002 / 3.91 GB
  Free  PE / Size       3092 / 12.08 GB
  VG UUID               MrlGGd-jg7O-OfZa-rxIm-9CUC-PyJ8-tgDITt

  --- Logical volume ---
  LV Name                /dev/VG_SHARE/LV_SHARE
  VG Name                VG_SHARE
  LV UUID                sjwBZq-8HL6-CnjK-iqGo-mkQk-vHvy-6Vkjbx
  LV Write Access        read/write
  LV Status              available
  # open                 0
  LV Size                3.91 GB
  Current LE             1002
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:2

  --- Physical volumes ---
  PV Name               /dev/sdb1
  PV UUID               rEgx77-JfwD-zazd-S1lZ-GaX0-STbY-532TD2
  PV Status             allocatable
  Total PE / Free PE    2047 / 1045

  PV Name               /dev/sdc1
  PV UUID               J1MUR6-chsV-sqqV-uAG5-jxBD-CJEv-ufooJs
  PV Status             allocatable
  Total PE / Free PE    2047 / 2047

# service cman start
Starting cluster:
   Loading modules... done
   Mounting configfs... done
   Starting ccsd... done
   Starting cman... failed

                                                           [FAILED]

# tail -f /var/log/messages
Feb 12 14:36:58 yildiz ccsd[2921]: Starting ccsd 2.0.60:
Feb 12 14:36:58 yildiz ccsd[2921]:  Built: Jan 23 2007 12:42:25
Feb 12 14:36:58 yildiz ccsd[2921]:  Copyright (C) Red Hat, Inc.  2004
All rights reserved.
Feb 12 14:36:58 yildiz ccsd[2921]: cluster.conf (cluster name =
RHEL5_CS, version = 1) found.
Feb 12 14:36:58 yildiz ccsd[2921]: Remote copy of cluster.conf is from
quorate node.
Feb 12 14:36:58 yildiz ccsd[2921]:  Local version # : 1
Feb 12 14:36:58 yildiz ccsd[2921]:  Remote version #: 1
Feb 12 14:36:58 yildiz ccsd[2921]: Remote copy of cluster.conf is from
quorate node.
Feb 12 14:36:58 yildiz ccsd[2921]:  Local version # : 1
Feb 12 14:36:58 yildiz ccsd[2921]:  Remote version #: 1
Feb 12 14:36:58 yildiz ccsd[2921]: Remote copy of cluster.conf is from
quorate node.
Feb 12 14:36:58 yildiz ccsd[2921]:  Local version # : 1
Feb 12 14:36:58 yildiz ccsd[2921]:  Remote version #: 1
Feb 12 14:36:58 yildiz ccsd[2921]: Remote copy of cluster.conf is from
quorate node.
Feb 12 14:36:58 yildiz ccsd[2921]:  Local version # : 1
Feb 12 14:36:58 yildiz ccsd[2921]:  Remote version #: 1
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] AIS Executive Service
RELEASE 'subrev 1324 version 0.80.2'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Copyright (C) 2002-2006
MontaVista Software, Inc and contributors.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Copyright (C) 2006 Red Hat, Inc.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] AIS Executive Service:
started and ready to provide service.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Using default multicast
address of 239.192.76.169
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_cpg loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais cluster closed process group service v1.01'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_cfg loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais configuration service'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_msg loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais message service B.01.01'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_lck loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais distributed locking service B.01.01'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_evt loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais event service B.01.01'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_ckpt loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais checkpoint service B.01.01'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_amf loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais availability management framework B.01.01'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_clm loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais cluster membership service B.01.01'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_evs loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais extended virtual synchrony service'
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] openais component
openais_cman loaded.
Feb 12 14:36:58 yildiz openais[2927]: [MAIN ] Registering service
handler 'openais CMAN membership service 2.01'
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] Token Timeout (10000 ms)
retransmit timeout (495 ms)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] token hold (386 ms)
retransmits before loss (20 retrans)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] join (60 ms) send_join
(0 ms) consensus (4800 ms) merge (200 ms)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] downcheck (1000 ms) fail
to recv const (50 msgs)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] seqno unchanged const
(30 rotations) Maximum network MTU 1500
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] window size per rotation
(50 messages) maximum messages per rotation (17 messages)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] send threads (0 threads)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] RRP token expired timeout (495 ms)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] RRP token problem
counter (2000 ms)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] RRP threshold (10 problem count)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] RRP mode set to none.
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] heartbeat_failures_allowed (0)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] max_network_delay (50 ms)
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] HeartBeat is Disabled.
To enable set heartbeat_failures_allowed > 0
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] Receive multicast socket
recv buffer size (219136 bytes).
Feb 12 14:36:58 yildiz openais[2927]: [TOTEM] Transmit multicast
socket send buffer size (219136 bytes).
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] The network interface
[172.16.40.11] is now up.
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] Created or loaded
sequence id 0.172.16.40.11 for this ring.
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] entering GATHER state from 15.
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais extended virtual synchrony service'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais cluster membership service B.01.01'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais availability management framework B.01.01'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais checkpoint service B.01.01'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais event service B.01.01'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais distributed locking service B.01.01'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais message service B.01.01'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais configuration service'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais cluster closed process group service v1.01'
Feb 12 14:36:59 yildiz openais[2927]: [SERV ] Initialising service
handler 'openais CMAN membership service 2.01'
Feb 12 14:36:59 yildiz openais[2927]: [CMAN ] CMAN 2.0.60 (built Jan
23 2007 12:42:29) started
Feb 12 14:36:59 yildiz openais[2927]: [SYNC ] Not using a virtual
synchrony filter.
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] Creating commit token
because I am the rep.
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] Saving state aru 0 high
seq received 0
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] entering COMMIT state.
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] entering RECOVERY state.
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] position [0] member 172.16.40.11:
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] previous ring seq 0 rep
172.16.40.11
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] aru 0 high delivered 0
received flag 0
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] Did not need to
originate any messages in recovery.
Feb 12 14:36:59 yildiz openais[2927]: [TOTEM] Couldn't store new ring
id 4 to stable storage (Permission denied)
Feb 12 14:37:00 yildiz ccsd[2921]: Initial status:: Quorate
Feb 12 14:37:01 yildiz setroubleshoot:      SELinux is preventing the
/usr/sbin/aisexec from using potentially mislabeled files (tmp).
For complete SELinux messages. run sealert -l
a83caf42-8a8c-49d5-afec-81b67ee2aa68

# cat /etc/cluster/cluster.conf
<?xml version="1.0"?>
<cluster alias="RHEL5_CS" config_version="1" name="RHEL5_CS">
  <fence_daemon post_fail_delay="0" post_join_delay="3"/>
  <clusternodes>
    <clusternode name="node1.localdomain" votes="1" nodeid="1">
      <com_info>
        <syslog name="node1.localdomain"/>
          <sharedd name="/dev/VG_SHARE/LV_SHARE"/>
      </com_info>
      <fence>
        <method name="1">
          <device name="ManualFence" nodename="node1.localdomain"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="node2.localdomain" votes="1" nodeid="2">
      <com_info>
        <syslog name="node2.localdomain"/>
          <sharedd name="/dev/VG_SHARE/LV_SHARE"/>
      </com_info>
      <fence>
        <method name="1">
          <device name="ManualFence" nodename="node2.localdomain"/>
        </method>
      </fence>
    </clusternode>
  </clusternodes>
  <cman expected_votes="1" two_node="1"/>
  <fencedevices>
    <fencedevice agent="fence_manual" name="ManualFence"/>
  </fencedevices>
  <rm>
    <failoverdomains/>
    <resources/>
  </rm>
</cluster>


If i disable SElinux working. But...




More information about the Linux-cluster mailing list