Hi
We are facing a strange problem from past few days. Below are the logs
attached for ref.
We are using nic bonding to our dell server. It has centos 5.4
installed with 4 nic cards. This machine was working good from past
few months. But from previous 2-3 days it went out of network by
itself.
Any pointer or help would be much appreciated.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
cat /proc/cpuinfo
processor    : 15
vendor_id    : GenuineIntel
cpu family    : 6
model      : 26
model name    : Intel(R) Xeon(R) CPU      E5530  @ 2.40GHz
stepping     : 5
==============================================================================================
[root@S log]# uname -a
Linux ABC.NETXXXXXX Â 2.6.18-164.6.1.el5 #1 SMP Tue Nov 3 16:12:36 EST
2009 x86_64 x86_64 x86_64 GNU/Linux
============================================================================================
[root@S log]# cat /etc/redhat-release
CentOS release 5.4 (Final)
[root@SJC-SRCH-03-R ~]# dmesg |grep eth | more
eth0: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found
at mem d6000000, IRQ 90, node addr 00219b8fd3bc
eth1: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found
at mem d8000000, IRQ 98, node addr 00219b8fd3be
eth2: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found
at mem da000000, IRQ 106, node addr 00219b8fd3c0
eth3: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found
at mem dc000000, IRQ 114, node addr 00219b8fd3c2
cnic: Added CNIC device: eth0
cnic: Added CNIC device: eth1
cnic: Added CNIC device: eth2
cnic: Added CNIC device: eth3
bonding: bond0: Adding slave eth0.
bnx2: eth0: using MSIX
bnx2i: iSCSI not supported, dev=eth0
bonding: bond0: enslaving eth0 as a backup interface with a down link.
bnx2i: iSCSI not supported, dev=eth0
bonding: bond0: Adding slave eth1.
bnx2: eth1: using MSIX
bnx2i: iSCSI not supported, dev=eth1
bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex, receive &
transmit flow control ON
bonding: bond0: enslaving eth1 as a backup interface with a down link.
bnx2i: iSCSI not supported, dev=eth1
bonding: bond0: link status definitely up for interface eth0.
bonding: bond0: making interface eth0 the new active one.
bonding: bond0: link status definitely up for interface eth1.
bonding: bond0: link status definitely down for interface eth1, disabling it
bnx2: eth1 NIC Copper Link is Up, 1000 Mbps full duplex, receive &
transmit flow control ON
bonding: bond0: link status definitely up for interface eth1.
bonding: bond0: making interface eth1 the new active one.
bnx2: eth2: using MSIX
ADDRCONF(NETDEV_UP): eth2: link is not ready
bnx2i: iSCSI not supported, dev=eth2
bnx2i: iSCSI not supported, dev=eth2
bnx2: eth2: using MSIX
ADDRCONF(NETDEV_UP): eth2: link is not ready
bnx2i: iSCSI not supported, dev=eth2
bnx2i: iSCSI not supported, dev=eth2
bnx2: eth3: using MSIX
ADDRCONF(NETDEV_UP): eth3: link is not ready
bnx2i: iSCSI not supported, dev=eth3
bnx2i: iSCSI not supported, dev=eth3
bnx2: eth3: using MSIX
ADDRCONF(NETDEV_UP): eth3: link is not ready
bnx2i: iSCSI not supported, dev=eth3
bnx2i: iSCSI not supported, dev=eth3
bnx2: eth2: using MSIX
ADDRCONF(NETDEV_UP): eth2: link is not ready
bnx2i: iSCSI not supported, dev=eth2
bnx2: eth2: using MSIX
ADDRCONF(NETDEV_UP): eth2: link is not ready
bnx2i: iSCSI not supported, dev=eth2
bnx2i: iSCSI not supported, dev=eth2
bnx2: eth3: using MSIX
ADDRCONF(NETDEV_UP): eth3: link is not ready
bnx2i: iSCSI not supported, dev=eth3
bnx2: eth3: using MSIX
ADDRCONF(NETDEV_UP): eth3: link is not ready
bnx2i: iSCSI not supported, dev=eth3
bnx2i: iSCSI not supported, dev=eth3
bonding: bond0: Removing slave eth1
bonding: bond0: releasing active interface eth1
bonding: bond0: making interface eth0 the new active one.ease 5.4 (Final)
bonding: bond0: Removing slave eth0
bonding: bond0: releasing active interface eth0
bonding: unable to remove non-existent slave eth1 for bond bond0.
bonding: bond0: Adding slave eth0.
bnx2: eth0: using MSIX
bnx2i: iSCSI not supported, dev=eth0
bonding: bond0: enslaving eth0 as a backup interface with a down link.
bnx2i: iSCSI not supported, dev=eth0
bonding: bond0: Adding slave eth1.
bnx2: eth1: using MSIX
bnx2i: iSCSI not supported, dev=eth1
bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex, receive &
transmit flow control ON
bonding: bond0: enslaving eth1 as a backup interface with a down link.
bonding: bond0: link status definitely up for interface eth0.
bonding: bond0: making interface eth0 the new active one.
bonding: bond0: link status definitely up for interface eth1.
bnx2i: iSCSI not supported, dev=eth1
bonding: bond0: link status definitely down for interface eth1, disabling it
bnx2: eth1 NIC Copper Link is Up, 1000 Mbps full duplex, receive &
transmit flow control ON
bonding: bond0: link status definitely up for interface eth1.
bonding: bond0: making interface eth1 the new active one.
bonding: bond0: Removing slave eth0
bonding: bond0: Warning: the permanent HWaddr of eth0 -
00:21:9B:8F:D3:BC - is still in use by bond0. Set the HWaddr of eth0
to a different address to avoid
conflicts.
bonding: bond0: releasing backup interface eth0
bonding: bond0: Removing slave eth1
bonding: bond0: releasing active interface eth1
bonding: bond0: Adding slave eth0.
bnx2: eth0: using MSIX
bnx2i: iSCSI not supported, dev=eth0
bonding: bond0: enslaving eth0 as a backup interface with a down link.
bnx2i: iSCSI not supported, dev=eth0
bonding: bond0: Adding slave eth1.
bnx2: eth1: using MSIX
bnx2i: iSCSI not supported, dev=eth1
bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex, receive &
transmit flow control ON
bonding: bond0: enslaving eth1 as a backup interface with a down link.
bonding: bond0: link status definitely up for interface eth0.
bonding: bond0: making interface eth0 the new active one.
bonding: bond0: link status definitely up for interface eth1.
bnx2i: iSCSI not supported, dev=eth1
bonding: bond0: link status definitely down for interface eth1, disabling it
bnx2: eth1 NIC Copper Link is Up, 1000 Mbps full duplex, receive &
transmit flow control ON
bonding: bond0: link status definitely up for interface eth1.
bonding: bond0: making interface eth1 the new active one.
===========================================================================================================================================
============================================================================================
[root@S ~]# modinfo e1000 | more
filename:
/lib/modules/2.6.18-164.6.1.el5/kernel/drivers/net/e1000/e1000.ko
version: Â Â Â Â 7.3.20-k2-NAPI
license: Â Â Â Â GPL
description: Â Â Intel(R) PRO/1000 Network Driver
author: Â Â Â Â Intel Corporation, <linux.nics(a)intel.com>
srcversion: Â Â 26DD82C709EB760C93D4103
alias: Â Â Â Â Â pci:v00008086d00001000sv*sd*bc*sc*i*
depends:
vermagic: Â Â Â 2.6.18-164.6.1.el5 SMP mod_unload gcc-4.1
parm: Â Â Â Â Â TxDescriptors:Number of transmit descriptors (array of int)
parm: Â Â Â Â Â TxDescPower:Binary exponential size (2^X) of each
transmit descriptor (array of int)
parm: Â Â Â Â Â RxDescriptors:Number of receive descriptors (array of int)
parm: Â Â Â Â Â Speed:Speed setting (array of int)
parm: Â Â Â Â Â Duplex:Duplex setting (array of int)
parm: Â Â Â Â Â AutoNeg:Advertised auto-negotiation setting (array of int)
parm: Â Â Â Â Â FlowControl:Flow Control setting (array of int)
parm: Â Â Â Â Â XsumRX:Disable or enable Receive Checksum offload (array of int)
parm: Â Â Â Â Â TxIntDelay:Transmit Interrupt Delay (array of int)
parm: Â Â Â Â Â TxAbsIntDelay:Transmit Absolute Interrupt Delay (array of int)
parm: Â Â Â Â Â RxIntDelay:Receive Interrupt Delay (array of int)
parm: Â Â Â Â Â RxAbsIntDelay:Receive Absolute Interrupt Delay (array of int)
parm: Â Â Â Â Â InterruptThrottleRate:Interrupt Throttling Rate (array of int)
parm: Â Â Â Â Â SmartPowerDownEnable:Enable PHY smart power down (array of int)
parm: Â Â Â Â Â KumeranLockLoss:Enable Kumeran lock loss workaround
(array of int)
parm: Â Â Â Â Â copybreak:Maximum size of packet that is copied to a
new buffer on receive (uint)
parm: Â Â Â Â Â debug:Debug level (0=none,...,16=all) (int)
=================================================================================================
[root@ ~]# ethtool eth0
Settings for eth0:
    Supported ports: [ TP ]
    Supported link modes:  10baseT/Half 10baseT/Full
                100baseT/Half 100baseT/Full
                1000baseT/Full
    Supports auto-negotiation: Yes
    Advertised link modes:  10baseT/Half 10baseT/Full
                100baseT/Half 100baseT/Full
                1000baseT/Full
    Advertised auto-negotiation: Yes
    Speed: 1000Mb/s
    Duplex: Full
    Port: Twisted Pair
    PHYAD: 1
    Transceiver: internal
    Auto-negotiation: on
    Supports Wake-on: g
    Wake-on: d
=============================================
root@S ~]# ethtool -i eth0
driver: bnx2
version: 1.9.3
firmware-version: 4.6.4 NCSI 1.0.6
bus-info: 0000:01:00.0
[=========================
[root@ ~]# ethtool -i eth1
driver: bnx2
version: 1.9.3
firmware-version: 4.6.4 NCSI 1.0.6
bus-info: 0000:01:00.1
================================
[root@S ~]# ethtool -i bond0
driver: bonding
version: 3.4.0
firmware-version: 2
bus-info:
===================================