Hardware RAID - Check Status?

Kilo · #1 18th September 2006, 04:11 PM

Hi People,

I've got some Dell Poweredge 1850s with hardware RAID. They're running what I think is called RAID1 - basically the two physicals drives contain identical data and are shown to the OS as one logical volume.

Does a utility exist which allows me to check the condition of the data on the two discs? I've had one physical volume fail recently, and it's been hot-swapped but I can't check that it has been successfully rebuilt without rebooting and inspecting in the RAID utility. It'd be really nice to be able to do so from the console.

I'm not even sure how to find out what the name of the RAID controller is. I do know the following though:

Code:

 pvscan                                                                                      ~
  PV /dev/sda2   VG VolGroup00   lvm2 [68.12 GB / 32.00 MB free]
  Total: 1 [68.12 GB] / in use: 1 [68.12 GB] / in no VG: 0 [0   ]

Code:

df                                                                                          ~
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
                       66G   31G   32G  49% /
/dev/sda1              99M   16M   79M  17% /boot
/dev/shm              2.0G     0  2.0G   0% /dev/shm

Any assistance would be appreciated!

wdingus · #2 19th September 2006, 01:43 AM

Just about everything you'd ever want to know about Dell RAID and Linux:

http://linux.dell.com/storage.shtml

And "lspci" can be handy in seeing what hardware you have installed.

# lspci
00:00.0 Host bridge: Intel Corp.: Unknown device 2550 (rev 03)
00:00.1 Class ff00: Intel Corp.: Unknown device 2551 (rev 03)
00:01.0 PCI bridge: Intel Corp.: Unknown device 2552 (rev 03)
00:02.0 PCI bridge: Intel Corp.: Unknown device 2553 (rev 03)
00:1d.0 USB Controller: Intel Corp. 82801DB USB (Hub #1) (rev 02)
00:1d.1 USB Controller: Intel Corp. 82801DB USB (Hub #2) (rev 02)
00:1d.2 USB Controller: Intel Corp. 82801DB USB (Hub #3) (rev 02)
00:1d.7 USB Controller: Intel Corp. 82801DB USB EHCI Controller (rev 02)
00:1e.0 PCI bridge: Intel Corp. 82801BA/CA/DB PCI Bridge (rev 82)
00:1f.0 ISA bridge: Intel Corp. 82801DB ISA Bridge (LPC) (rev 02)
00:1f.1 IDE interface: Intel Corp. 82801DB ICH4 IDE (rev 02)
00:1f.3 SMBus: Intel Corp. 82801DB SMBus (rev 02)
02:1c.0 PIC: Intel Corp. 82870P2 P64H2 I/OxAPIC (rev 04)
02:1d.0 PCI bridge: Intel Corp. 82870P2 P64H2 Hub PCI Bridge (rev 04)
02:1e.0 PIC: Intel Corp. 82870P2 P64H2 I/OxAPIC (rev 04)
02:1f.0 PCI bridge: Intel Corp. 82870P2 P64H2 Hub PCI Bridge (rev 04)
03:03.0 Ethernet controller: Intel Corp. 82546EB Gigabit Ethernet Controller (Copper) (rev 01)
03:03.1 Ethernet controller: Intel Corp. 82546EB Gigabit Ethernet Controller (Copper) (rev 01)
04:01.0 RAID bus controller: Intel Corp. RAID Controller
05:01.0 Serial controller: Equinox Systems, Inc. SST-64P Adapter (rev 05)
05:02.0 VGA compatible controller: nVidia Corporation NV11 [GeForce2 MX/MX 400] (rev b2)

This is a Dell with an Intel hardware RAID card so looking closer at that particular card:

[root@monroe root]# lspci -vv -s 04:01.0
04:01.0 RAID bus controller: Intel Corp. RAID Controller
Subsystem: Intel Corp.: Unknown device 01af
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr+ Stepping- SERR+ FastB2B+
Status: Cap+ 66Mhz+ UDF- FastB2B+ ParErr- DEVSEL=slow >TAbort- <TAbort- <MAbort- >SERR- <PERR-
Latency: 64, cache line size 08
Interrupt: pin A routed to IRQ 24
Region 0: Memory at ec000000 (32-bit, prefetchable) [size=32M]
Expansion ROM at <unassigned> [disabled] [size=32K]
Capabilities: [80] Power Management version 2
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-

I have "storcon" and "srcd" both installed. Using "storcon" while booted in Linux gives an identical interface to going into the cards BIOS without the OS loaded. The "srcd" package can monitor the card and email you or run arbitrary commands upon an *event* with the card.

Unfortunately storcon appears to 100% require human interaction. I'd have rather had a simple command-line utility to retreive stats from the card and dump them stdout as I've done with numerous other types of cards. These at least don't appear to support that.

Anyway, whatever card you have that was supplied by Dell, they'll likely cover on that page.

Kilo · #3 19th September 2006, 02:58 PM

Hi Wdingus,

Thanks very much for your reply - it's appreciated. I'll start by showing you the outputs I get to the commands you've shown me:

Code:

root@h100398[2] lspci                                                                                                                               ~
00:00.0 Host bridge: Intel Corporation E7520 Memory Controller Hub (rev 09)
00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A (rev 09)
00:04.0 PCI bridge: Intel Corporation E7525/E7520 PCI Express Port B (rev 09)
00:05.0 PCI bridge: Intel Corporation E7520 PCI Express Port B1 (rev 09)
00:06.0 PCI bridge: Intel Corporation E7520 PCI Express Port C (rev 09)
00:1d.0 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #1 (rev 02)
00:1d.1 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #2 (rev 02)
00:1d.2 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI #3 (rev 02)
00:1d.7 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB2 EHCI Controller (rev 02)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev c2)
00:1f.0 ISA bridge: Intel Corporation 82801EB/ER (ICH5/ICH5R) LPC Interface Bridge (rev 02)
00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE Controller (rev 02)
01:00.0 PCI bridge: Intel Corporation 80332 [Dobson] I/O processor (rev 06)
01:00.2 PCI bridge: Intel Corporation 80332 [Dobson] I/O processor (rev 06)
02:05.0 SCSI storage controller: LSI Logic / Symbios Logic 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI (rev 08)
03:0b.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID (rev 01)
05:00.0 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI Bridge A (rev 09)
05:00.2 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI Bridge B (rev 09)
06:07.0 Ethernet controller: Intel Corporation 82541GI/PI Gigabit Ethernet Controller (rev 05)
07:08.0 Ethernet controller: Intel Corporation 82541GI/PI Gigabit Ethernet Controller (rev 05)
09:0d.0 VGA compatible controller: ATI Technologies Inc Radeon RV100 QY [Radeon 7000/VE]
root@h100398[3] lspci -vv -s 03:0b.0                                                                                                                ~
03:0b.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID (rev 01)
        Subsystem: Dell MegaRAID 520 DELL PERC 4/SC RAID Controller
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B-
        Status: Cap+ 66Mhz+ UDF- FastB2B+ ParErr- DEVSEL=slow >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 32, Cache Line Size 10
        Interrupt: pin A routed to IRQ 185
        Region 0: Memory at f8ff0000 (32-bit, prefetchable) [size=64K]
        Expansion ROM at fe800000 [disabled] [size=64K]
        Capabilities: [80] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-

I've downloaded and installed storcon, but maybe I've not done something quite right. When I run it (from a remote console - the machine is in a data center), it says 'No controller found'. Do I need to point it at the controller in a configuration file or similar?

wdingus · #4 20th September 2006, 01:04 AM

Well in my case the example was an intel ZCR card and it uses "storcon", an *Intel* product. You appear to have a megaraid card so whatever management tools you'd need would be different than what I did. Looks like Dell OEMs various Smybios Logic (AMI) MegaRaid cards as Perc XYZ models.

http://linux.dell.com/storage.shtml#megaraid

Management Utility
* perc-cerc-apps-6.03-A06.tar.gz includes Dellmgr-5.31, linflash-3.01, Megamon-4.0-0a, percsnmp-4.09-1 (Search support.dell.com for R71524).

Moonpup: We're talking about *hardware* RAID where the card sees the multiple drives and only presents a single drive to the OS. In Kilo's case /dev/sda. So there won't be anything in mdstat because no "md" devices were made. Linux doesn't specifically know about the individual disks, it only sees the one disk as presented to it by the RAID card. Checking the md* devices would be appropriate for software RAID however.

moonpup · #5 19th September 2006, 09:30 PM

You could also do the following...

1) cat /proc/mdstat "this will verify the array was built"

2) mdadm --detail /dev/md0 "change md0 to what ever your device is"

post back your output

moonpup · #6 20th September 2006, 01:47 AM

wdingus,

you are correct and since i read the post quickly i missed the "hardware" raid piece