Discover V7000 on Redhat

水深无声 2023-10-08 09:36 36阅读 0赞

## Discover V7000 on Redhat ##

### Steps to configure the Linux Host ###

Follow these steps to configure the Linux host:

*  Use the latest firmware levels on your host system.
 *  Install the HBA or HBAs on the Linux server.
 *  Install the supported HBA driver/firmware and upgrade the kernel, if required.
 *  Connect the Linux server FC host adapters to the switches.
 *  Configure the switches (zoning) if needed.
 *  Install SDD for Linux.
 *  Configure the host, volumes, and host mapping in the IBM Flex System V7000 Storage Node.
 *  Rescan for LUNs on the Linux server to discover the volumes that were created on the IBM Flex System V7000 Storage Node.

#### os kernel ####

[root@dev1 ~]# uname -a
    Linux dev1.egolife.com 2.6.39-400.17.1.el6uek.x86_64 #1 SMP Fri Feb 22 18:16:18 PST 2013 x86_64 x86_64 x86_64 GNU/Linux

#### hba details ####

fc device

[root@dev1 ~]# lspci  | grep Fibre
    8b:00.0 Fibre Channel: Emulex Corporation Saturn-X: LightPulse Fibre Channel Host Adapter (rev 03)
    8b:00.1 Fibre Channel: Emulex Corporation Saturn-X: LightPulse Fibre Channel Host Adapter (rev 03)
    
    [root@dev1 ~]# grep Fibre /var/log/dmesg
    Emulex LightPulse Fibre Channel SCSI driver 8.3.5.86.2p
    scsi3 : Emulex LPe12000 PCIe Fibre Channel Adapter  on PCI bus 8b device 00 irq 48
    scsi4 : Emulex LPe12000 PCIe Fibre Channel Adapter  on PCI bus 8b device 01 irq 58

fc hosts

[root@dev1 ~]# ll /sys/class/fc_host/host*
    lrwxrwxrwx. 1 root root 0 Jun 18 10:42 /sys/class/fc_host/host3 -> ../../devices/pci0000:80/0000:80:03.0/0000:8b:00.0/host3/fc_host/host3
    lrwxrwxrwx. 1 root root 0 Jun 18 10:42 /sys/class/fc_host/host4 -> ../../devices/pci0000:80/0000:80:03.0/0000:8b:00.1/host4/fc_host/host4

fc\_host directory

[root@dev1 ~]# ll /sys/class/fc_host/host3/
    total 0
    -r--r--r--. 1 root root 4096 Jun 18 10:43 active_fc4s
    lrwxrwxrwx. 1 root root    0 Jun 18 10:43 device -> ../../../host3
    -rw-r--r--. 1 root root 4096 Jun 18 10:43 dev_loss_tmo
    -r--r--r--. 1 root root 4096 Jun 18 10:43 fabric_name
    --w-------. 1 root root 4096 Jun 18 10:43 issue_lip
    -r--r--r--. 1 root root 4096 Jun 18 10:43 maxframe_size
    -r--r--r--. 1 root root 4096 Jun 18 10:43 max_npiv_vports
    -r--r--r--. 1 root root 4096 Jun 18 10:43 node_name
    -r--r--r--. 1 root root 4096 Jun 18 10:43 npiv_vports_inuse
    -r--r--r--. 1 root root 4096 Jun 18 10:43 port_id
    -r--r--r--. 1 root root 4096 Jun 18 10:43 port_name
    -r--r--r--. 1 root root 4096 Jun 18 10:43 port_state
    -r--r--r--. 1 root root 4096 Jun 18 10:43 port_type
    drwxr-xr-x. 2 root root    0 Jun 18 10:43 power
    -r--r--r--. 1 root root 4096 Jun 18 10:43 speed
    drwxr-xr-x. 2 root root    0 Jun 18 10:43 statistics
    lrwxrwxrwx. 1 root root    0 Jun 18 10:43 subsystem -> ../../../../../../../class/fc_host
    -r--r--r--. 1 root root 4096 Jun 18 10:43 supported_classes
    -r--r--r--. 1 root root 4096 Jun 18 10:43 supported_fc4s
    -r--r--r--. 1 root root 4096 Jun 18 10:43 supported_speeds
    -r--r--r--. 1 root root 4096 Jun 18 10:43 symbolic_name
    -rw-r--r--. 1 root root 4096 Jun 18 10:43 tgtid_bind_type
    -rw-r--r--. 1 root root 4096 Jun 18 10:43 uevent
    --w-------. 1 root root 4096 Jun 18 10:43 vport_create
    --w-------. 1 root root 4096 Jun 18 10:43 vport_delete

hba wwn

[root@dev1 ~]# cat /sys/class/fc_host/host*/node_name 
    0x20000090fa3436de
    0x20000090fa3436df

hba hosts in v7000

operation:V7000 -> Cluster -> Hosts -> Ports by Host -> Host Details:APP01

hba name: 10000090FA3436DE 10000090FA3436DF

![APP01 hba details][]

#### rpms ####

install multipath packages

[root@dev1 ~]# yum install -y device-mapper-multipath
    
    [root@dev1 ~]# rpm -qa | grep device-mapper
    device-mapper-persistent-data-0.1.4-1.el6.x86_64
    device-mapper-event-1.02.77-9.el6.x86_64
    device-mapper-1.02.77-9.el6.x86_64
    device-mapper-multipath-0.4.9-64.0.1.el6.x86_64
    device-mapper-event-libs-1.02.77-9.el6.x86_64
    device-mapper-multipath-libs-0.4.9-64.0.1.el6.x86_64
    device-mapper-libs-1.02.77-9.el6.x86_64

#### multipath configure ####

DM\_Multipath

Device mapper multipathing (DM-Multipath) allows you to configure multiple I/O paths between server nodes and storage arrays into a single device. These I/O paths are physical SAN connections that can include separate cables, switches, and controllers. Multipathing aggregates the I/O paths, creating a new device that consists of the aggregated paths

enable multipath

[root@dev1 ~]# mpathconf --enable --with_multipathd y

scan disks

[root@dev1 ~]# fdisk -l
    
    WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.
    
    
    Disk /dev/sda: 299.0 GB, 298999349248 bytes
    255 heads, 63 sectors/track, 36351 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Sector size (logical/physical): 512 bytes / 4096 bytes
    I/O size (minimum/optimal): 4096 bytes / 4096 bytes
    Disk identifier: 0x00000000
    
       Device Boot      Start         End      Blocks   Id  System
    /dev/sda1               1       36352   291991551+  ee  GPT
    Partition 1 does not start on physical sector boundary.
    
    Disk /dev/sdb: 107.4 GB, 107374182400 bytes
    255 heads, 63 sectors/track, 13054 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk identifier: 0x00000000
    
    
    Disk /dev/sdc: 107.4 GB, 107374182400 bytes
    255 heads, 63 sectors/track, 13054 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk identifier: 0x00000000
    
    
    Disk /dev/mapper/mpathc: 107.4 GB, 107374182400 bytes
    255 heads, 63 sectors/track, 13054 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk identifier: 0x00000000

note:sdb,sdc and /dev/mapper/mpathc are new devices added.

show multipath topology

[root@dev1 ~]# multipath -l
    mpathc (36005076802810b121800000000000002) dm-0 IBM,2145
    size=100G features='1 queue_if_no_path' hwhandler='0' wp=rw
    |-+- policy='round-robin 0' prio=0 status=active
    | `- 4:0:0:0 sdc 8:32 active undef running
    `-+- policy='round-robin 0' prio=0 status=enabled
      `- 3:0:0:0 sdb 8:16 active undef running

note:multipathing aggregates the sdb,sdc, and creates a new device mpathc that consists of the aggregated paths.

v7000 volumes detail operation: V7000 -> Cluster -> Volumes -> Volumes –> Volume Details:volume01

!![volume01 details][]

chkconfig

[root@dev1 ~]# chkconfig multipathd on

#### fdisk and makefs ####

fdisk

[root@dev1 ~]# fdisk /dev/mapper/mpathc

makefs

[root@dev1 ~]# mkfs.ext4 /dev/mapper/mpathc

mount

[root@dev1 ~]# mkdir /v7000 
    [root@dev1 ~]# mount /dev/mapper/mpathc /v7000/
    
    [root@dev1 ~]# df -h
    Filesystem            Size  Used Avail Use% Mounted on
    /dev/sda4             179G  3.0G  167G   2% /
    tmpfs                  32G   88K   32G   1% /dev/shm
    /dev/sda2             485M   55M  405M  12% /boot
    /dev/sda1             200M  260K  200M   1% /boot/efi
    /dev/mapper/mpathc     99G  188M   94G   1% /v7000

dd test

[root@dev1 v7000]# time dd if=/dev/mapper/mpathc of=/dev/null bs=8k
    13107200+0 records in
    13107200+0 records out
    107374182400 bytes (107 GB) copied, 270.831 s, 396 MB/s
    
    real	4m30.834s
    user	0m2.224s
    sys	2m43.163s

### Reference ###

*  [IBM V7000 Introduction and Implementation Guide][]
 *  [DM Multipath on Redhat][]

[APP01 hba details]: https://imgconvert.csdnimg.cn/aHR0cDovL2R5bGFubmluaW4uY29tL2Fzc2V0cy9pbWFnZXMvMjAxMy9hcHAwMV9wb3J0cy5wbmc?x-oss-process=image/format,png
[volume01 details]: https://imgconvert.csdnimg.cn/aHR0cDovL2R5bGFubmluaW4uY29tL2Fzc2V0cy9pbWFnZXMvMjAxMy92b2x1bWUwMV9kZXRhaWxzLnBuZw?x-oss-process=image/format,png
[IBM V7000 Introduction and Implementation Guide]: https://www.redbooks.ibm.com/redpieces/abstracts/sg248068.html?Open&pdfbookmark
[DM Multipath on Redhat]: https://access.redhat.com/site/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/DM_Multipath/MPIO_Overview.html