How to setup InfiniBand network ?

1) InfiniBand Switch

1 x Mellanox InfiniScale IV IS5022 8 ports QDR

• InfiniBand Short depth Switch
• MIS5022Q-1BFR
• 8-Port QSFP 40 Gb/s
• Hardware revision: A6

2) InfiniBand Cards

2 x Mellanox Connect-IB FDR InfiniBand Card

• MCB193A-FCAT
• Single QSFP+ Port 56 Gb/s
• PCI 3.0 x16
• Hardware revision: A4

3) OS Linux

2 x Red Hat Enterprise Linux 6.5

4) Setup InfiniBand network

# chkconfig opensmd on

# service opensmd start

5) Check InfiniBand card

# ibstatus

6) Check InfiniBand network

# ibnetdiscover

7) Ping InfiniBand address (lid or guid)

# ibping -S

# ibping 2

%%