Qlogic Fast Fabric User Manual

Contents

Qlogic Fast Fabric User Manual Manual pdf 32 page image

3 – Getting StartedComplete Installation of additional IB Management Nodes3-18 D000006-000 Rev AQ7. (Host) "Verify Hosts see each other" will verify that each host can see all theothers via queries to the Subnet Administrator and the SA replica on each hosthas been fully populated.8. (Host) "Verify Hosts ping via IPoIB" will verify that IPoIB is properly configuredand running on all the hosts. This is accomplished via the IB managementnode pinging each host via IPoIB.9. (Linux) "Refresh ssh Known Hosts" will refesh the ssh knowhosts file on theIB management node to include the IPoIB hostnames of all the hosts10. (Host) "Check MPI Performance" will do a quick check of PCI and MPIperformance.This displays the MPI latency and bandwidth between pairs of hosts (1-2, 3-4,5-6, etc). The results are also written to the test.res file which may be viewedvia the "View ibtest result files". Refer to the section “Interpreting the ibtest logfiles” on page 5-68 for more details.The numbers reported should be checked against the practical PCI speeds inthe Performance Impact table below. If any pairs are not in the expectedperformance range, carefully examine the two hosts involved to verify that thePCI slot used, BIOS settings and any motherboard jumpers related to deviceson PCI buses or slot speeds. Also verify HCA and riser cards are properly seated.Table 3-1. Performance Impact3.9Complete Installation of additional IB Management NodesIf the fabric is to have more than one IB Management Node, the setup of theadditional management nodes may be completed now. The previous steps willhave performed basic software installation, setup and verification on those nodes.Now the management software itself must be installed and configured.NOTE: The steps below assume a symmetrical configuration where all IBmanagement nodes have the same connectivity and capabilities. Inassymetrical configurations where the IB management nodes are not allconnected to the same set of management networks and IB subnets, thefiles copied to each management node may need to be slightly different.For example configuration files for fabric_analysis may indicate differentport numbers, or host files used for FastFabric and MPI may need to listdifferent hosts. For multiple subnet configurations, refer to “Multi-SubnetFabrics” on page D-1.PCI Speed Theoretical Max Practical Bandwidth133 1024MB/sec 800-900 MB/sec100 770MB/sec 600-680 MB/sec66 512MB/sec 400-450 MB/sec