Configuration Tests

TestSteps
Configure route
  • Configure the gateway node with at least 4 interfaces
  • Configure 2 gateway interfaces on tcp and 2 interfaces on tcp2
  • Configure 2 peers. Peer A on tcp and Peer B on tcp2
  • Configure a route on Peer A using the primary NID of the gateway
  • Configure a route on Peer B using the primary NID on the gateway
  • Show peers on Peer A and B and make sure that all 4 gateway interfaces have been discovered
Verify Discovery interval
  • Configure as above
  • Monitor net stats "lnetctl net show"
  • Verify that route is discovered every approx 60 seconds by enable the net on debug and check log(look for TRACE)
  • Change the alive_router_check_interval to 30 seconds and verify router is discovered every 30 seconds
Verify route UP
  • Configure as above
  • lnetctl route show -v
  • Verify route is up on both Peer A and Peer B
Verify route DOWN with avoid_asym_router_failure = 0
  • Configure as above
  • "lnetctl route show -v" should show Up in stat
  • set avoid_asym_router_failure = 0 on Peer A and bring it down
  • Verify route stat shows Down after alive_router_check_interval on Peer B
Verify multiple router
  • Configure similar as above but add another router for a total of > 2 gateways
  • Ensure that all routers are discovered at regular intervals of alive_router_check_interval

Traffic Tests

TestSteps
1 Gateway test
  • Configure similar to above with 1 gateway
  • Run traffic using lnet_selftest
  • Verify traffic is distributed evenly across the gateway's interfaces
  • NOTE: only one route for the gateway
>=2 Gateway test
  • Configure multiple gateways between the peers
  • Run traffic using lnet_selftest
  • Verify traffic is distributed over the two gateways and their interfaces
Verify hop count
  • Configure multiple gateways between the peers
  • Set 1st gateway to have hops = 1
  • Set 2nd gateway to have hops = 2
  • Run traffic using lnet_selftest
  • Verify traffic is using 1st gateway. Traffic should be distributed among its interfaces
Verify priority
  • Configure multiple gateways between the peers
  • Set 1st gateway to have priority = 0
  • Set 2nd gateway to have priority = 10
  • Run traffic using lnet_selftest
  • Verify traffic is using 1s gateway. Traffic should be distributed among its interfaces

Traffic Failure

TestSteps
1 Gateway. Multiple interfaces. Interface failure
  • Configure similar to above with 1 gateway
  • Run traffic using lnet_selftest
  • Verify traffic is distributed among the gateway's interfaces
  • Unplug one of the gateway's interfaces
  • Verify traffic switches to using the other interface
>=2 Gateways. Gateway Failure
  • Configure similar to above with 2 or more gateways
  • Run traffic using lnet_selftest
  • Verify traffic is distributed among the gateways and their interfaces
  • shutdown one of the gateways
  • Verify that the other gateway will continue to be used

File System Test

Repeat the tests in the above 2 sections but instead of using lnet_selftest, bring up a file system and run IOR (or other) jobs. Verify no evictions occur during failure testing.