...
"Small" buffers are 4K bytes, "large" are 1M and "smalltiny" are a only a few bytes. The lnet module parameters which can be used to set these are:
- large_router_buffers
- small_router_buffers
- tiny_router_buffers
It is also possible to adjust the buffer numbers dynamically via lnetctl: "lnetctl set <tiny_buffers|small_buffers|large_buffers>"
Basic Connectivity Verification
...
Default tunings for OPA can be found in /etc/modprobe.d/ko2iblnd.conf and are as follows:
options ko2iblnd-opa peer_credits=128 peer_credits_hiw=64 credits=1024 concurrent_sends=256 ntx=2048 map_on_demand=32 fmr_pool_size=2048 fmr_flush_trigger=512 fmr_cache=1 conns_per_peer=4
...