MDS

OSS 1

Client 1

Client 2

MGS

OSS2

This is a single fabric with a bottleneck.

Client1: 10.10.10.2@o2ib

Client2: 10.10.10.3@o2ib

MGS-1: 10.10.10.4@o2ib

MGS-2: 10.10.10.5@o2ib

MDS-1: 10.10.10.6@o2ib

MDS-2: 10.10.10.7@o2ib

OSS1-1: 10.10.10.8@o2ib

OSS1-2: 10.10.10.9@o2ib

OSS2-1: 10.10.10.10@o2ib

OSS2-2: 10.10.10.11@o2ib

This rule makes Client1 avoid the red path:

selection:
  - type: peer
    local: 10.10.10.2@o2ib
    remote: 10.10.10.[4-10/2]@o2ib
    priority: 0 # highest priority

Client1 will only use the red path if there is no other option.