peer_credits=128 - the number of concurrent sends to a single peer
peer_credits_hiw=64 - Hold in Wait – when to eagerly return credits
credits=1024 - the number of concurrent sends (to all peers)
concurrent_sends=256 - send work-queue sizing
ntx=2048 - the number of message descriptors that are pre-allocated when the ko2iblnd module is loaded in the kernel
map_on_demand=32 - the number of noncontiguous memory regions that will be mapped into a virtual contiguous region
fmr_pool_size=2048 - the size of the Fast Memory registration (FMR) pool (must be >= ntx/4)
fmr_flush_trigger=512 - the dirty FMR pool flush trigger
fmr_cache=1 - enable FMR caching
conns_per_peer=4 - create multiple queue pairs per peer to allow higher throughput from a single client. This is of most benefit to OPA interfaces, when coupled with the krcvqs parameter of the OPA hfi1 kernel driver. The hfi1 driver option krcvqs must also be set. It is recommended to set krcvqs=4. In some cases, setting krcvqs=8 will yield improved IO performance, but this can impact other workloads, especially on clients. If queue-pair memory usage becomes excessive, reduce the ko2iblnd conns_per_peer value to 2 and krcvqs=2.
The default values used by Lustre if no parameters are given is:
