NAME
rxe - Software RDMA over Ethernet SYNOPSIS modprobe rdmarxe This is usually performed by a configuration utility (see rxecfg(8).) DESCRIPTION The rdmarxe kernel module provides a software implementation of the RoCEv2 protocol. The RoCEv2 protocol is an RDMA transport protocol that exists on top of UDP/IPv4 or UDP/IPv6. The InfiniBand (IB) Base Trans‐ port Header (BTH) is encapsulated in the UDP packet. Once a RXE instance has been created, communicating via RXE is the same as communicating via any OFED compatible Infiniband HCA, albeit in some cases with addressing implications. In particular, while the use of a GRH header is optional within IB sub‐ nets, it is mandatory with RoCE. Verbs applications written over IB verbs should work seamlessly, but they require provisioning of GRH information when creating address vectors. The library and driver are modified to provide for mapping from GID to MAC addresses required by the hardware. FILES /sys/class/infiniband/rxe[0,1,...] Directory that holds RDMA device information. The format is the same as other RDMA devices. /sys/module/rdmarxenet/parameters/add Write only file used by rxecfg(8) to add new RXE devices to existing Ethernet devices. /sys/module/rdmarxenet/parameters/remove Write only file used by rxecfg(8) to remove RXE devices. /sys/module/rdmarxenet/parameters/mtu Write only file used by rxecfg(8) to configure RoCE and Ether‐ net MTU values. /sys/module/rdmarxe/parameters/maxucontext Read/Write file that sets a limit on the number of UCs allowed per RXE device. /sys/module/rdmarxe/parameters/maxqp Read/Write file that sets a limit on the number of QPs allowed per RXE device. /sys/module/rdmarxe/parameters/maxqpwr Read/Write file that sets a limit on the number of WRs per QP allowed per RXE device. /sys/module/rdmarxe/parameters/maxmr Read/Write file that sets a limit on the number of MRs allowed per RXE device. /sys/module/rdmarxe/parameters/maxfmr Read/Write file that sets a limit on the number of FMRs allowed per RXE device. /sys/module/rdmarxe/parameters/maxcq Read/Write file that sets a limit on the number of CQs allowed per RXE device. /sys/module/rdmarxe/parameters/maxlogcqe Read/Write file that sets a limit on the log base 2 of the num‐ ber of CQEs per CQ allowed per RXE device. /sys/module/rdmarxe/parameters/maxinlinedata Read/Write file that sets a limit on the maximum amount of inline data per WR allowed per RXE device. The above configuration parameters only affect a new RXE instance when it is created not afterwards. /sys/module/rdmarxe/parameters/crcdisable Read/Write file that controls the disabling of ICRC computation. Set to a nonzero value for TRUE. Zero for FALSE. /sys/module/rdmarxe/parameters/fastcomp|req|resp|arb Read/Write file that enables calling kernel tasklets as subrou‐ tines to reduce latency. /sys/module/rdmarxe/parameters/nsecperpacket|kbyte Read/Write file that controls static rate pacing for output packets. If set to nonzero values the minimum delay to the next packet is set to nsecperkbyte * sizeof(current packet in KBytes) or nsecperpacket which ever is less. /sys/module/rdmarxe/parameters/maxpacketperack Read/Write file that controls the issuing of acks by the respon‐ der during a long message. If set additional acks will be gener‐ ated every maxpktperack packets. /sys/module/rdmarxe/parameters/maxskbperqp Read/Write file that controls the number of skbs (packets) that a requester can queue for sending internally. /sys/module/rdmarxe/parameters/maxreqcompgap Read/Write file that controls the maximum gap between the PSN of request packets send and ack packets received. /sys/module/rdmarxe/parameters/defaultmtu Read/Write file that controls the default mtu used for UD pack‐ ets. SEE ALSO rxecfg(8), verbs(7), AUTHORS Written by John Groves, Frank Zago and Bob Pearson at System Fabric Works.
1.0.0 2011-06-29 RXE(7)