OPENIB.ORG INFINIBAND SUPPORT (2004-03-17 drop)
---------- ---------- -------

This file gives a basic outline of installing and using the kernel
components of the OpenIB.org InfiniBand stack. More information,
userspace tools, and the latest kernel drivers are available from
<http://openib.org/>

INSTALLATION
------------

Copy the infiniband/ directory to the drivers/ directory in a 2.4
kernel source tree. Apply the kernel-24.diff patch to the kernel so
that InfiniBand support is enabled in the kernel configuration.
Reconfigure the kernel with all CONFIG_INFINIBAND_XXX options set to
'm' and rebuild the kernel.

If you wish to build SDP support, you will have to obtain the
infiniband-kernel-sdp package and copy those sources into
drivers/infiniband/ulp/sdp before building.

The patch and driver package were developed against the Red Hat EL 3.0
2.4.21-EL.4 kernel. Some tweaking of the patch and/or driver source
may be required to use other kernels; in particular, you will probably
have to comment our the line

EXTRA_CFLAGS += -D_TS_SDP_AIO_SUPPORT

in drivers/infiniband/ulp/sdp/Makefile to build SDP, since mainline
2.4 kernels do not support asynchronous IO (AIO). You may also have
to remove the definitions of -DRHEL_ROUTE_FLOW_API from EXTRA_CFLAGS in
drivers/infiniband/ulp/ipoib/Makefile and -DRHEL_SCSI_API in
drivers/infiniband/ulp/srp/Makefile.

By adding

alias infiniband_hca ib_tavor

alias ib0 ib_ipoib
alias ib1 ib_ipoib

alias net-pf-26 ib_sdp

to /etc/modules.conf, IP-over-InfiniBand (IPoIB) can be enabled
simply by running

ifconfig ib0 <netaddress> # HCA port 1
ifconfig ib1 <netaddress> # HCA port 1

Once IPoIB is configured and running, Sockets Direct Protocol (SDP)
can be used by creating a SOCK_STREAM socket with protocol family 26
(AF_INET_SDP).

SCSI RDMA Protocol (SRP) is used by running

modprobe ib_srp

InfiniBand attached storage will appear as normal SCSI devices.


Some debugging information is available in the files in the
/proc/infiniband directory. Of particular interest are the
/proc/infiniband/ca1/port1/info and /proc/infiniband/ca1/port2/info
files, which among other things show the state of the HCA's ports.

NOTES
-----

2004-03-17 -- Initial drop for kernel 2.4

* Developed using Red Hat EL 3.0 2.4.21-4.EL kernel.
* This drop has only been tested on i386.
* InfiniBand support will not work if compiled staticly into the
kernel due to link order issues. Set all CONFIG_INFINIBAND
options to 'm'.