[openib-general] Okay, stack is up, but what about minism and VAPI libs?

Sun Apr 4 00:58:36 PST 2004

> I'm used to the Mellanox stack world where we have minism.  The 
> tools on the openib site don't seem to supply minism or OpenSM.

minism operates on top of a mellanox's module called ib_mgt which is
replaced
by the ib_mad module at open-ib stack (ib_mad handles both QP0 and QP1).

So, as far as i understand, you can not compile/run minism with the open-ib
drop, since 
both the ib_mgt module and the interface to user-space layers above it are
not present.

It is possible to port minism over the ib_mad api, but even after doing so,
as minism does
not support ib-multicast-join which is needed by IPoIB, you will be able
only to get IB link,
which is probably enough for running MPI coded on top of VAPI directly.

>What about getting the vapi/evapi/mpga/mtl_common/mosal libraries so 
>that we can actually run and build things like MPI and other custom VAPI
based apps.

Here goes,

You will need to build the user level support and install the libraries,
some scripts
and some programs (vstat etc). For this you need to download the user space
package
(https://openib.org/downloads/infiniband-support-2004-02-26.tar.bz2) and
compile it  (at least 
i had after building the supplied src rpm has failed on my system, also with
the new spec file). 

Make-ing with the command below, should work for both 2.4 and 2.6 systems
(*)
        $ make TS_TARGET_SYSTEMS=host_native_2_6
If make fails, try doing
        $ ln -s /usr/src/linux third_party/linux_host_native_2_6
and then the make command

This also installs everything...

If you are running a 2.6 system, you better patch your /etc/modprobe.conf
file 
        $ cat
infiniband-support-2.0/build/exe/scripts/modprobe.conf.infiniband >>
/etc/modprobe.conf

When this is done, the following should enable user apps to work:
        $ modprobe ib_tavor
        $ modprobe ib_ipoib
            $ ifconfig ib0  netmask  

I am attacing few files:
 - list of what is actually installed (grabbed from the spec file)
 - start/stop scripts for 2.4 based system (the start file is a replacement
for the patch to /etc/modprobe.conf 
   that on 2.6 based systems).

Or

(*) for me it worked for the following systems:
  - RH9 / 2.6.3          / x86
  - EL3 / 2.4.21-4.EL / x86

(**) If your app uses the IB stack (i.e not purely VAPI based), you might
also need to modprobe
      ib_useraccess and/or ib_useraccess_cm and/or ib_udapl

-----Original Message-----
From: Mike Houston [mailto:mhouston at graphics.stanford.edu]
Sent: Friday, April 02, 2004 4:56 AM
To: openib-general at openib.org
Subject: [openib-general] Okay, stack is up, but what about minism and VAPI
libs?

This is probably a really stupid question, but I have the stack up, what 
next?  I'm used to the Mellanox stack world where we have minism.  The 
tools on the openib site don't seem to supply minism or OpenSM.

What about getting the vapi/evapi/mpga/mtl_common/mosal libraries so 
that we can actually run and build things like MPI and other custom VAPI 
based apps.

I want to test the vapi/HCA driver in this stack for stability before I 
give IPOIB and SDP a go.  At the moment, the mosal code looks a little 
old and probably has some old bugs addressed in the newer Mellanox 
code.  I haven't dug through the vapi source yet to see what, if 
anything, is different from the Mellanox stack.

-Mike

-- 
To unsubscribe send an email with subject unsubscribe to
openib-general at openib.org.
Please contact moderator at openib.org for questions.

-------------- next part --------------

%config(noreplace) %{_sysconfdir}/dat.conf
%config(noreplace) %{_sysconfdir}/libsdp.conf

/%{_lib}/libsdp.so
%{_libdir}/mpi
%{_libdir}/libdapl.so
%{_libdir}/libdat.so
%{_libdir}/libts_ib_cm_user.so
%{_libdir}/libts_ib_cm_user.a
%{_libdir}/libvapi.so
%{_libdir}/libmtl_common.so
%{_libdir}/libmtgetopt.so
%{_libdir}/libmosal.so
%{_libdir}/libmpga.so
%{_libdir}/libvapi.a
%{_libdir}/libmtl_common.a
%{_libdir}/libmtgetopt.a
%{_libdir}/libmosal.a
%{_libdir}/libmpga.a

%{_includedir}/vapi
%{_includedir}/infiniband
%{_includedir}/dat
%{_includedir}/mpi

%{_datadir}/infiniband

%{_bindir}/mpi
%{_bindir}/vping
%{_bindir}/vstat
%{_bindir}/ttcp.sdp
%{_bindir}/dapltest.x
%{_bindir}/lat_client.x
%{_bindir}/lat_server.x
%{_bindir}/thru_client.x
%{_bindir}/thru_server.x

/usr/src/mpi
/sbin/ipoib_arp
-------------- next part --------------
A non-text attachment was scrubbed...
Name: open-ib-start.sh
Type: application/octet-stream
Size: 322 bytes
Desc: not available
Url : https://openib.org/pipermail/openib-general/attachments/20040404/9c5b9979/open-ib-start.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: open-ib-stop.sh
Type: application/octet-stream
Size: 358 bytes
Desc: not available
Url : https://openib.org/pipermail/openib-general/attachments/20040404/9c5b9979/open-ib-stop.obj