[openib-general] tests and performance targets

Thu Apr 15 15:30:49 PDT 2004

When I post results I'll try to get all that info added.
Thanks for the list.
Later I'll start threads with 1. base information to accompany each results
report, 2. test list with public web locations, & 3. results tools and format.

At 2:18 PM -0400 4/15/04, Rimmer, Todd wrote:
>As we go about benchmarking and posting results, I recommend we include the necessary supporting information.
>
>All too often people quote unqualified numbers which cannot be used for accurate comparison.
>
>As a starting point the list could be:
>CPU type, model, speed
>/proc/cpuinfo, /proc/meminfo, /proc/pci, etc
>server model, motherboard model, front side bus speed, PCI slot speed, etc
>benchmark used, version, options for benchmark (message size, transfer model, etc), scripts to run benchmark,etc
>Host OS, kernel level, distribution, gcc version, glibc version, kernel patches, etc
>Host software stack used (version, vendor, any patches to make it run, build output showing compiler flags, etc),    module load options, stack parameters used, etc
>Fabric topology, switch models, silicon levels
>HCA board vendor, model, firmware clock, TPT, etc settings, firmware level
>
>Todd Rimmer
>
>-----Original Message-----
>From: Matt L. Leininger [mailto:mlleinin at hpcn.ca.sandia.gov]
>Sent: Wednesday, April 14, 2004 11:52 PM
>To: openib-general at openib.org
>Subject: RE: [openib-general] tests and performance targets
>
>
>We will set up an area on the web site for posting test results and
>benchmarks.
>
>A framework for automated regression testing of com, laten, allred,
>PMB-MPI1, other MPI tests, Lustre, PVFS, IB ULPs, IB access layer, SM,
>etc. would be very useful.  Along with needing an open source regression
>testing framework, does anyone have an open source testing suite for
>IBTA compliance (i.e. IBTA plugfest tests)?  The regression testing
>should include tests for performance, IB compliance, stability,
>portability, scaling, and manageability.
>
>     - Matt
>
>On Wed, 2004-04-14 at 15:32, Woodruff, Robert J wrote:
>> Also pointers to where people can download the benchmarks
>> might also be useful.
>>
>> -----Original Message-----
>> From: Fab Tillier [mailto:ftillier at infiniconsys.com]
>> Sent: Wednesday, April 14, 2004 3:18 PM
>> To: openib-general at openib.org
>> Subject: RE: [openib-general] tests and performance targets
>>
>>
>> Could the matrix of test results be posted to the OpenIB site?  It would
>> be useful in preventing duplication of efforts.
>>
>> - Fab
>>
>> > -----Original Message-----
>> > From: Jim Harm [mailto:jharm at llnl.gov]
>> > Sent: Wednesday, April 14, 2004 3:18 PM
>> > To: openib-general at openib.org
>> > Subject: [openib-general] tests and performance targets
>> >
>> > Here's a partial list of some initial tests we are interested in
>> > automating for evaluating improvements over versions and stacks.
>> >
>> > From the Presta1.2 suite:
>> > com        measuring throughput and (with options) cross-sectional
>> bandwidth
>> > laten      measuring latency
>> > allred     measuring a sequential latency across many nodes
>> > and from Pallas:
>> > PMB-MPI1   measuring lots of stuff with ping-pong, pong-pong, etc.
>> >
>> > We've seen about 820 MB per second with about 5.9 usec latency using
>> > the Voltaire stack on dual Opteron PCI-X nodes.
>> >
>> > I'd like to know if anyone can recommend some other public domain
>> > tests and see if anyone has a framework for automation or evaluation
>> > of the test results.
>> >
>> > Also, we'll be having to keep track of hardware, version of stack,
>> > version of test, version of compiler, other variables that can give us
>>
>> > important information while analyzing the results. If a framework has
>> > been used elsewhere that can be adapted to this application, it would
>> > save time.
> > > --
> > >
-- 
}}}===============>>  LLNL
James E. Harm (Jim); jharm at llnl.gov
System Administrator, ICCD Clusters
 Page: 

-- 
To unsubscribe send an email with subject unsubscribe to openib-general at openib.org.
Please contact moderator at openib.org for questions.