[UCLA-LUG] Network and storage benchmarking

[Sizhao Yang]

I used netperf and iperf:

http://www.netperf.org/netperf/NetperfPage.html

i recommend bonnie++ as well

Zao


On 8/7/07, Chris Frost <chris at frostnet.net> wrote:
>
> There are tools (of at least research-quality) that try to find and
> characterize the slowest hop in a given path. Capest, SProbe, and MultiQ
> are three that come to mind.
>
>
> On Mon, Aug 06, 2007 at 10:41:11PM -0700, Jordan Mendler wrote:
> > Hey all,
> >
> > I am working at a lab where we are pushing tons of data over our network
> > (~500gbs per 2-3 day experiment, which will increase 2-3 times in a
> couple
> > of months). Data is going through multiple storage devices and across a
> few
> > buildings at various times in processing (storage off of a sequencer to
> > cluster temp space to permanent storage). We have been encountering
> really
> > slow transfer speeds, so we suspect that we are hitting a 10mb/s
> connection
> > somewhere.
> >
> > I was asked to benchmark our infrastructure to find the bottlenecks, so
> I
> > wanted to see if anyone had any suggestions of good tools or techniques
> for
> > doing so. Our entire setup is linux with nfs and rsync over ssh for
> > connectivity. It appears that the task should be split into:
> > 1) benchmarking our storage to see where disks are slowing down the
> moving
> > of files.
> > 2) the network at various points, between each leg of our network
> >
> > For #1, I have been working with rsync and just found a tool called
> IOZone
> > that looks interesting. Initially I was going to use rsync for #2 as
> well,
> > but can not figure out how to rsync into /dev/null so as to avoid disk
> > writes. I also saw ttcp online which looks interesting. Does anyone have
> any
> > suggestions of techniques, tools or good sites to use as a reference? So
> far
> > I have been following http://lbs.sourceforge.net/ and the Linux HowTo,
> but
> > would like to do more real-world and practical benchmarking.
> >
> > Thanks so much,
> > Jordan
>
> > _______________________________________________
> > UCLALUG Discussion list - Linux at linux.ucla.edu
> > For information on this list, and to UNSUBSCRIBE, visit:
> > http://linux.ucla.edu/mailman/listinfo/linux
>
>
> --
> Chris Frost  |  <http://www.frostnet.net/chris/>
> -------------+----------------------------------
> PGP: <http://www.frostnet.net/chris/pgpkey.txt>
>
> _______________________________________________
> UCLALUG Discussion list - Linux at linux.ucla.edu
> For information on this list, and to UNSUBSCRIBE, visit:
> http://linux.ucla.edu/mailman/listinfo/linux
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://linux.ucla.edu/pipermail/linux/attachments/20070809/d92a3dc8/attachment.htm