Re: Large Commit Issues! 10Mbps Upload cap on a Gigabit LAN

thanks for details.

a) defrag ur client's disk drive.
b) test 'export' and compare its performance agaisnt 'checkout' for same Repo Path. This is due to significant overhead invovled on checkout in order to create woring copies containing pristine copies of checed out files. Hence CO is always lot slower thn ur raw copy tests.
c) consider setting "compression off" (zlib) both on ur SVN client & SVN server (mod_dav_svn). U have good bandwidth available, so IMO compression is an unwarranted overhead on either ends.
d) confirm that network cards on both server & client side have checksum offloading enabled. (i would assume that to be the case as default Win2k3 install)
e) what is access method for SVN Client .. assuming https?

(a), (c), and (d) are applicable for 'Commit' operations as well. Similarly, pls report speed of 'import' a large file into the repo.

50% peak utilization on server some how hints about a bottleneck in the chain (unless its dual proc / HT, and one of the CPU is peaked at 100%).. but lets leave that aside for the time being. BTW, how much RAM in the server?

cheers

Shirish

  ----- Original Message -----
  From: Ahmed Reza
  To: Samay ; users@subversion.tigris.org
  Sent: Tuesday, April 25, 2006 12:36 AM
  Subject: Re: Large Commit Issues! 10Mbps Upload cap on a Gigabit LAN

  Hi Shirish,
      Below are the system specs and some further testing that I did. I'm still trying to figure out the bottlenecking issues. Let me know if you see anything that I missed.

  Regards,
  Ahmed

  Server:
  2.4 Ghz Intel Xeon with 533Mhz FSB
  512 L2 Cache
  Using RAID 1 & SCSI drives capable of 160MB/s
  There are no IRQ duplicates (i.e. no conflicts)
  It has 2, 1Gbps Network cards
  Running Win'03 Server (up to date on all service packs/patches)

  Client:
  Intel P4 3.0Ghz
  1GB of Ram
  1Gbps Network card

  I just copied a 2GB file from the server to the client and vice versa. The transfer was very fast and used ~300Mbps (Average), both ways were about the same. I'm using Net meter on both ends to monitor the bandwidth usage, and until the file transfer the bandwidth monitor was pretty much showing little activity so I assume 99.9% of the bandwaidth useage was due to the file copy operation between the server to the client hard drive and then back again. I checked to make sure that all irritating background processes like Norton, were shut off and all the microsoft fast indexing services were shut off. There is virtually no server load besides the programs/transerfs that I am running, as this server is a dedicated server being used by me.
  Next, I just tried doing a checkout of a 1.8GB file and looking at the bandwidth monitor, it looks like the maximum bandwidth usage was 28Mbps and average was ~20Mbps. During the transfer, neither the client or server were really pressed for resources, as the server used a max of 50% of it's processing power and ~281MBs of memory, the client pc shows similiar load.

  Please let me know if this info helps. I am still left wondering... Thanks again for the help.

  Regards,
  Ahmed

  On 4/22/06, Samay < getafix123@hotmail.com> wrote:
    Transfer speed also depends on
    a) server specs -> processor, memory
    b) bus speed
    c) any IRQ sharing (e.g. Eth0 & Drive Controller sharing same IRQ-- ouch!!)
    d) speed of drives & raid controller, raid config
    e) server load (processes in wait stage?)
    f) operating system & configuration.
    g) and MTU (jumbo frames?) on the network itself

    of course least common denominator of the server & cliebt capability defines the over all speed u may get. Care to share details above?

    regards

    Shirish
      ----- Original Message -----
      From: Ahmed Reza
      To: users@subversion.tigris.org
      Sent: Sunday, April 23, 2006 3:06 AM
      Subject: Large Commit Issues! 10Mbps Upload cap on a Gigabit LAN

        Hi, I'm running into an issue that nobody seems to know a heck of a lot about. I'm moving a whole bunch of files from an old repository system (RCS) to SVN (i.e 80,000+ files, ~60GB). However, checking in is virtually impossible. I have a Gigabit connection to the server and all other data transfers are blazing fast except for SVN which caps at 10Mbps uploading to the server and 20Mbps when I'm checking out. I would really, really appreciate any help on this subject as I have googled this for hours to no avail.

        Thanks,
        Ahmed
Received on Mon Apr 24 17:03:00 2006