[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Lockups on large initial import

From: Alex R. Mosteo <alejandro_at_mosteo.com>
Date: 2004-09-08 10:27:55 CEST

Matt Pounsett wrote:

[big and interesting snip]

> Because this works fine using only svn with a file:// URL, and because
> this web server allows me to read and write many large files using DAV,
> I'm inclined to think the problem is in mod_dav_svn somewhere.
>
> I'm at a bit of an impasse now. I can't think of anything else to try
> or test. Is there any other information I can provide, or specific
> troubleshooting tasks I can perform to help one of the developers track
> this down?

Thanks Matt for putting it together so clearly. My experience has been
the same, with both failure types, also using Apache.

I agree with your conclusions, but must be noted that someone else
posted the other day a description that could match this problem using
svnserve. So maybe it is a race condition inside BDB or something else.

I wanted to do a test but was unable, maybe you want to try it: to use a
fsfs repository. I've been unable to compile the latest RC so I'm stuck
in 1.0.6 until a .rpm is available. If you do this test, please report
on it.

I'll repost my test script just in case someone else want to stress his
configuration. I suppose that with minor changes it could be used with
svnserve or directly using file://...

(Note that it needs plenty of disk space available).

----8<-----------

#!/bin/sh

# test_data is a folder with randomly created files
rm -rf test_data
mkdir test_data

filesize=10000 # Adjust this filesize for different experiences
x=$((100000000 / filesize))

echo "Creating binaries..."
while ((x)); do
    head -c $filesize /dev/urandom > test_data/random-$x.bin;
    x=$((x - 1));
    echo Remaining to be created: $x...
done

# svn-test is the folder with the repository
sudo rm -rf svn-test
sudo mkdir svn-test
sudo svnadmin create svn-test
sudo chown nobody:nobody -R svn-test # nobody is my apache user
echo "Beginning import..."
svn import test_data http://your.server.here/svn-test/test_data -m ""
echo "Verifying..."
sudo svnadmin verify svn-test
echo "Done."

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Wed Sep 8 10:26:55 2004

This is an archived mail posted to the Subversion Users mailing list.