[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Performance issue with svn export [svn 1.8.11]

From: Eric Johnson <eric_at_tibco.com>
Date: Fri, 29 May 2015 08:43:25 -0700

Hi Nouha,

Based on the relative size of the repositories, one might expect that the
larger repository would take about twice as long to export. So clearly
something is weird here.

You'll still need to provide more details:

   - Are the types of files in the two repositories different?
   - Are you running a virus scanner on the client?
   - Have you timed the command, to find out how much system, user, and
   real time is being spent?
   - What command are you using to export? (Are you exporting from a
   working copy, or directly from the server?)
   - What OS & version thereof are you using on the client?
   - Have you observed the problem with other clients / OSes?
   - Does an export take the same time as a checkout?
   - Have you tried doing a export of the repository on the server? Does it
   show the same time discrepancy?

Somehow, you need to establish enough information to identify whether the
source of the problem is the server, the client, the network, or the
protocol.

For example, the client could be running a virus scanner that goes nuts for
your 30K files repository. Or it could be that something is unreliable
about your network, but only manifests itself with a few files from your
30K repository.

Eric.

On Fri, May 29, 2015 at 7:37 AM, Nouha Terzi <terzi.nouha_at_gmail.com> wrote:

> Hello Eric,
>
> Many thanks for your answer.
>
> What's the client on which you're running the svn export command?
> > I tested with 2 svn clients: 1.6.11 and 1.8.8 from an RH 5 server and
> got the same response time for both export
>
> Are you doing the export across the network, or on the same machine
> hosting the repository?
> > It is thru Network. And the 2 repositories are hosted on the same
> remote svn server.
> My server and my client are hosted on the same WAN-intranet.
>
> When the export is done, how much disk space is taken by the export (in
> both cases)?
> > 121M for the repo having 30k files and 68M for teh second one.
>
> Please note that we are using http protocol not svn thru ssh.
>
> Thank you for valuable support in advancE.
>
> regards,
> Nouha
>
>
> 2015-05-28 21:08 GMT+01:00 Eric Johnson <eric_at_tibco.com>:
>
>> Looks like nobody has responded yet. I've certainly not encountered that
>> behavior.
>>
>> I think you'll need to provide more information. The problem could stem
>> from so many places. Could be, for example, that you've got a virus
>> scanner, and when you export the 30K files, you're exporting files that
>> draw more attention from a virus scanner.
>>
>> What's the client on which you're running the svn export command? Are you
>> doing the export across the network, or on the same machine hosting the
>> repository? When the export is done, how much disk space is taken by the
>> export (in both cases)?
>>
>> Eric.
>>
>> On Tue, May 26, 2015 at 9:05 AM, Nouha Terzi <terzi.nouha_at_gmail.com>
>> wrote:
>>
>>> Hello all,
>>>
>>> we are deploying svn 1.8.11 on our server Rhel 6.6.
>>> We are facing some issue within svn export.
>>> it seems that it has some perf limitation when dealing with a huge
>>> number of files.
>>>
>>> we have this delay when doing an svn export url and the target has:
>>>
>>> less than 20k files export = ~ 1 minute
>>>
>>> more than 30k files export > 1 hour
>>>
>>>
>>>
>>> Is it a known issue? Has someone encouter thsi behavior?
>>>
>>>
>>> thnak you for your valuable support.
>>>
>>>
>>> regards,
>>>
>>> Nouha
>>>
>>
>>
>
Received on 2015-05-29 17:43:57 CEST

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.