[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Suspected Memory Leak for merge

From: Brian Buesker <bbuesker_at_qualcomm.com>
Date: 2005-07-13 07:30:53 CEST

Sorry, I forgot to attach the log. Here it is.

Brian

Brian Buesker wrote:

>I have a script that uses the SVN perl bindings to do many (typically
>small) merges. Looking at the memory for the script in top shows the
>memory usage growing significantly. I created a simple perl script that
>just does the merges and nothing else, and captured the top output to a
>file. The script basically does something like this:
>
>my $client = new SVN::Client( auth => [SVN::Client::get_simple_provider(),
> SVN::Client::get_username_provider(),
> SVN::Client::get_ssl_server_trust_file_provider()]);
>
>$client->checkout (...);
>
>for my $i ( 1 .. $n ) {
> $client->merge (...);
>}
>
>Attached is the output of top for approximately 25 merges. In this log,
>the merges begin somewhere around the 20m mark. I wouldn't expect the
>memory usage to grow that quickly when doing merges. We have seen much
>worse growth than this where the RES value grows above 1 GB.
>
>Unfortunately I can't make our repository available for testing, and I
>haven't come up with an easy way to write a test script that will prep a
>repository with enough things that can be merged in order to reproduce
>this error. However, I am certainly willing to try any potential patches
>to see if the leak is fixed.
>
>Currently I have only tested this with 1.1.4, although I have not seen
>anything in the changelogs for 1.2.x that would indicate something like
>this has been fixed.
>
>The entire details of my environment are as follows:
>
>OS: Fedora Core 3
>
>SVN Version:
>% svn --version
>svn, version 1.1.4 (r13838)
> compiled Apr 5 2005, 15:49:54
>
>Copyright (C) 2000-2004 CollabNet.
>Subversion is open source software, see http://subversion.tigris.org/
>This product includes software developed by CollabNet
>(http://www.Collab.Net/).
>
>The following repository access (RA) modules are available:
>
>* ra_dav : Module for accessing a repository via WebDAV (DeltaV) protocol.
>- handles 'http' schema
>- handles 'https' schema
>* ra_local : Module for accessing a repository on local disk.
>- handles 'file' schema
>* ra_svn : Module for accessing a repository using the svn network
>protocol.
>- handles 'svn' schema
>
>Compiler:
>$ gcc --version
>gcc (GCC) 3.4.2 20041017 (Red Hat 3.4.2-6.fc3)
>Copyright (C) 2004 Free Software Foundation, Inc.
>This is free software; see the source for copying conditions. There is NO
>warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
>
>Perl:
>$ perl -v
>
>This is perl, v5.8.5 built for i386-linux-thread-multi
>
>Copyright 1987-2004, Larry Wall
>
>Perl may be copied only under the terms of either the Artistic License
>or the
>GNU General Public License, which may be found in the Perl 5 source kit.
>
>Complete documentation for Perl, including FAQ lists, should be found on
>this system using `man perl' or `perldoc perl'. If you have access to the
>Internet, point your browser at http://www.perl.com/, the Perl Home Page.
>
>Berkeley DB Version: 4.2.52
>
>OpenSSL Version:
>$ rpm -q openssl
>openssl-0.9.7a-40
>
>Please let me know if you need any more information.
>
>Thanks,
>Brian
>
>
>

32388 bbuesker 15 0 21740 12m 4304 S 20.0 1.3 0:10.57 memtest.pl
32388 bbuesker 15 0 21740 12m 4304 R 7.3 1.3 0:10.79 memtest.pl
32388 bbuesker 15 0 22576 13m 4304 S 41.0 1.4 0:12.02 memtest.pl
32388 bbuesker 15 0 22844 13m 4304 S 14.7 1.4 0:12.46 memtest.pl
32388 bbuesker 15 0 22976 14m 4304 S 17.0 1.4 0:12.97 memtest.pl
32388 bbuesker 15 0 23392 14m 4304 S 27.0 1.4 0:13.78 memtest.pl
32388 bbuesker 15 0 23528 14m 4304 R 29.3 1.4 0:14.66 memtest.pl
32388 bbuesker 15 0 24132 15m 4304 S 30.7 1.5 0:15.58 memtest.pl
32388 bbuesker 15 0 24452 15m 4304 R 24.0 1.5 0:16.30 memtest.pl
32388 bbuesker 15 0 24852 15m 4304 S 32.3 1.6 0:17.27 memtest.pl
32388 bbuesker 15 0 25384 16m 4304 S 37.7 1.6 0:18.40 memtest.pl
32388 bbuesker 15 0 25992 17m 4304 R 35.3 1.7 0:19.46 memtest.pl
32388 bbuesker 16 0 26404 17m 4304 R 37.3 1.7 0:20.58 memtest.pl
32388 bbuesker 15 0 26876 17m 4304 S 17.7 1.8 0:21.11 memtest.pl
32388 bbuesker 15 0 26876 17m 4304 S 12.7 1.8 0:21.49 memtest.pl
32388 bbuesker 15 0 27156 18m 4304 S 17.7 1.8 0:22.02 memtest.pl
32388 bbuesker 15 0 27360 18m 4304 S 12.7 1.8 0:22.40 memtest.pl
32388 bbuesker 15 0 27360 18m 4304 S 13.7 1.8 0:22.81 memtest.pl
32388 bbuesker 15 0 27496 18m 4304 S 9.3 1.8 0:23.09 memtest.pl
32388 bbuesker 15 0 27788 18m 4304 S 17.7 1.9 0:23.62 memtest.pl
32388 bbuesker 16 0 28196 19m 4304 D 25.3 1.9 0:24.38 memtest.pl
32388 bbuesker 15 0 28384 19m 4304 S 10.3 1.9 0:24.69 memtest.pl
32388 bbuesker 15 0 28384 19m 4304 S 10.3 1.9 0:25.00 memtest.pl
32388 bbuesker 15 0 28384 19m 4304 S 10.3 1.9 0:25.31 memtest.pl
32388 bbuesker 16 0 28384 19m 4304 R 21.0 1.9 0:25.94 memtest.pl
32388 bbuesker 15 0 29372 20m 4304 S 12.0 2.0 0:26.30 memtest.pl
32388 bbuesker 15 0 29372 20m 4304 S 7.3 2.0 0:26.52 memtest.pl
32388 bbuesker 15 0 29372 20m 4304 S 6.7 2.0 0:26.72 memtest.pl
32388 bbuesker 15 0 29372 20m 4304 S 5.3 2.0 0:26.88 memtest.pl
32388 bbuesker 15 0 29372 20m 4304 S 9.3 2.0 0:27.16 memtest.pl
32388 bbuesker 15 0 29372 20m 4304 S 6.3 2.0 0:27.35 memtest.pl
32388 bbuesker 15 0 29372 20m 4304 S 7.0 2.0 0:27.56 memtest.pl
32388 bbuesker 15 0 30308 21m 4304 R 50.3 2.1 0:29.07 memtest.pl
32388 bbuesker 15 0 30620 21m 4304 R 43.3 2.1 0:30.37 memtest.pl
32388 bbuesker 15 0 30620 21m 4304 R 36.7 2.1 0:31.47 memtest.pl
32388 bbuesker 15 0 31176 21m 4304 R 42.7 2.2 0:32.75 memtest.pl
32388 bbuesker 15 0 31176 21m 4304 S 28.3 2.2 0:33.60 memtest.pl
32388 bbuesker 15 0 31176 21m 4304 S 15.0 2.2 0:34.05 memtest.pl
32388 bbuesker 16 0 31480 22m 4304 R 14.7 2.2 0:34.49 memtest.pl
32388 bbuesker 15 0 31480 22m 4304 R 15.0 2.2 0:34.94 memtest.pl
32388 bbuesker 15 0 31788 22m 4304 S 15.3 2.2 0:35.40 memtest.pl
32388 bbuesker 15 0 32100 22m 4304 S 17.0 2.3 0:35.91 memtest.pl
32388 bbuesker 15 0 32424 23m 4304 S 15.3 2.3 0:36.37 memtest.pl
32388 bbuesker 16 0 32424 23m 4304 S 16.7 2.3 0:36.87 memtest.pl
32388 bbuesker 16 0 32424 23m 4304 S 14.3 2.3 0:37.30 memtest.pl
32388 bbuesker 16 0 32424 23m 4304 S 14.3 2.3 0:37.73 memtest.pl
32388 bbuesker 15 0 32424 23m 4304 R 14.3 2.3 0:38.16 memtest.pl
32388 bbuesker 15 0 32732 23m 4304 R 14.7 2.3 0:38.60 memtest.pl
32388 bbuesker 15 0 32732 23m 4304 S 15.3 2.3 0:39.06 memtest.pl
32388 bbuesker 15 0 32732 23m 4304 S 14.7 2.3 0:39.50 memtest.pl
32388 bbuesker 16 0 32732 23m 4304 S 12.3 2.3 0:39.87 memtest.pl
32388 bbuesker 15 0 33044 23m 4304 S 15.0 2.4 0:40.32 memtest.pl
32388 bbuesker 15 0 33044 23m 4304 S 15.0 2.4 0:40.77 memtest.pl
32388 bbuesker 16 0 33044 23m 4304 S 15.3 2.4 0:41.23 memtest.pl
32388 bbuesker 15 0 33044 23m 4304 S 21.0 2.4 0:41.86 memtest.pl
32388 bbuesker 16 0 33044 23m 4304 R 35.3 2.4 0:42.92 memtest.pl
32388 bbuesker 15 0 33044 23m 4304 R 28.6 2.4 0:43.79 memtest.pl
32388 bbuesker 16 0 33180 23m 4312 S 33.3 2.4 0:44.79 memtest.pl
32388 bbuesker 16 0 36424 27m 4332 D 3.3 2.7 0:44.89 memtest.pl
32388 bbuesker 15 0 46932 37m 4360 S 11.0 3.7 0:45.22 memtest.pl
32388 bbuesker 15 0 47024 37m 4364 S 1.3 3.7 0:45.26 memtest.pl
32388 bbuesker 15 0 47288 37m 4364 S 2.7 3.7 0:45.34 memtest.pl
32388 bbuesker 15 0 61416 51m 4364 S 17.3 5.1 0:45.86 memtest.pl
32388 bbuesker 15 0 61856 52m 4380 S 3.0 5.2 0:45.95 memtest.pl
32388 bbuesker 15 0 62196 52m 4380 S 3.0 5.2 0:46.04 memtest.pl
32388 bbuesker 15 0 62872 52m 4380 S 2.7 5.2 0:46.12 memtest.pl
32388 bbuesker 16 0 90092 79m 4396 R 31.7 7.9 0:47.07 memtest.pl
32388 bbuesker 15 0 91924 81m 4396 S 5.0 8.1 0:47.22 memtest.pl
32388 bbuesker 15 0 92392 81m 4400 S 3.3 8.1 0:47.32 memtest.pl
32388 bbuesker 16 0 92920 82m 4400 R 5.3 8.2 0:47.48 memtest.pl
32388 bbuesker 15 0 120m 112m 4400 S 34.0 11.1 0:48.50 memtest.pl
32388 bbuesker 15 0 121m 113m 4400 S 3.0 11.2 0:48.59 memtest.pl
32388 bbuesker 15 0 122m 113m 4400 S 3.7 11.3 0:48.70 memtest.pl
32388 bbuesker 15 0 122m 113m 4400 S 3.7 11.3 0:48.81 memtest.pl
32388 bbuesker 15 0 123m 114m 4400 S 4.3 11.3 0:48.94 memtest.pl
32388 bbuesker 15 0 123m 114m 4400 R 3.3 11.4 0:49.04 memtest.pl
32388 bbuesker 16 0 123m 114m 4400 S 3.0 11.4 0:49.13 memtest.pl
32388 bbuesker 15 0 124m 115m 4400 S 3.7 11.5 0:49.24 memtest.pl
32388 bbuesker 15 0 137m 129m 4400 S 21.3 12.8 0:49.88 memtest.pl
32388 bbuesker 15 0 138m 129m 4400 S 2.3 12.9 0:49.95 memtest.pl

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Wed Jul 13 07:35:24 2005

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.