[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: repos corruption revisited: memory leak?

From: Jan Hendrik <jan.hendrik_at_bigfoot.com>
Date: 2003-10-27 11:40:54 CET

Hi John, Ben, Mark, J Wynia & all others!

Sorry for getting back so late, but I was busy and wanted to do
some more tests with your valuable information on a cold-booted
machine before ...

Concerning Re: repos corruption revisited: mem
John Peacock wrote on 23 Oct 2003, 11:38, at least in part:

> Ben Collins-Sussman wrote:
>
> > When I fire up my httpd on Linux, I get about 8 mpm-prefork
> > children, each about 3 megs in size. After even the most gigantic
> > svn operations, the largest child never grows bigger than 10 megs.
>
> But he's running Apache under Windows, which is a very different beast
> from Linux. I don't run Apache under Windows, so perhaps someone who
> does could see how much memory the child processes typically use.

According to Apache manual on Windows it only starts two
processes, the rest are threads. Here the first process uses
3,628KB at startup, plus 1,620 KB in virtual memory, and 3
threads. This remains quite constant over time.

The other process runs 252 threads throughout, memory starting
7,032 KB, plus 6,652 in vertual memory. Both these values raise to
about 21/22 MB when committing, little difference if 22 or 2100 files
are committed. Or with more files even less, 15/16MB. At one
place the manual speaks of 50 threads as default for Windows, at
another of 64. 250 is what was set in httpd.conf by the installer.

> And I am also pointing out that Windows doesn't behave well under low
> memory conditions (and I would consider 128MB to be very low memory
> for a Windows server). If he is running a browser and editor, etc. on
> the machine, he could quickly exhaust physical RAM. For example, just
> this moment, Mozilla 1.4 is consuming ~60MB and a Macromedia flash
> player app is taking 16MB on top of that.

For someone who worked well with 32MB under Win95 running big
apps like Word97 and Homesite4/5 concurrently plus filemanager,
MS IE, Pegasus Mail it is difficult to believe 128MB are very low!
Yes, adding 64MB made things much smoother, while another
32MB to the maximum of 144MB on this machine (or has, by
chance, someone tried more on the Dell Inspiron 3000/M200ST?
Some vendors offer 128MB modules for this model, too, though
Kingston and Dell say these are for Inspiron 3200 upwards only)
did not make a recognizable difference. However, the 512MB
module for the P4 machine will be ordered this week, also a
cardbus 10/100 NIC for my notebook to open another possible
bottle neck. So in about 10 days I should know if memory is the
basic issue ...

> > memory consumption was low: RAM usage did not go above
> > 80MB, pagefile not above 220 MB.
>
> That't not the individual child processes, that is total RAM
> consumption by _all_ processes. He also didn't identify what other
> processes were running the day before he had his problems. I am also
> concerned that he is using hibernation with resident server processes.

Right, it were all processes. Mainly Word97, Homesite5, Opera6,
Pegasus Mail, TotalCommander. That's my usual workbench and
also was the days before the problems. However, today's tests
where on a clean, cold-booted machine running nothing but
cmd.exe (shell), taskmanager, Apache, Kerio Firewall. And SVN of
course. I attach a table with what taskmanager told immediately
after booting, during separate commits of 63 changed, 22 added,
2100 added, 1874 changed (one line added each) files.

I do not pretend to be able to really interpret the data. Of course I
see that the first commit caused about 25 MB to be swapped and
that already small commits need about 50MB memory. SVN.exe
had 5.6MB plus 4.6MB virtual in these and 11-18MB plus 8.8-
19MB virtual memory in use during the huge commit. Interesting
that now as I am writing this, with Homesite, Pegasus, Opera,
TotalCommander running, with 92MB I have more available RAM
than after booting. Virtual memory is at 200MB now though.

> I don't know for sure, but I think it would be best to add RAM as a
> first pass. If and until someone else can replicate this, his specific
> environment is a more important clue that the software he is running,
> IMNSHO.

Doing so in a couple of days ... would be glad if that ends this
problem.

Jan Hendrik

---------------------------------------
Freedom quote:

     If concern for human poverty and suffering were one's primary motive,
     one would seek to discover their cause. One would not fail to ask:
     Why did some nations develop, while others did not?
     Why have some nations achieved material abundance,
     while others have remained stagnant in sub-human misery?
     History and specifically the unprecedented prosperity-explosion
     of the 19th century would give an immediate answer:
     capitalism is the only system that enables men to produce abundance -
     and the key to capitalism is individual freedom.
                 -- Ayn Rand, Requiem for Man

                 | after boot | commit 63 | commit 22 | commit 2100 | commit 1874
                          | | changed files | added files | changed files | changed files
-----------------|------------|---------------|-------------|---------------|--------------
real memory: | | | | |
                 | | | | |
total | 146,996 | 146,996 | 146,996 | 146,996 | 146,996
                          | | | | |
available | 69,780 | 42,850 | 41,820 | 60,972 | 69,460
                          | | (min. 22,000) |(min. 20,000)| (min. 4,000) |
                          | | | | |
system cache | 79,856 | 67,336 | 69,068 | 69,280 | 72,232
                          | | | | |
-----------------|------------|---------------|-------------|---------------|-------------
virtual memory: | | | | |
                          | | | | |
total | 76,116 | 101,328 | 107,863 | 98,372 | 99,400
                          | | | | |
Grenzwert | 601,384 | 601,384 | 601,384 | 601,384 | 601,384
                          | | | | |
max. value | 78,872 | 112,316 | 115,576 | 119,008 | 119,008
                          | | | | |
-----------------|------------|---------------|-------------|---------------|-------------
Kernel memory: | | | | |
                          | | | | |
total | 21,148 | 31,484 | 37,944 | 28,356 | 28,572
                          | | | | |
swapped | 16,752 | 24,096 | 27,720 | 20,996 | 21,872
                          | | | | |
not swapped | 4,396 | 7,388 | 10,230 | 7,360 | 6,700
                          | | | | |
=================|============|===============|=============|===============|===========
Apache proc. 1 | | | | |
                          | | | | |
memory | 3,628 | 3,628 | 3,628 | 2,544 | 2,544
                          | | | | |
memory max. | 3,628 | 3,628 | 3,628 | 3,628 | 3,628
                          | | | | |
virtual memory | 1,620 | 1,620 | 1,620 | 1,620 | 1,620
                          | | | | |
-----------------|------------|---------------|-------------|---------------|-----------
Apache proc. 2 | | | | |
                          | | | | |
memory | 7,032 | 21,484 | 21,608 | 15,292 | 16,122
                          | | | | |
memory max. | 7,032 | 22,096 | 22,136 | 22,504 | 22,504
                          | | | | |
virtual memory | 6,652 | 22,176 | 22,176 | 22,248 | 22,236

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Mon Oct 27 11:39:15 2003

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.