[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: repos not accessible after log files removed (II)

From: Jan Hendrik <jan.hendrik_at_bigfoot.com>
Date: 2003-09-30 09:21:06 CEST

To complete this barely noticed thread at least for my own records:

After another recover I could dump the corrupt repos without trouble
and load it into a virginal .30 repos. Doing a verify on the repos also
showed no troubles. However, after a few commits and updates it
was business as usual: no longer accessable. I had not even
removed the unused logfiles at that point, something I supposed to
be the cause so far.

Generally it looks like it happens faster or at least more likely when
the repos is accessed via Apache through the LAN than via
Apache a/o file:/// on the local disk. But I stress the "faster" and
"more likely".

Since for me there is no pattern I can follow after about three
working days spent on this I recalled Subversion from production to
low level testing. That is I keep two or three private copies of
working copies and update/commit them occasionally while doing
production by old-fashioned synchronizing again. And give Perforce
a second try.

Though in painful work I could reconstruct data of about 100
changed files, in terms of source control - as I understand it - I have
lost data. And in view of recent major changes on the website files
the loss is really huge for I lost the ability to undo these, no matter
if I need to revert or not.

It would be interesting though to hear of this belongs to the typical
things one has to "accept" when using basically Unix apps as
Berkeley, Apache, Subversion in their Windows ports. (It's a small
peer-to-peer LAN here, all W2K SP2.)

Jan Hendrik

Concerning Re: repos not accessible after log
Jan Hendrik wrote on 27 Sep 2003, 11:29, at least in part:

> As it continued to be an on and off with the repos - that is, do a
> recover and remove unused logfiles, accessing it a few times
> successfully and then no access again and start with recover again - I
> created a new repos and will now upgrade to SVN .30 and see what
> happens then after removing unused logfiles.
>
> Since I could not have any trust in that constantly broken/recovered
> repos anymore I regard its contents as being lost and reconstructed
> data by manually synchronizing the existing working copies (comparing
> and merging about 100 files in WinMerge - fortunately not all 4500
> files!) instead of using a dump.
>
> Hope this will not happen again! It was not very amusing nor do I like
> gigabytes filled with logfiles, especially when just a Check for
> updates per TSVN crates about 50 new ones!
>
> Jan Hendrik
>
> Concerning repos not accessible after log file
> Jan Hendrik wrote on 25 Sep 2003, 21:06, at least in part:
>
> > In addition to the report below and after a day of trial'n'error,
> > predominantly with the test repos:
> >
> > Stopping Apache, recovering the repos, starting Apache gives
> > access back for some time. Normal LAN traffic is unaffected.
> > However, recovering only works when the removed logfiles (--only-
> > unused) are restored from backup before.
> >
> > svnadmin lstxns revealed a couple of pending transactions,
> > supposedly from failed commits, both in the production repos as in
> > the test repos not used for about two weeks. I removed these with
> > svnadmin rmtxns.
> >
> > But the problem persists: after some time I cannot access the
> > repos anymore, nor the server per browser at all (http://servername
> > times out). Doing ping shows the machine is alive, turning off the
> > firewall makes no difference. Here's the output:
> >
> > C:\>ping dim4300
> >
> > Ping Dim4300 [192.168.0.3] mit 32 Bytes Daten:
> >
> > Antwort von 192.168.0.3: Bytes=32 Zeit=100ms TTL=128
> > Antwort von 192.168.0.3: Bytes=32 Zeit<10ms TTL=128
> > Antwort von 192.168.0.3: Bytes=32 Zeit<10ms TTL=128
> > Antwort von 192.168.0.3: Bytes=32 Zeit<10ms TTL=128
> >
> > Ping-Statistik for 192.168.0.3:
> > Packets: sent = 4, received = 4, lost = 0 (0% loss),
> > Ca. Zeitangaben in Millisek.:
> > Minimum = 0ms, Maximum = 100ms, Mittelwert = 25ms
> >
> > C:\>svn ls http://dim4300/svn/repos/trunk/internet/Marine
> > svn: RA layer request failed
> > svn: PROPFIND request failed on '/svn/repos/trunk/internet/Marine'
> > svn: PROPFIND of '/svn/repos/trunk/internet/Marine': could not
> > connect to server
> > (http://dim4300)
> >
> > C:\>
> >
> > Since this happens with both repos which are accessed thruogh
> > different Apache servers, one of about 130MB, the other 80MB it
> > looks unlikely that it is related to size or my recent commit of
> > 4500 files which went to the production repos only. But it seems to
> > be related somehow to removing obsolete logfiles.
> >
> > System W2K, SVN .27, Apache 2.0.47 (there was no SVN .28 for
> > Windows, when .29 came I was too busy to trouble myself with the
> > schema change, when through the work .30 was around the corner
> > already, but now I am reluctant to upgrade a system that
> > fundamentally stopped working).
> >
> > BTW I am amazed that just checking for updates (with TSVN)
> > produces about 50 logfiles!
> >
> > Jan hendrik
> > > Hi all out there!
> > >
> > > A strange coincidence:
> > >
> > > some hours after a huge commit I could not access the production
> > > repos anymore (via Apache) and I had to stop and start Apache
> > > (restart would not do). Before starting I did svnadmin recover. On
> > > the time of the repos request the user of the SVN server machine
> > > got a Windows message about lacking virtual memory.
> > >
> > > The next day this repeated. Looking deeper into it I found that
> > > Apache did not respond at all. That is, server/manual timed out,
> > > too.
> > >
> > > Still thinking this were an Apache issue of some sort I was much
> > > surprised to find that except for the virtual memory message I had
> > > the same problem on my own machine accessing a local test repos
> > > via my own local Apache server. I had not done so for about a
> > > fortnight, but Apache always run quietly in the background.
> > >
> > > However, Sep. 7 I had run
> > >
> > > svnadmin lsdblogs --only-unused | xargs rm
> > >
> > > on it. And the same command after the commit to the other
> > > machine with the production repos.
> > >
> > > Going further back to my first steps with SVN before setting up
> > > Apache I had this with the first repos and file:/// access, too.
> > > That was with SVN .25. Checking out per file:///repos is
> > > impossible now again, the command hangs and finally times out.
> > > Looks like the repos does like to have *all* its logs around, even
> > > those reported to be no longer in use.
> > >
> > > Moving log files back into the db folder from a backup did not
> > > help though.
> > >
> > > Running SVN .27, Apache 2.0.47, Win2K SP2.
> > >
> > > Thanks for any suggestions.
> > >
> > > Jan Hendrik
> > > ---------------------------------------
> > > Freedom quote:
> > >
> > > We've gone astray from first principles.
> > > We've lost sight of the rule
> > > that individual freedom and ingenuity
> > > are at the very core of everything
> > > that we've accomplished.
> > > Government's first duty is to protect the people,
> > > not run their lives.
> > > -- Ronald Reagan
> > >
> > > ---------------------------------------
> > > Mailed with Pegasus Mail 3.12c (32bit).
> > > Never heard of it?
> > > Easy to use, full featured - and freely available.
> > > And *no* automatic virus activation and spreading.
> > > Take a look at http://www.pmail.com
> > > Give it a try - and you'll never miss anything else.
> > >
> > > ------------------------------------------------------------------
> > > -- - To unsubscribe, e-mail:
> > > users-unsubscribe@subversion.tigris.org For additional commands,
> > > e-mail: users-help@subversion.tigris.org
> > >
> >
> >
> > ---------------------------------------
> > Freedom quote:
> >
> > There is no worse tyranny than to force a man to pay for
> > what he does not want merely because you think it would be good
> > for him.
> > -- Robert Heinlein
> >
> > ---------------------------------------
> > Mailed with Pegasus Mail 3.12c (32bit).
> > Never heard of it?
> > Easy to use, full featured - and freely available.
> > And *no* automatic virus activation and spreading.
> > Take a look at http://www.pmail.com
> > Give it a try - and you'll never miss anything else.
> >
> > --------------------------------------------------------------------
> > - To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> > For additional commands, e-mail: users-help@subversion.tigris.org
> >
>
>
> ---------------------------------------
> Freedom quote:
>
> We've gone astray from first principles.
> We've lost sight of the rule
> that individual freedom and ingenuity
> are at the very core of everything
> that we've accomplished.
> Government's first duty is to protect the people,
> not run their lives.
> -- Ronald Reagan
>
> ---------------------------------------
> Mailed with Pegasus Mail 3.12c (32bit).
> Never heard of it?
> Easy to use, full featured - and freely available.
> And *no* automatic virus activation and spreading.
> Take a look at http://www.pmail.com
> Give it a try - and you'll never miss anything else.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org For
> additional commands, e-mail: users-help@subversion.tigris.org
>

---------------------------------------
Freedom quote:

     We believed then and now:
     There are no limits to growth and human progress
     when men and women are free to follow their dreams.
     And we were right to believe that.
                -- Ronald Reagan

---------------------------------------
Mailed with Pegasus Mail 3.12c (32bit).
Never heard of it?
Easy to use, full featured - and freely available.
And *no* automatic virus activation and spreading.
Take a look at http://www.pmail.com
Give it a try - and you'll never miss anything else.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Tue Sep 30 09:18:21 2003

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.