FW: SlikSVN 1.6.6 64-bit stalls on some operations

Greetings.

                I've run into an issue with the latest release of SlikSVN
(1.6.6). I'm copying the problem description from an earlier mail to the
SlikSVN team, as the SlikSVN team has suggested I contact this list for
suggestions.

                I've been using SlikSVN for all of my 64-bit Windows
systems. Beginning with 1.6.6, I found that the svn client frequently
stalls, for 120 seconds or more, on certain operations. It seems to stall in
particular at the following places:

1) At the beginning of a checkout operation, before copying any
files.

2) At the end of an import or checkin operation, after the server
has completed the transaction, but before the client reports the new
revision number.

3) At the end of an list operation, before returning control to
the parent process.

4) At the end of some update operations, before returning control
to the parent process.

While the client is stalling, I can check the network connections and see
that a TCP connection is open to the server, so the problem appears to be
related to some I/O blocking.

I've only observed this problem when working against my server, though I
spend only a small amount of time working with other servers. I haven't been
able to replicate the issue with Google or Sourceforge HTTPS servers. My
server is running SVN 1.6.6 on Apache 2.2.14 behind IIS via ISAPI Rewrite.

I do not experience the issue with the Tigris.org 1.6.6 svn client nor with
TortoiseSVN 1.6.6 client. I always experience the problem with the 32-bit
and 64-bit SlikSVN clients.

The problem can be easily replicated by requesting a list operation on
https://svn.jaraco.com/jaraco/python with the SlikSVN 1.6.6 client.
Obviously, the problem seems to be related to my server configuration as
well, but because the problem emerged with the latest release of the client,
and since the server works well with other clients, it makes the most sense
to determine what changed with the client.

The SlikSVN team has suggested I write this list to see if you have any
suggestions as to what might be causing the stalls. I suspect the problem
has something to do with the way that the I/O is handled. The problem
emerged with 1.6.6 and goes away if I roll back to SlikSVN 1.6.5.

Was there any change in the Subversion 1.6.5-1.6.6 changeset that might
affect the I/O behavior as described?

                Do you have any other suggestions for troubleshooting this
issue?

Regards,

Jason

From: Jason R. Coombs
Sent: Tuesday, 24 November, 2009 10:39
To: Bert Huijben
Cc: 'Thijs Leydens (Slik BV)'
Subject: RE: SlikSVN 1.6.6 64-bit stalls on some operations

Hi Bert.

                Thanks for the clarification. I'm used to build systems that
take the latest revision of the tree and not the revision of the repository
when tagging projects, and since the revision was from the trunk, I wanted
to be sure that wasn't the issue.

                This means the issue I'm having is not related to the SVN
sources, but something specific to the SlikSVN build process (and also
specific to my server, it seems).

                Did anything change with the SlikSVN build process between
1.6.5 and 1.6.6? Do you have instructions on how I could replicate the
SlikSVN build process locally so I can track down the issue?

Regards,

Jason

From: Bert Huijben [mailto:bert_at_qqmail.nl]
Sent: Tuesday, 24 November, 2009 04:57
To: Jason R. Coombs
Cc: 'Thijs Leydens (Slik BV)'
Subject: RE: SlikSVN 1.6.6 64-bit stalls on some operations

                Hi Jason,

SlikSVN is not build against Subversion trunk. It is build against the
specific version tag (In this case
http://svn.collab.net/repos/svn/tags/1.6.6) at a specific revision. As the
SharpSvn binaries were build more than a week after the release of 1.6.6,
the revision at which the tag was retrieved is later than the one used to
generate the tarball.

(Actually the tarball was created against ^/branches/1.6.x). But all of this
only documents the exact procedure as there were no changes in between.

Once a release is tagged in the Subversion release, the tag should never
change..

If SlikSVN would be built from the subversion trunk sources you would have
dozens of other issues (probably many more). The Subversion trunk
development state doesn't have a guaranteed stable working copy format at
this time, so I would not recommend using it for developing anything outside
subversion itself.

And it would certainly make it impossible to share a working copy with any
other subversion client as the format currently changes every few weeks
until it reaches the final WC-NG state we like for Subversion 1.7.

                Bert

From: Thijs Leydens (Slik BV) [mailto:thijs_at_slik.eu]
Sent: dinsdag 24 november 2009 9:22
To: bert_at_vmoo.com
Subject: FW: SlikSVN 1.6.6 64-bit stalls on some operations

From: Jason R. Coombs [mailto:jaraco_at_jaraco.com]
Sent: maandag 23 november 2009 19:07
To: support_at_sliksvn.com
Subject: RE: SlikSVN 1.6.6 64-bit stalls on some operations

Dear Thijs,

Let me first apologize for not taking your suggestion more seriously. My
initial instinct was that because I can only reproduce the problem with
SlikSVN that it must be a Slik SVN issue. but after some additional
information, I see how it could be a core subversion issue.

I've created a hybrid SlikSVN with the 1.6.6 binaries replaced with the
OpenSSL binaries from 1.6.5 and this had no effect, so the problem is
probably not due to the OpenSSL libraries.

I then noticed that SlikSVN is built against SVN r40358 while the Tigris.org
binaries are built against r40053. I now suspect that perhaps the issue
could reside between those revisions.

Can you confirm that the SlikSVN releases were built against a trunk
checkout of the SVN code? Was that done on purpose?

I sincerely appreciate you taking the time to help me resolve these issues.
If you can answer those straightforward questions, it will help me
significantly in tracking down the issue.

Best Regards,

Jason

From: Jason R. Coombs
Sent: Monday, 23 November, 2009 11:57
To: support_at_sliksvn.com
Subject: RE: SlikSVN 1.6.6 64-bit stalls on some operations

Dear Thijs,

                Thanks for your prompt reply.

                I'm concerned, however, that since I can't reproduce the
problem with the Tigris.org subversion client that there's nothing they can
investigate. Indeed, if I were them, based on my results, the first thing I
would recommend is to contact SlikSVN.

                That is, I can run svn.exe from the svn-1.6.6-win32.zip
binary distribution for Windows and it doesn't stall, but if I run the same
command from the SlikSVN 1.6.6 distribution, it does stall.

                I decided to run another test. I went to my server and
performed a list operation using SlikSVN directly to the Apache server not
through the SSL and reverse proxy. This test did not exhibit the stall,
which leads me to conclude that the issue lies between the SlikSVN 1.6.6
client and something in the SSL or HTTP handling on the client side.

                Now I understand that the SlikSVN client works on other
SSL-enabled sites, so it's not strictly an SSL issue. However, it seems
likely to me that the compilation of the OpenSSL library with SlikSVN is one
of the likely differences between the Tigris.org binaries and SlikSVN
binaries.

                I can continue to investigate. In the meantime, can you
confirm the OpenSSL versions used with SlikSVN 1.6.5 and 1.6.6?

Regards,

Jason

From: Thijs Leydens (Slik Subversion) [mailto:thijs_at_sliksvn.com]
Sent: Monday, 23 November, 2009 11:05
To: Jason R. Coombs
Cc: support_at_sliksvn.com
Subject: RE: SlikSVN 1.6.6 64-bit stalls on some operations

Hi Jason,

Sorry for not coming back to you; our SlikSVN client manager has been ill
for some time now.

I've been told that it is very unlikely that your issues are caused by our
binaries - it seems more like a Subversion issue than a SlikSVN issue. It's
probably best to forward your questions to users_at_subversion.tigris.org.

Best regards,

--

 Thijs Leydens

 Slik Developer Tools BV | A Slik company

 Support: support_at_sliksvn.com | Tel +31 10 2827804 | Fax +31 10 2827805

 Mauritsweg 49 | NL-3012 JW Rotterdam | The Netherlands | KvK 24441791

From: Jason R. Coombs [mailto:jaraco_at_jaraco.com]
Sent: maandag 23 november 2009 11:56
To: support_at_sliksvn.com
Subject: SlikSVN 1.6.6 64-bit stalls on some operations

Greetings,

                I sent a message about this issue via the web support form a
couple of weeks ago. I didn't hear anything, so I'm resending in case the
first message was lost. I also have additional information over what I
reported before. I'm hoping this issue can be resolved for the next release.

                I've been using SlikSVN for all of my 64-bit Windows
systems. Beginning with 1.6.6, I found that the svn client frequently
stalls, for 120 seconds or more, on certain operations. It seems to stall in
particular at the following places:

1) At the beginning of a checkout operation, before copying any files.

2) At the end of an import or checkin operation, after the server has
completed the transaction, but before the client reports the new revision
number.

3) At the end of an list operation, before returning control to the
parent process.

I think I've seen it stall on an update operation, but many updates complete
without the stall, so I may be mistaken.

While the client is stalling, I can check the network connections and see
that a TCP connection is open to the server, so the problem appears to be
related to some I/O blocking.

I've seen this problem on five separate installations of SlikSvn 1.6.6 (32-
and 64-bit) on Windows Vista, Windows 7, and Windows Server 2008. I've only
observed the problem when communicating with my server, which is SVN 1.6.6
behind Apache 2.2.14 behind IIS and ISAPI Rewrite. I had the same problem
with the 1.6.5 server, so I upgraded it to 1.6.6 to make sure that wasn't a
factor. I haven't observed this problem with any other server, though I use
my server most frequently.

I do not experience the stalls when using the Tigris.org 32-bit svn 1.6.6
client nor when using TortoiseSVN 1.6.6 (either 32- or 64-bit), so the
problem seems to be unique to my server and SlikSVN 1.6.6. I'd like to
continue to use SlikSVN's client, but these stalls are quite annoying.

I suspect you will be able to replicate the problem by performing a list on
https://svn.jaraco.com/jaraco/python/ .

It's quite possible the problem is related to my server, but since the
problem emerged between SlikSVN 1.6.5 and 1.6.6 and because the server works
reliably with other clients, I'm hoping a solution can be found with
SlikSVN. I'm happy to run test or debug code and help track down the issue.
I've never compiled an SVN client before, but I have Visual Studio 2008 and
I'm comfortable working through a procedure to set up the dependencies if
it's documented well enough. I didn't see SlikSVN source code on the web
site, though, so I understand if you're keeping that proprietary.

Please let me know if I can provide an additional information.

Regards,

Jason R. Coombs

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2425921

Please start new threads on the <users_at_subversion.apache.org> mailing list.
To subscribe to the new list, send an empty e-mail to <users-subscribe_at_subversion.apache.org>.