issue 1463: locale problems during import and export/checkout

HI SVN Users :)

as Karl send me a comment on this issue, that I should describe you the
problem here on this list.

Ok, lets go:

You have to take a file tree with binary and/or text data just like this:

/content/bla/fasel/großbritannien.html
/content/fasel/bla/Für alle Zeiten_trailer.mov

As you can see, I'm using german umlaute (ß == ß and ü == ü).

My OS is Debian Linux Woody with all security and bugfix packages applied.
I'm using Berkeley DB 4.1.25 or 4.0.14 as reference implementation.
Also I'm using apache 2.0.45/2.0.46 as a webdav server.

Neon, Openssl, etc. are always the latest stable releases.

ok, my system locale is POSIX (export LANG=POSIX), this locale is set up from
the installation server of our server farm, so normally no harm.

ok now do the following:

svnadmin create /data/repos/inbox

svn import /content file://data/repos/inbox

When you are trying to import now the files into the repository, this action
will abort with the failure: failure during string recode (utf.c:173)
(libsvn_subr).
After this action, the DB is completly broken.

When I change the locale to "export LANG=de_DE@euro" and do the import again
everything works fine.

Now the other way around, you import the filetree with a correct locale
setting, and after this, you reset the locale to "POSIX" or to another locale
!= iso-8859-xx, and try to export or checkout (i did a checkout in this
test).

If you reach the first file with the special char (german umlaut), the
checkout will abort with the same error message I wrote, at the same line in
the sourcecode.

What's the problem with it:

I have to serve different data repositories for diff. countries.
All countries have their own locale setting, but I can't change the locale
everytime, just because all repositories are laying on a HA cluster.

So, if I have a german user with a german locale, and he wants to checkout a
repository which was imported with e.g. a russian locale (kyrillic charset),
this action will abort and during adding and importing files it will destroy
the berkeley db behind the repository.

I can't be sure, that all users will be using only filenames with 7bit
characters, so, I have to deal with the allmyghty windows people, who are
using all those "nifty" features like spaces and special chars in filenames
;)

I hope, that this is not a "feature" of subversion or apr (the function which
do the convert is in APR, and I think they're using some of glibc's iconv
features).

hope you can help me to get a solution for this problem, just because I want
to use subversion for my project, but if this is an issue, what can't be
fixed, I have to think about other version control systems.

regards,

\sh

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Wed Aug 6 10:08:59 2003