On 2011-09-11 21:40, Johan Corveleyn wrote:
> On Mon, Sep 5, 2011 at 11:09 PM, David Darj<zid_at_alagazam.net> wrote:
>> On 2011-09-02 00:02, Johan Corveleyn wrote:
>>> On Tue, Aug 30, 2011 at 11:29 PM, David Darj<zid_at_alagazam.net> wrote:
>>>> On 2011-08-28 20:34, Johan Corveleyn wrote:
>>>>> Hi,
>>>>>
>>>>> I get a test failure of svnsync_tests.py 28: copy and reencode
>>>>> non-UTF-8 svn:* props. The following error appears:
>>>>>
>>>>> svnsync: E720087: Can't convert string from 'ISO-8859-3' to 'UTF-8':
>>>>> svnsync: E720087: 2011-01-11T20:57:24.206641Z
>>>>>
>>>>> See also fails.log in attachment.
>>>>>
>>>>> This happens on 1.7.x as well as on trunk. On Windows XP (Visual C
>>>>> Express 2008).
>>>>>
>>>>> ISTR that this error is already there for quite some time, but I
>>>>> didn't yet take the time to investigate further (and my build
>>>>> environment was broken for some time). I guess it has something to do
>>>>> with r1084335, which introduced functionality to let svnsync translate
>>>>> properties that were not encoded in UTF-8.
>>>>>
>>>>> Is anyone else seeing this? Any ideas?
>>>>>
>>>> I've also seen this on my VC6 build for beta3.
>>>> Didn't give it any attention then as it's "just a beta".
>>>> Would be nice if anyone have any clues to the reason.
>>>>
>>>> /David a.k.a Alagazam
>>>>
>>> Any of the other Windows devs seen this? If not, could it be a
>>> difference in compiler or OS, or different set of dependencies?
>>>
>>> Any idea what could be the cause, and what to do about it?
>>>
>>> FYI, I used these dependencies:
>>> Httpd 2.2.19
>>> Apr 1.4.5 (as included with httpd)
>>> Apr-Util 1.3.12 (as included with httpd)
>>> Apr-Iconv 1.2.1 (as included with httpd)
>>> Neon 0.29.6
>>> OpenSSL 1.0.0d
>>> Serf 1.0.0
>>> SQLite 3.7.7.1
>>> ZLib 1.2.5
>>>
>>> Build environment: Visual C++ 2008 Express on Windows XP SP3.
>>>
>> Just for the record...here is my build environment and dependencies:
>> (I've seen this on beta3,rc1 and rc2, never built trunk and previous betas)
>>
>> for beta3 and rc1:
>> APR 1.4.5
>> APR-util 1.3.12
>> APR-Iconv 1.2.1
>> BDB 4.4.20 (4.8.30 for rc2)
>> libintl 0.14.1 (patched as supplied with svn 1.6.x dependencies)
>> Neon 0.28.3 (0.29.6 for rc2)
>> OpenSSL 0.9.8r (1.0.0d for rc2)
>> Serf 0.3.0 (1.0.0 for rc2)
>> sqlite 3.7.6.3 (3.7.7.1 for rc2)
>> zlib 1.2.5
>>
>> for rc2 I've updated these:
>> BDB 4.8.30
>> Neon 0.29.6
>> OpenSSL 1.0.0d
>> Serf 1.0.0
>> sqlite 3.7.7.1
>>
>> My build environment if WinXP SP3 fully patched, VisualStudio 6 sp 6,
>> Platform SDK Feb 2003 (latest for VS6)
> Hmm, at least we're both running WinXP SP3, so maybe that has
> something to do with it. Maybe WinXP somehow has less language / char
> encoding / ... support installed by default, which causes this to
> fail.
>
> And now the good news: I was able to make the test succeed by enabling
> "28593 (ISO 8859-3 Latin 3)" in the "Code page conversion tables" of
> the OS'es "Regional and Language Options" (see Control Panel |
> Regional and Language Options | Advanced).
>
> So in summary: this is a local failure, which can be fixed by enabling
> the right "Code page conversion table" in Windows. Nothing serious to
> worry about.
>
> Though it's still not nice that the absence of this setting causes the
> test to fail, especially because it wasn't enabled by default (at
> least on my system). Maybe someone on this list knows how to change
> the test to make it more tolerant in this regard?
>
I can confirm this solution fixes the problem.
I think the Win-developers signing the rc2 release all use Windows 7,
maybe it have more code pages installed by default.
I also took a quick look in the code and found the following
"suspicious" code in libsvn_subr\utf.c (line 303) in function
get_xlate_handle_node
#if defined(WIN32)
apr_err = svn_subr__win32_xlate_open((win32_xlate_t **)&handle,
topage, frompage, pool);
#else
apr_err = apr_xlate_open(&handle, topage, frompage, pool);
#endif
Why is Windows not using apr_iconv (if available) for this conversion?
(something "ivan" introduced in r865724)
I will try changing this and see if solves the problem.
/David
Received on 2011-09-12 22:56:37 CEST