Re: Subversion binary file detection is look like broken

On Fri, Oct 03, 2014 at 11:26:32AM +0400, Navrotskiy Artem wrote:
> Hello,
>
>
>
> Subversion console client try to detect binary file with algorythm:
>
> 1. File is NOT BINARY if it contains only BOM UTF-8 signature (why not
> check as first N bytes is corret UTF-8?);
> 2. File is BINARY if first 1024 bytes contains ZERO byte (uniform
> distribution of bytes takes change of absent ZERO byte: (1 - 1 /
> 256) ^ 1024 = ~1.8%);
> 3. File is BINARY if first 1024 bytes contains over 85% of characters
> not in range 0x07-0x0D, 0x20-0x7F (total we have 153 "binary"
> bytes, ~60%).
>
> This algoritm looks like broken.
>

Can you suggest a better algoritm?
Received on 2014-10-03 13:35:33 CEST