Re: Problems with case folding of UTF-8

[Stig Venaas <Stig@OpenLDAP.org>]

On Mon, Dec 10, 2001 at 10:05:57AM +0100, Pierangelo Masarati wrote:
> Hi,
> 
> while dealing with DN normalization I had a serious problem.  I was 
> dealing with Italian accents in Latin-1 ("e acute", "e grave" and so),
> and this is what happened:

I think the behavior is correct, but I need to do some checking before
I can give you a definite answer. Hopefully I'm able to do that in 8-9
days. If you feel like it you can look at the Unicode tables yourself.
Look at UnicodeData.txt in HEAD. The format is explained at the
Unicode consortium web.

> b) breaks the current DN normalization workaround in slapd because 
> the resulting normalized DN is longer than the input one (a six-char 
> '\c3\89' is turned into a seven-char 'E\cc\81' when there's an 
> equivalent six-char representation)

Yes, there can be multiple equivalent representations, and the
normalized representation is often not the shortest one, so we
have to allow for the strong to grow, which means that you need
to do new allocation for the normalized string. UTF8Normalize or
whatever I called it, does this.

Stig