Tcl Source Code

On a Linux/glibc system, I have two French locales:
$ LC_ALL=fr_FR.UTF-8 locale charmap
UTF-8
$ LC_ALL=fr_FR.ISO-8859-1 locale charmap
ISO-8859-1

('locale charmap' is the command-line equivalent of nl_langinfo(CODESET).)

In Tcl, [encoding system] should be set to an equivalent value, otherwise
strings with non-ASCII characters are printed incorrectly to standard output.

This works in Tcl 8.6:

$ LC_ALL=fr_FR.UTF-8 tclsh8.6
% encoding system
utf-8

$ LC_ALL=fr_FR.ISO-8859-1 tclsh8.6
% encoding system
iso8859-1

But it does not work for the ISO-8859-1 locale any more in Tcl 9.0 beta2:

$ LC_ALL=fr_FR.UTF-8 tclsh9.0
% encoding system
utf-8

$ LC_ALL=fr_FR.ISO-8859-1 tclsh9.0
% encoding system
utf-8

I debugged it. nl_langinfo(CODESET) comes out as "ISO-8859-1".
This string is lowercased, producing "iso-8859-1", and then a lookup in
LocaleTable is done, in function SearchKnownEncodings. The table
happens to have 174 elements, and the "iso-8859-1" is at index 80.
Due to a logic bug in function SearchKnownEncodings, this index is not found.
SearchKnownEncodings then returns NULL.

The attached patch fixes the bug. The bug is present since 2005, but
triggered on different encodings, because of the influence of the table
length and the searched entry's index.