Unicode-based FreeBSD
Tim Kientzle
kientzle at freebsd.org
Tue Aug 26 05:03:15 UTC 2008
> Going to UTF-8 might fix some of the character issues
> but we would be in the same shoes when it comes to characters
> which are in -16 and -32 but not in -8.
You need to read the Unicode/ISO10646 standards again;
you do not understand them.
There are no characters in UTF-32 that are not in UTF-8.
UTF-32, UTF-16, and UTF-8 all use exactly the same characters.
UTF-8 encodes Unicode characters from U+000000 to U+10FFFF, using 1 to 4
bytes per character.
UTF-16 encodes Unicode characters from U+000000 to U+10FFFF, using 2 to
4 bytes per character.
UTF-32 encodes Unicode characters from U+000000 to U+10FFFF, using 4
bytes per character.
Practically speaking, UTF-8 is a bit more convenient for file
storage and transmission (including terminal support), UTF-16
or UTF-32 can be slightly more convenient for internal
string manipulation. But all three encodings use exactly
the same characters.
Tim Kientzle
More information about the freebsd-current
mailing list