svn commit: r341630 - in stable/11: share/ctypedef tools/tools/locale tools/tools/locale/etc
Yuri Pankov
yuripv at FreeBSD.org
Thu Dec 6 11:49:54 UTC 2018
Author: yuripv
Date: Thu Dec 6 11:49:52 2018
New Revision: 341630
URL: https://svnweb.freebsd.org/changeset/base/341630
Log:
MFC r339311, r339313:
Restore some of the ctype definitions reported in the PR from pre-CLDR
data, namely 0xE000-0xF8FF private use area, and 0xFF00-0xFFF half- and
fullwidth punctuation.
While here, update tools/tools/locale/README based on my experience
rebuilding the locale data.
PR: 225692
Reviewed by: bapt, cem (previous version)
Differential Revision: https://reviews.freebsd.org/D17471
Modified:
stable/11/share/ctypedef/en_US.UTF-8.src
stable/11/tools/tools/locale/README
stable/11/tools/tools/locale/etc/common.UTF-8.src
stable/11/tools/tools/locale/etc/manual-input.UTF-8 (contents, props changed)
Directory Properties:
stable/11/ (props changed)
Modified: stable/11/share/ctypedef/en_US.UTF-8.src
==============================================================================
--- stable/11/share/ctypedef/en_US.UTF-8.src Thu Dec 6 10:53:11 2018 (r341629)
+++ stable/11/share/ctypedef/en_US.UTF-8.src Thu Dec 6 11:49:52 2018 (r341630)
@@ -6241,6 +6241,12 @@ graph <MEETEI_MAYEK_LETTER_KOK>;...;<MEETEI_MAYEK_APUN
digit <MEETEI_MAYEK_DIGIT_ZERO>;...;<MEETEI_MAYEK_DIGIT_NINE>
**********************************************************************
+* 0xE000 - 0xF8FF Private Use Area (from pre-CLDR data)
+**********************************************************************
+
+graph <PRIVATE_USE_AREA-E000>;...;<PRIVATE_USE_AREA-F8FF>
+
+**********************************************************************
* 0xFB50 - 0xFDFF Arabic Presentation Forms (differential)
**********************************************************************
@@ -6277,6 +6283,17 @@ punct <SMALL_COMMA>;...;<SMALL_COMMERCIAL_AT>
**********************************************************************
blank <ZERO_WIDTH_NO-BREAK_SPACE>
+
+**********************************************************************
+* 0xFF00 - 0xFFFF Half- and Fullwidth Punctuation (from pre-CLDR data)
+**********************************************************************
+
+punct <FULLWIDTH_EXCLAMATION_MARK>;...;<FULLWIDTH_SOLIDUS>;/
+ <FULLWIDTH_COLON>;...;<FULLWIDTH_COMMERCIAL_AT>;/
+ <FULLWIDTH_LEFT_SQUARE_BRACKET>;...;<FULLWIDTH_GRAVE_ACCENT>;/
+ <FULLWIDTH_LEFT_CURLY_BRACKET>;...;<HALFWIDTH_KATAKANA_MIDDLE_DOT>;/
+ <FULLWIDTH_CENT_SIGN>;...;<FULLWIDTH_WON_SIGN>;/
+ <HALFWIDTH_FORMS_LIGHT_VERTICAL>;...;<HALFWIDTH_WHITE_CIRCLE>
**********************************************************************
* 0x10300 - 0x1032F Old Italic
Modified: stable/11/tools/tools/locale/README
==============================================================================
--- stable/11/tools/tools/locale/README Thu Dec 6 10:53:11 2018 (r341629)
+++ stable/11/tools/tools/locale/README Thu Dec 6 11:49:52 2018 (r341630)
@@ -2,17 +2,37 @@
To generate the locales:
-Tools needed: java, perl and devel/p5-Tie-IxHash
+Tools needed:
+ java (openjdk >= 8)
+ perl
+ converters/p5-Text-Iconv
+ devel/p5-Tie-IxHash
+ textproc/p5-XML-Parser
-fetch cldr data from: http://cldr.unicode.org
-extract in a directory ~/unicode/cldr/v27.0.1 for example
-fetch unidata from http://www.unicode.org/Public/zipped/ (latest version)
-extract in a directory ~/unicode/UNIDATA/8.0.0 for example
+Fetch CLDR data from: http://unicode.org/Public/cldr/. You need all of the
+core.zip, keyboards.zip, and tools.zip.
-either modify tools/tools/locales/etc/unicode.conf or export variables:
-CLDRDIR="~/unicode/cldr/v27.0.1"
-UNIDATADIR="~/unicode/UNIDATA/8.0.0"
+Extract:
+ mkdir -p ~/unicode/cldr/v33.0
+ cd ~/unicode/cldr/v33.0
+ unzip ~/core.zip ~/keyboards.zip ~/tools.zip
-run:
-make POSIX
-make install
+Fetch unidata (UCD.zip) from http://www.unicode.org/Public/zipped/latest.
+
+Extract:
+ mkdir -p ~/unicode/UNIDATA/11.0.0
+ cd ~/unicode/UNIDATA/11.0.0
+ unzip ~/UCD.zip
+
+Either modify tools/tools/locales/etc/unicode.conf or export variables:
+ CLDRDIR=~/unicode/cldr/v33.0; export CLDRDIR
+ UNIDATADIR=~/unicode/UNIDATA/9.0.0; export UNIDATADIR
+
+Build the CLDR tools:
+ cd $CLDRDIR/tools/java
+ ant jar
+
+Run:
+ make POSIX
+ make
+ make install
Modified: stable/11/tools/tools/locale/etc/common.UTF-8.src
==============================================================================
--- stable/11/tools/tools/locale/etc/common.UTF-8.src Thu Dec 6 10:53:11 2018 (r341629)
+++ stable/11/tools/tools/locale/etc/common.UTF-8.src Thu Dec 6 11:49:52 2018 (r341630)
@@ -6241,6 +6241,12 @@ graph <MEETEI_MAYEK_LETTER_KOK>;...;<MEETEI_MAYEK_APUN
digit <MEETEI_MAYEK_DIGIT_ZERO>;...;<MEETEI_MAYEK_DIGIT_NINE>
**********************************************************************
+* 0xE000 - 0xF8FF Private Use Area (from pre-CLDR data)
+**********************************************************************
+
+graph <PRIVATE_USE_AREA-E000>;...;<PRIVATE_USE_AREA-F8FF>
+
+**********************************************************************
* 0xFB50 - 0xFDFF Arabic Presentation Forms (differential)
**********************************************************************
@@ -6277,6 +6283,17 @@ punct <SMALL_COMMA>;...;<SMALL_COMMERCIAL_AT>
**********************************************************************
blank <ZERO_WIDTH_NO-BREAK_SPACE>
+
+**********************************************************************
+* 0xFF00 - 0xFFFF Half- and Fullwidth Punctuation (from pre-CLDR data)
+**********************************************************************
+
+punct <FULLWIDTH_EXCLAMATION_MARK>;...;<FULLWIDTH_SOLIDUS>;/
+ <FULLWIDTH_COLON>;...;<FULLWIDTH_COMMERCIAL_AT>;/
+ <FULLWIDTH_LEFT_SQUARE_BRACKET>;...;<FULLWIDTH_GRAVE_ACCENT>;/
+ <FULLWIDTH_LEFT_CURLY_BRACKET>;...;<HALFWIDTH_KATAKANA_MIDDLE_DOT>;/
+ <FULLWIDTH_CENT_SIGN>;...;<FULLWIDTH_WON_SIGN>;/
+ <HALFWIDTH_FORMS_LIGHT_VERTICAL>;...;<HALFWIDTH_WHITE_CIRCLE>
**********************************************************************
* 0x10300 - 0x1032F Old Italic
Modified: stable/11/tools/tools/locale/etc/manual-input.UTF-8
==============================================================================
--- stable/11/tools/tools/locale/etc/manual-input.UTF-8 Thu Dec 6 10:53:11 2018 (r341629)
+++ stable/11/tools/tools/locale/etc/manual-input.UTF-8 Thu Dec 6 11:49:52 2018 (r341630)
@@ -877,6 +877,12 @@ graph <MEETEI_MAYEK_LETTER_KOK>;...;<MEETEI_MAYEK_APUN
digit <MEETEI_MAYEK_DIGIT_ZERO>;...;<MEETEI_MAYEK_DIGIT_NINE>
**********************************************************************
+* 0xE000 - 0xF8FF Private Use Area (from pre-CLDR data)
+**********************************************************************
+
+graph <PRIVATE_USE_AREA-E000>;...;<PRIVATE_USE_AREA-F8FF>
+
+**********************************************************************
* 0xFB50 - 0xFDFF Arabic Presentation Forms (differential)
**********************************************************************
@@ -913,6 +919,17 @@ punct <SMALL_COMMA>;...;<SMALL_COMMERCIAL_AT>
**********************************************************************
blank <ZERO_WIDTH_NO-BREAK_SPACE>
+
+**********************************************************************
+* 0xFF00 - 0xFFFF Half- and Fullwidth Punctuation (from pre-CLDR data)
+**********************************************************************
+
+punct <FULLWIDTH_EXCLAMATION_MARK>;...;<FULLWIDTH_SOLIDUS>;/
+ <FULLWIDTH_COLON>;...;<FULLWIDTH_COMMERCIAL_AT>;/
+ <FULLWIDTH_LEFT_SQUARE_BRACKET>;...;<FULLWIDTH_GRAVE_ACCENT>;/
+ <FULLWIDTH_LEFT_CURLY_BRACKET>;...;<HALFWIDTH_KATAKANA_MIDDLE_DOT>;/
+ <FULLWIDTH_CENT_SIGN>;...;<FULLWIDTH_WON_SIGN>;/
+ <HALFWIDTH_FORMS_LIGHT_VERTICAL>;...;<HALFWIDTH_WHITE_CIRCLE>
**********************************************************************
* 0x10300 - 0x1032F Old Italic
More information about the svn-src-stable
mailing list