Граф коммитов

114 Коммитов

Автор SHA1 Сообщение Дата
André Bargull 7d0125b8c7 Bug 1799859: Add support for "microsecond" and "nanosecond" units. r=dminor
Steps performed:
- Add "microsecond" and "nanosecond" to "intl/icu/data_filter.json".
- Run "icu_sources_data.py" to update the ICU data file.
- Run "update-tzdata.sh" to reapply the tzdata 2022f changes.
- Add "microsecond" and "nanosecond" to "SanctionedSimpleUnitIdentifiers.yaml".
- Run "make_intl_data.py units" to regenerate additional SpiderMonkey files.

Spec PR: https://github.com/tc39/ecma402/pull/708

Differential Revision: https://phabricator.services.mozilla.com/D161676
2022-11-09 16:45:43 +00:00
Henri Sivonen 1737aa6569 Bug 1630920 - Remove the gb2312han and big5han collations. r=anba
Makes the ICU data 191 KB smaller.

Differential Revision: https://phabricator.services.mozilla.com/D160337
2022-10-28 08:44:04 +00:00
Henri Sivonen 0b6dc7aed6 Bug 1793749 - Build ICU with the implicithan collation root. r=anba
Makes ICU data 353 KB smaller.

Differential Revision: https://phabricator.services.mozilla.com/D160345
2022-10-28 08:43:58 +00:00
Sean Burke be3eb81a13 Bug 1790071 - work around ICU-22132. r=platform-i18n-reviewers,dminor
Differential Revision: https://phabricator.services.mozilla.com/D157023
2022-10-06 18:50:51 +00:00
André Bargull ee902f8f06 Bug 1766220: Backport ICU-21994 to fix a potential heap buffer overflow. r=platform-i18n-reviewers,dminor
Differential Revision: https://phabricator.services.mozilla.com/D144542
2022-04-25 16:34:42 +00:00
André Bargull d9409e29f8 Bug 1763783 - Part 2: Update in-tree ICU to release 71.1. r=platform-i18n-reviewers,jfkthame
Depends on D143273

Differential Revision: https://phabricator.services.mozilla.com/D143275
2022-04-10 09:17:54 +00:00
André Bargull 2e3c881a95 Bug 1738422 - Part 9: Add a separate UNumberFormatFields constant for the approximately sign. r=platform-i18n-reviewers,dminor
Our previous heuristic no longer works, so we now have to patch ICU directly to
support detecting the approximately sign.

Depends on D129930

Differential Revision: https://phabricator.services.mozilla.com/D129931
2021-11-16 17:02:57 +00:00
André Bargull d814742408 Bug 1738422 - Part 2: Update in-tree ICU to release 70.1. r=platform-i18n-reviewers,dminor
Update to ICU 70.1 by running "update-icu.sh" with "maint/maint-70" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D129924
2021-11-16 17:02:38 +00:00
André Bargull cbc4b735a9 Bug 1648137 - Part 16: Allow to format non-decimal number strings. r=platform-i18n-reviewers,dminor
Remove this Java compatibility restriction to be able to format ranges starting
resp. ending at infinity.

Differential Revision: https://phabricator.services.mozilla.com/D119756
2021-08-24 09:34:51 +00:00
André Bargull adf02e643c Bug 1648137 - Part 4: Fully clear the decimal quantity before assigning a new value. r=platform-i18n-reviewers,dminor
Differential Revision: https://phabricator.services.mozilla.com/D119744
2021-08-24 09:34:47 +00:00
André Bargull b0a94f02a6 Bug 1685075 - Part 2: Remove "en-US-posix" locale from ICU data file. r=zbraniecki
The filter file doesn't support exclusion lists for the "locales" filter type
(<https://github.com/unicode-org/icu/blob/main/docs/userguide/icu_data/buildtool.md#filtering-by-locale>),
therefore we have to manually exclude "en-US-posix" from the relevant resource
types: "en-US-posix" data is only present for collation, locales, and break
iteration. Break iteration is already completely stripped from the data file,
so we don't need to change anything on that front.

The string must be "en_US_POSIX" to match the resource file name, also see
<https://unicode-org.atlassian.net/browse/ICU-21400>.

Depends on D117975

Differential Revision: https://phabricator.services.mozilla.com/D117976
2021-06-18 09:22:06 +00:00
André Bargull 8b1839ebe0 Bug 1685075 - Part 1: Replace black/white-list in ICU data filter file. r=zbraniecki
Replace "whitelist" and "blacklist" with "includelist" resp. "excludelist", because
the latter is now the preferred name in ICU and the ICU docs/examples are all using
the new names.

Differential Revision: https://phabricator.services.mozilla.com/D117975
2021-06-18 09:22:06 +00:00
André Bargull 3fe14705b6 Bug 1697729: Re-add alias and parent links in ICU filters. r=tcampbell
The `-/*` filter also removes the alias (`%%ALIAS`) and parent locale (`%%Parent`)
links, so we have to manually add them back when we're using `-/*`.

The ICU docs warn about this issue, but unfortunately that warning wasn't
present when we originally created our filter file, so this bug went unnoticed
for a long time.

Differential Revision: https://phabricator.services.mozilla.com/D116981
2021-06-16 06:49:45 +00:00
André Bargull e3d2b6377c Bug 1714933 - Part 2: Update in-tree ICU to release 69.1. r=tcampbell
Update to ICU 69.1 by running "update-icu.sh" with "maint/maint-69" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D116968
2021-06-15 07:53:58 +00:00
Noemi Erli ce2801c88f Backed out 8 changesets (bug 1714933) for causing build bustages in 1659595.js CLOSED TREE
Backed out changeset 2f72875b300f (bug 1714933)
Backed out changeset a42831b46643 (bug 1714933)
Backed out changeset c7ccabae5816 (bug 1714933)
Backed out changeset a4f4e4026174 (bug 1714933)
Backed out changeset fca960ad267b (bug 1714933)
Backed out changeset 62bdba475376 (bug 1714933)
Backed out changeset f168a2d1d391 (bug 1714933)
Backed out changeset 85af7c63b9c5 (bug 1714933)
2021-06-14 23:47:43 +03:00
André Bargull 0b804a59a3 Bug 1714933 - Part 2: Update in-tree ICU to release 69.1. r=tcampbell
Update to ICU 69.1 by running "update-icu.sh" with "maint/maint-69" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D116968
2021-06-14 19:46:50 +00:00
Butkovits Atila c9d6eddfc2 Backed out 7 changesets (bug 1714933) for causing failures on test_ManifestProcessor_lang.html
Backed out changeset 2b4a65b9c1ac (bug 1714933)
Backed out changeset 40c329123b7c (bug 1714933)
Backed out changeset 692101de3873 (bug 1714933)
Backed out changeset 695f3bd8e875 (bug 1714933)
Backed out changeset 30e9aacecf56 (bug 1714933)
Backed out changeset e9f2a0d262c2 (bug 1714933)
Backed out changeset 3de963fab6d6 (bug 1714933)
2021-06-14 19:46:45 +03:00
André Bargull d165d44525 Bug 1714933 - Part 2: Update in-tree ICU to release 69.1. r=tcampbell
Update to ICU 69.1 by running "update-icu.sh" with "maint/maint-69" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D116968
2021-06-14 13:12:59 +00:00
André Bargull 50a541b708 Bug 1686052 - Part 3: Update in-tree ICU to release 68.2. r=jwalden
Update to ICU 68.2 by running "update-icu.sh" with "maint/maint-68" as the target.

Differential Revision: https://phabricator.services.mozilla.com/D101389
2021-06-04 17:42:10 +00:00
André Bargull 3d58656e00 Bug 1693575 - Part 3: Implement support for "calendar" option. r=tcampbell
This last part to support "calendar" requires a bit more code.

`GetCalendarDisplayName()` performs the following steps:
1. Validate the input matches the `type` nonterminal, per
   CanonicalCodeForDisplayNames, step 4.a.
2. Then convert it to lower case, because ICU expects lower case names and it
   needs to be in lower case for `LanguageTag::replaceUnicodeExtensionType()`.
3. Replace calendar name aliases with the preferred name, e.g. use "ethioaa"
   instead of "ethiopic-amete-alem".
4. Check the input isn't too large, just in case ICU somehow doesn't properly
   handle large string inputs.
5. Retrieve the old-style value of the calendar name, for example "gregorian"
   for the calendar name "gregory".
6. And finally call `uldn_keyValueDisplayName` to search for the localised name.

Our ICU data file doesn't yet include calendar names. To include calendar names
we need to enable them in "data_filter.json", rebuild the ICU data file, and
then reapply the update for tzdata 2021a. (Reapplying the tzdata changed
"intl/tzdata/GIT-INFO", but otherwise didn't change any time zone files.)

Adding the calendar names to the ICU data file results in a slight increase of
the overall data file size (79,184 bytes).

The existing "calendar.js" test file was renamed to "month-calendar.js", so
the test file for the new "calendar" type can be named "calendar.js".

Differential Revision: https://phabricator.services.mozilla.com/D116008
2021-06-01 07:45:44 +00:00
Chris Fallin 9e6185bf59 Bug 1706949 part 13 - Fix icu and intl for wasi. r=anba,glandium
Differential Revision: https://phabricator.services.mozilla.com/D113218
2021-05-26 06:44:09 +00:00
Axel Hecht 915204d819 Bug 1649441, remove icu/README.md now that it is in docs, r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D82984
2020-07-09 20:38:57 +00:00
André Bargull 4d1d96c31a Bug 1534160 - Part 2: Cherry-pick patch for Android time zone detection. r=jwalden
Cherry-pick the commit from <https://github.com/unicode-org/icu/pull/605>.

Depends on D82545

Differential Revision: https://phabricator.services.mozilla.com/D82546
2020-07-09 09:52:26 +00:00
André Bargull dc07d1aa1e Bug 1534160 - Part 1: Re-run ICU updater to pick up latest changes to ICU 67 maintenance branch. r=jwalden
The change itself isn't important for us, because we don't use ICU's make-files,
but avoids confusion why additional changes were applied when running the update
script.

Differential Revision: https://phabricator.services.mozilla.com/D82545
2020-07-07 21:05:03 +00:00
Axel Hecht ac4d08312c Bug 1614941, add more date formats to dsb and hsb, r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D62732
2020-07-07 11:46:05 +00:00
Ricky Stewart 0ba6a8762d Bug 1645779 - Make icu_sources_data.py Python 3-compliant r=jwalden,anba
This removes a dependency on `pymake`, which is Python 2-only, and thoroughly unnecessary since we just use it to find assignments of the form `OBJECTS = ...`. We can replicate this logic by just isolating lines that begin with that literal string, and everything else can stay the same. This is definitionally more brittle than actually using a parser, but it works fine for now, and the original implementation wasn't significantly better (it didn't handle any form of dynamism, anything more complicated than a single unconditional assignment with a space-separated list of literal strings representing outputs, etc.)

Differential Revision: https://phabricator.services.mozilla.com/D79896
2020-06-18 21:01:49 +00:00
Sylvestre Ledru 4b7c742212 Bug 1646405 - update the code using pyyaml to use the new path r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D80025
2020-06-18 19:40:28 +00:00
André Bargull 3a33d76bdf Bug 1642934: Automatically determine current CLDR version when updating langtags. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D78021
2020-06-12 11:19:50 +00:00
André Bargull 3d23887ba7 Bug 1636984 - Part 2: Reimport ICU to generate the data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D74682
2020-06-12 12:50:04 +00:00
Jeff Walden 5104a36433 Bug 1642505 - Add an ICU README file describing what ICU does, how to use it, and how to use and update Gecko's imported copy of it. r=anba
Differential Revision: https://phabricator.services.mozilla.com/D77719
2020-06-03 17:49:26 +00:00
André Bargull b029ce9ac8 Bug 1557727 - Part 1: Add resources for Intl.DisplayNames to ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D52163
2020-05-19 11:17:21 +00:00
André Bargull 57a5eb29e7 Bug 1632434 - Part 1: Update in-tree ICU to release 67.1. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D72908
2020-04-29 23:47:31 +00:00
André Bargull 5020091e8c Bug 1610512 - Part 1: Update in-tree ICU to release 66.1. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D66555

--HG--
extra : moz-landing-system : lando
2020-03-19 01:09:56 +00:00
Andreea Pavel 0618bdbfe4 Backed out changeset f34592b66d45 undo typo on a CLOSED TREE 2020-01-06 14:35:59 +02:00
Andreea Pavel e830f0abe2 No bug - fix typo to have a commit to triggering commit ingestion again. CLOSED TREE 2020-01-06 14:16:53 +02:00
André Bargull e96ab7f00d Bug 1583269 - Part 2: Update in-tree ICU to release 65.1. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D49443

--HG--
rename : intl/icu/source/i18n/numparse_stringsegment.cpp => intl/icu/source/i18n/string_segment.cpp
rename : intl/icu/source/data/buildtool/__init__.py => intl/icu/source/python/icutools/databuilder/__init__.py
rename : intl/icu/source/data/buildtool/comment_stripper.py => intl/icu/source/python/icutools/databuilder/comment_stripper.py
rename : intl/icu/source/data/buildtool/locale_dependencies.py => intl/icu/source/python/icutools/databuilder/locale_dependencies.py
rename : intl/icu/source/data/buildtool/renderers/__init__.py => intl/icu/source/python/icutools/databuilder/renderers/__init__.py
rename : intl/icu/source/data/buildtool/renderers/makefile.py => intl/icu/source/python/icutools/databuilder/renderers/makefile.py
rename : intl/icu/source/data/buildtool/test/__init__.py => intl/icu/source/python/icutools/databuilder/test/__init__.py
rename : intl/icu/source/data/buildtool/test/__main__.py => intl/icu/source/python/icutools/databuilder/test/__main__.py
rename : intl/icu/source/data/buildtool/test/filtration_test.py => intl/icu/source/python/icutools/databuilder/test/filtration_test.py
extra : moz-landing-system : lando
2019-10-19 01:25:24 +00:00
André Bargull d31b7c3f20 Bug 1569567 - Part 7: Remove currency codes and gender lists from ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D39670

--HG--
extra : moz-landing-system : lando
2019-07-30 08:03:11 +00:00
André Bargull 4bfe032920 Bug 1569567 - Part 6: Remove unused "locales" values from ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D39669

--HG--
extra : moz-landing-system : lando
2019-07-30 08:01:21 +00:00
André Bargull 749ffe624f Bug 1569567 - Part 5: Remove "Sequence" collation values from ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D39668

--HG--
extra : moz-landing-system : lando
2019-07-30 07:59:27 +00:00
André Bargull 6ce8fbc4fa Bug 1569567 - Part 4: Remove "UCARules" collation values from ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D39667

--HG--
extra : moz-landing-system : lando
2019-07-30 07:57:28 +00:00
André Bargull 748f4f0bc3 Bug 1569567 - Part 3: Remove "variant" and "formal" currency values from ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D39666

--HG--
extra : moz-landing-system : lando
2019-07-30 07:55:21 +00:00
André Bargull 68cf5e5a7e Bug 1569567 - Part 2: Remove "Version" info from ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D39665

--HG--
extra : moz-landing-system : lando
2019-07-30 07:53:14 +00:00
André Bargull fe20e01eb1 Bug 1569567 - Part 1: Exclude additional resource files currently not needed. r=jwalden
"confusables" feature:
- Used in 'unicode/uspoof.h' for spoofing detection.

"stringprep" feature:
- Used in 'unicode/usprep.h' for RFC 3454 string preparation.

"unames" feature:
- Used in 'unicode/uchar.h' for `u_charName` to retrieve the name of a Unicode character.

Differential Revision: https://phabricator.services.mozilla.com/D39664

--HG--
extra : moz-landing-system : lando
2019-07-30 07:51:11 +00:00
André Bargull 958926a675 Bug 1433303 - Part 2: Add Intl.Locale minimize() and maximize() functions. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D38875

--HG--
extra : moz-landing-system : lando
2019-07-29 09:26:55 +00:00
André Bargull 677e918830 Bug 1566410 - Part 6: Add units to ICU data file. r=jwalden
Differential Revision: https://phabricator.services.mozilla.com/D38334

--HG--
extra : moz-landing-system : lando
2019-07-24 10:31:43 +00:00
André Bargull 609b56f708 Bug 1543642 - Part 2: Update in-tree ICU to release 64.2. r=jwalden
--HG--
extra : amend_source : e10719d9ef0593b38840e044b87ada042d499e01
2019-04-23 07:45:23 -07:00
André Bargull 868d7f1acd Bug 1543644: Include RBNF data for Japanese to support Gannen year representation. r=jwalden
ICU changes the numbering system of date formats which include an era marker
to "jpanyear". "jpanyear" is a rule-based numbering system and therefore the
RBNF data for the Japanese locale now need to be included.

Differential Revision: https://phabricator.services.mozilla.com/D27340

--HG--
extra : moz-landing-system : lando
2019-04-26 20:55:35 +00:00
André Bargull 16d9e7dfcd Bug 1533481 - Part 5: Update in-tree ICU to release 64.1. r=jwalden!
--HG--
extra : rebase_source : 9dfdf09968fb65ba1288b5d79d8dd238c270e34f
2019-03-28 07:29:13 -07:00
André Bargull a6b52311ad Bug 1533481 - Part 4: Prepare update to ICU 64. r=jwalden!
Summary:

- ICU no longer supports removing resource files manually, instead the new data
  filter builder needs to be used.
- This includes test data, which also must be preserved in ICU 64.
- umutex.h contains an implicit call to `new` in ICU64 which needs to be allowed
  in check_vanilla_allocations.py.
- Drive-by: Make ICU with multiple jobs for faster rebuilds.

Reviewers: jwalden

Reviewed By: jwalden

Bug #: 1533481

Differential Revision: https://phabricator.services.mozilla.com/D25264

--HG--
extra : rebase_source : 9fde775ee9b189c84a29f69f11ebd955f0030b38
2019-04-04 11:52:54 +03:00
André Bargull 7f8b902c81 Bug 1513934 - Import ICU patch to fix possible time zone misdetection on Windows 7. r=Waldo
--HG--
extra : amend_source : 9b0b4e865d1195b7124f74ea096d904a31b0cd71
2018-12-14 05:48:46 -08:00