gecko-dev/intl
Nika Layzell aef919f890 Bug 1170668 - Improve short read handling in nsConverterInputStream, r=hsivonen
This patch changes how nsConverterInputStream handles passing data
through to the underlying unicode converter in order to make it more
reliably handle propagating errors and deal with short reads from the
underlying input stream.

This was done by making the code continuously read within the Fill
method until at least one character has been decoded from the input
stream, so that we don't spuriously communicate an EOF to the caller due
to a short read not producing enough bytes for the decoder to produce a
UTF-16 character.

In addition, while making this change it became easier to signal to
the decoder about the final read from the input stream, meaning that
partial characters at the end of the stream will now generate a
replacement character, rather than being ignored.

Differential Revision: https://phabricator.services.mozilla.com/D152682
2022-08-11 17:37:20 +00:00
..
benchmarks Bug 1782008 - Remove now unnecessary .eslintrc.js files. r=webcompat-reviewers,extension-reviewers,media-playback-reviewers,pip-reviewers,denschub,rpl,alwu,mossop 2022-08-03 11:16:20 +00:00
build Bug 1686616 - register all Services.py services with components.conf. r=kmag,necko-reviewers,valentin 2021-02-18 13:26:28 +00:00
components Bug 1767961 - Part 4: Make TryCreateFromSkeleton a private method. r=platform-i18n-reviewers,dminor 2022-05-05 15:00:35 +00:00
docs Bug 1753413 - fx doc: Remove whitespaces, trailing lines & windows CR r=andi,perftest-reviewers,sparky 2022-02-03 18:34:58 +00:00
encoding_glue Bug 1701828 - meta charset rewrite. r=smaug 2021-12-08 11:34:20 +00:00
gtest Bug 1603127 - Replaced mozilla::Tuple with std::tuple and applied structured bindings in mozilla/Encoding.h. r=hsivonen 2021-11-08 08:14:00 +00:00
hyphenation Bug 1738401 - Remove -Wno-shadow warning suppressions. r=firefox-build-system-reviewers,glandium 2021-12-01 06:40:04 +00:00
icu Bug 1766220: Backport ICU-21994 to fix a potential heap buffer overflow. r=platform-i18n-reviewers,dminor 2022-04-25 16:34:42 +00:00
icu-patches Bug 1766220: Backport ICU-21994 to fix a potential heap buffer overflow. r=platform-i18n-reviewers,dminor 2022-04-25 16:34:42 +00:00
l10n Bug 1782008 - Remove now unnecessary .eslintrc.js files. r=webcompat-reviewers,extension-reviewers,media-playback-reviewers,pip-reviewers,denschub,rpl,alwu,mossop 2022-08-03 11:16:20 +00:00
locale Bug 1772006 - Part 5: Simplify and move the string searching APIs from ns[T]StringObsolete, r=xpcom-reviewers,necko-reviewers,eeejay,dragana,barret 2022-07-30 00:12:48 +00:00
locales Bug 1240277 - Add hyphenation patterns for Indic languages. r=platform-i18n-reviewers,dminor 2021-12-13 14:20:06 +00:00
lwbrk Bug 1774865 - extra cleanup mozglue, security, intl and netwerk includes r=sylvestre 2022-06-22 09:51:52 +00:00
strres Bug 1772006 - Part 4: Simplify and move the string comparison APIs from ns[T]StringObsolete, r=xpcom-reviewers,necko-reviewers,dragana,barret 2022-07-30 00:12:48 +00:00
tzdata Bug 1763783 - Part 3: Update time zone data to tzdata2022a. r=platform-i18n-reviewers,jfkthame 2022-04-10 09:18:03 +00:00
uconv Bug 1170668 - Improve short read handling in nsConverterInputStream, r=hsivonen 2022-08-11 17:37:20 +00:00
unicharutil Bug 1745113 Part 5 - Make grapheme cluster break iterators implement SegmentIteratorUtf16, and adapt the callers. r=necko-reviewers,jfkthame,kershaw 2022-01-13 18:36:04 +00:00
Encoding.h Bug 1603127 - Replaced mozilla::Tuple with std::tuple and applied structured bindings in mozilla/Encoding.h. r=hsivonen 2021-11-08 08:14:00 +00:00
EncodingDetector.h Bug 1686463 - Gather telemetry about automatic encoding detection outcomes. r=chutten,emk 2021-01-24 00:11:07 +00:00
ICU4X.md Bug 1736907 - Add a build flag to experimentally build with ICU4X static data; r=platform-i18n-reviewers,dminor 2021-11-16 15:09:09 +00:00
icu_sources_data.py Bug 1686052 - Part 2: Update ICU build script to use new "sources.txt" file. r=jwalden 2021-06-04 17:42:09 +00:00
moz.build Bug 1713627 - Remove code obsoleted by the replacing the Text Encoding menu with one item. r=jaws,emk 2021-06-21 12:09:01 +00:00
update-icu.sh Bug 1766220: Backport ICU-21994 to fix a potential heap buffer overflow. r=platform-i18n-reviewers,dminor 2022-04-25 16:34:42 +00:00
update-icu4x.sh Bug 1736907 - Add a build flag to experimentally build with ICU4X static data; r=platform-i18n-reviewers,dminor 2021-11-16 15:09:09 +00:00
update-tzdata.sh