Граф коммитов

5918 Коммитов

Автор SHA1 Сообщение Дата
Dorel Luca 58186c88dc Backed out 8 changesets (bug 1620621) for XPCshell failures in xpcshell/rs-blocklist/test_blocklist_mlbf_fetch.js
Backed out changeset 06fccc75c09e (bug 1620621)
Backed out changeset 8b4e286967c0 (bug 1620621)
Backed out changeset cfde27a748fd (bug 1620621)
Backed out changeset 7abf836343be (bug 1620621)
Backed out changeset 1a28d1de8f76 (bug 1620621)
Backed out changeset 90c08438be0a (bug 1620621)
Backed out changeset 723a3b4e7bbf (bug 1620621)
Backed out changeset bbc991f09d5d (bug 1620621)
2020-04-30 05:44:28 +03:00
Rob Wu cca5bab1f4 Bug 1620621 - Temporarily disable 2 RemoteSettings tests r=glasserc
These two tests use the Kinto client to access the RemoteSettings
database. However, due to the database version bump from D72416,
the kinto client is no longer compatible with the RemoteSettings
database.

This will be fixed in bug 1634203.

Differential Revision: https://phabricator.services.mozilla.com/D73160
2020-04-30 00:34:54 +00:00
Rob Wu 8962b5b5c1 Bug 1620621 - Add initial dump of addons blocklist r=Gijs
The MLBF (addons-mlbf.bin) itself is 64 KB.
Together with the metadata, this is 65 KB.
In contrast, the current JSON-based dump (addons.json) is 913 KB.

Differential Revision: https://phabricator.services.mozilla.com/D73159
2020-04-30 00:34:54 +00:00
Rob Wu 2f5a6bf9d0 Bug 1620621 - Add support for fallback to dumps for attachments r=Gijs,leplatrem
With this piece, it is now possible for RemoteSettings clients to always
have a valid attachment.

This adds the client APIs that could support bug 1542177.

Differential Revision: https://phabricator.services.mozilla.com/D72417
2020-04-29 23:08:08 +00:00
Rob Wu 3c1bafb9ac Bug 1620621 - Add caching and recovery mechanisms to RemoteSettings's download() method r=Gijs,leplatrem
The current RemoteSettings API has two methods for downloading:

- `download(record)` to download an attachment to disk, with a filename
  given by the record. The file is read and returned before downloading.
  A new download attempt overwrites the file, with no recovery mechanism
  if the download fails.
- `downloadAsBytes(record)` to download an attachment in memory.

The `download` method does have a cache, but it is only useful for
reducing bandwidth usage, not for availability of data. Moreover, if its
associated record is removed from the collection, then callers do not
have a way to delete the file since its identifier (filename) originates
from the record.

The `downloadAsBytes` method does not have this file tracking issue
since it does not persist the data, but it forces callers to implement
their own attachment storing mechanism.

This commit adds the `useCache` option to the `download()` method to
enable callers to use an IndexedDB-based cache instead of the
filesystem. The following options unlock significant features:

- `fallbackToCache` - If the requested attachment is not available, the
  last known attachment is returned.
- `fallbackToDump` - If the requested attachment is not available, nor
  cached, then the attachment (dump) that is packaged with the client is
  returned instead. This is implemented in the next commit (D72417).

The original record is cached along with the attachment, to allow
callers to use the file (identified by the given `attachmentId`) and
its metadata, even when the original record has been removed from the
collection.

This is particularly useful for scenarios where one wants to keep a file
(and metadata) up to date via RemoteSettings, without having to develop
a separate storage and synchronization mechanism.

The deprecation of the old behavior will be handled in bug 1634127.

Differential Revision: https://phabricator.services.mozilla.com/D72416
2020-04-29 23:39:07 +00:00
Ryan Kelly 7bae4ae386 Bug 1604844 - add identifiers from the sync ping to the deletion-request ping. r=markh,chutten
Differential Revision: https://phabricator.services.mozilla.com/D72286
2020-04-29 07:47:38 +00:00
Lina Cambridge add5457732 Bug 1633943 - Support tearing down a Rust `StorageSyncArea`. r=markh
This commit wires up `StorageSyncArea::teardown()` to call the new
`webext_storage::Store::close()` method.

It also changes `teardown` to drop the `LazyStore`, and thus close its
database connection, on the main thread if dispatching to the task
queue fails. Dispatch should only fail at shutdown, and putting the
owned reference back only adds indirection, since the `StorageSyncArea`
will still drop its `LazyStore` later in shutdown.

Finally, it includes an xpcshell test fix for
https://github.com/mozilla/application-services/pull/3050.

Differential Revision: https://phabricator.services.mozilla.com/D72992
2020-04-29 04:35:45 +00:00
Vlad Filippov cf50ebbe18 Bug 1631830 - Fetch Sync tokens with OAuth behind a pref r=rfkelly
Differential Revision: https://phabricator.services.mozilla.com/D72092
2020-04-28 04:20:55 +00:00
Lina Cambridge c13f9f9d49 Bug 1626128 - Change Golden Gate to depend on `sync15_traits`. r=markh
Now that `BridgedEngine` has been moved to `sync15_traits`, we can
remove `golden_gate_traits` from the tree, and change Golden Gate to
depend on `sync15_traits` directly.

This commit also adds a Cargo feature, `services_sync`, which reflects
the `MOZ_SERVICES_SYNC` config option. In the future, we'll use this
feature to gate implementations of `mozIBridgedSyncEngine`.

Differential Revision: https://phabricator.services.mozilla.com/D72784
2020-04-28 04:13:04 +00:00
ffxbld b534feae40 No Bug, mozilla-central repo-update HSTS HPKP remote-settings tld-suffixes - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D72661
2020-04-27 14:21:26 +00:00
Mathieu Leplatre e95ee4d2f4 Bug 1620186 - Fetch from changeset endpoint r=glasserc
Differential Revision: https://phabricator.services.mozilla.com/D71570
2020-04-24 09:15:43 +00:00
Mathieu Leplatre 3c64c7a3b2 Bug 1620186 - Upgrade kinto-client to 5.1.1 r=glasserc
Differential Revision: https://phabricator.services.mozilla.com/D71569
2020-04-24 09:15:25 +00:00
Dale Harvey 4ccaa0f9aa Bug 1615060 - Add distribution engines to m-c r=Standard8,mkaply
Differential Revision: https://phabricator.services.mozilla.com/D67231
2020-04-23 21:01:10 +00:00
Gijs Kruitbosch d0edbfc642 Bug 1624301 - optimize remote settings Database list calls without filters, r=leplatrem
Differential Revision: https://phabricator.services.mozilla.com/D72137
2020-04-23 16:19:27 +00:00
Gijs Kruitbosch 9655c6cc65 Bug 1631484 - make bulk imports / deletes in remote settings faster, r=asuth,leplatrem
Differential Revision: https://phabricator.services.mozilla.com/D71588
2020-04-22 00:04:19 +00:00
ffxbld 3e98c37370 No Bug, mozilla-central repo-update HSTS HPKP remote-settings - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D71596
2020-04-20 16:44:01 +00:00
ffxbld 618ba07d34 No Bug, mozilla-central repo-update HSTS HPKP remote-settings - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D71198
2020-04-16 16:16:14 +00:00
vladikoff de2af0a87e Bug 1627856 - Dont log URIs when sync fails to fetch favicons for synced tabs r=rfkelly
Differential Revision: https://phabricator.services.mozilla.com/D70414

--HG--
extra : moz-landing-system : lando
2020-04-13 23:40:16 +00:00
jayati 4da359df42 Bug 1628729 - Remove nsIFxAccountsUIGlue. r=eoger
Differential Revision: https://phabricator.services.mozilla.com/D70427

--HG--
extra : moz-landing-system : lando
2020-04-09 19:50:54 +00:00
Lina Cambridge f9abd62b34 Bug 1596322 - Add XPCOM bindings for Rust Sync engines. r=markh,tcsc,LougeniaBailey
This commit adds a new crate for bridging Rust Sync engines to Desktop,
and a `mozIBridgedSyncEngine` for accessing the bridge via JS.
Naturally, the bridge is called Golden Gate. 😊 For more information
on how to use it, please see `golden_gate/src/lib.rs`.

Other changes include:

* Ensuring the test Sync server uses UTF-8 for requests and responses.
* Renaming `mozISyncedBookmarksMirrorLogger` to `mozIServicesLogger`,
  and moving it into the shared Sync interfaces.

The `BridgedEngine` trait lives in its own crate, called
`golden_gate_traits`, to make it easier to eventually move into a-s.
`Interruptee` and `Interrupted` already exist in a-s, and are
duplicated in this crate for now.

Differential Revision: https://phabricator.services.mozilla.com/D65268

--HG--
extra : moz-landing-system : lando
2020-04-09 15:45:37 +00:00
ffxbld c53603da3d No Bug, mozilla-central repo-update HSTS HPKP remote-settings tld-suffixes - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D70364

--HG--
extra : moz-landing-system : lando
2020-04-09 13:55:34 +00:00
Bogdan Tara 5dcf5dcc85 Backed out changeset d8ef791a2165 (bug 1596322) for browser_all_files_referenced.js failures CLOSED TREE 2020-04-09 13:17:04 +03:00
Lina Cambridge fcb1f70a45 Bug 1596322 - Add XPCOM bindings for Rust Sync engines. r=markh,tcsc,LougeniaBailey
This commit adds a new crate for bridging Rust Sync engines to Desktop,
and a `mozIBridgedSyncEngine` for accessing the bridge via JS.
Naturally, the bridge is called Golden Gate. 😊 For more information
on how to use it, please see `golden_gate/src/lib.rs`.

Other changes include:

* Ensuring the test Sync server uses UTF-8 for requests and responses.
* Renaming `mozISyncedBookmarksMirrorLogger` to `mozIServicesLogger`,
  and moving it into the shared Sync interfaces.

The `BridgedEngine` trait lives in its own crate, called
`golden_gate_traits`, to make it easier to eventually move into a-s.
`Interruptee` and `Interrupted` already exist in a-s, and are
duplicated in this crate for now.

Differential Revision: https://phabricator.services.mozilla.com/D65268

--HG--
extra : moz-landing-system : lando
2020-04-09 07:32:52 +00:00
Brindusan Cristian bb29753b0d Backed out changeset 2b02e71f1780 (bug 1596322) for multiple xpcshell failures. CLOSED TREE 2020-04-09 03:39:56 +03:00
Lina Cambridge 186b7665c4 Bug 1596322 - Add XPCOM bindings for Rust Sync engines. r=markh,tcsc,LougeniaBailey
This commit adds a new crate for bridging Rust Sync engines to Desktop,
and a `mozIBridgedSyncEngine` for accessing the bridge via JS.
Naturally, the bridge is called Golden Gate. 😊 For more information
on how to use it, please see `golden_gate/src/lib.rs`.

Other changes include:

* Ensuring the test Sync server uses UTF-8 for requests and responses.
* Renaming `mozISyncedBookmarksMirrorLogger` to `mozIServicesLogger`,
  and moving it into the shared Sync interfaces.

The `BridgedEngine` trait lives in its own crate, called
`golden_gate_traits`, to make it easier to eventually move into a-s.
`Interruptee` and `Interrupted` already exist in a-s, and are
duplicated in this crate for now.

Differential Revision: https://phabricator.services.mozilla.com/D65268

--HG--
extra : moz-landing-system : lando
2020-04-08 20:18:37 +00:00
Cosmin Sabou 84ff986617 Merge mozilla-central to autoland. CLOSED TREE 2020-04-07 00:59:27 +03:00
Ciure Andrei 7de40f8ed0 Merge autoland to mozilla-central. a=merge 2020-04-07 00:46:53 +03:00
Mozilla Releng Treescript a17ce3b6b4 Update configs. IGNORE BROKEN CHANGESETS CLOSED TREE NO BUG a=release ba=release 2020-04-06 14:28:50 +00:00
ffxbld 03d8a2f376 No Bug, mozilla-central repo-update HSTS HPKP remote-settings tld-suffixes - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D69815

--HG--
extra : moz-landing-system : lando
2020-04-06 13:52:26 +00:00
sonakshi c2aaee8a41 Bug 1584797 - Remove unused aProxyService parameter from applyFilter method r=valentin
Differential Revision: https://phabricator.services.mozilla.com/D69679

--HG--
extra : moz-landing-system : lando
2020-04-06 20:21:03 +00:00
Gijs Kruitbosch b9b9e096b9 Bug 1627179 - ensure we deal with transaction.abort() throwing r=leplatrem
Differential Revision: https://phabricator.services.mozilla.com/D69511

--HG--
extra : moz-landing-system : lando
2020-04-03 13:17:38 +00:00
Gijs Kruitbosch c8f180ee44 Bug 1624983 - follow-up: add missing Array.from call a=fix
CLOSED TREE

Differential Revision: https://phabricator.services.mozilla.com/D69440

--HG--
extra : amend_source : 2526a782e8884f6f7763ca41295323719954e1ba
2020-04-02 20:01:58 +00:00
Gijs Kruitbosch b6fedc53eb Bug 1624983 - abort pending read transactions from the DB when quitting, r=asuth,leplatrem
Differential Revision: https://phabricator.services.mozilla.com/D68465

--HG--
extra : moz-landing-system : lando
2020-04-02 14:40:33 +00:00
ffxbld 11eaff63b3 No Bug, mozilla-central repo-update HSTS HPKP remote-settings tld-suffixes - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D69379

--HG--
extra : moz-landing-system : lando
2020-04-02 14:01:33 +00:00
aarushivij 338bc99a4f Bug 1573758 - Extend TTL for syncing tabs to 1 year. r=markh
Differential Revision: https://phabricator.services.mozilla.com/D69278

--HG--
extra : moz-landing-system : lando
2020-04-02 00:25:42 +00:00
ffxbld b15d2587f4 No Bug, mozilla-central repo-update HSTS HPKP remote-settings tld-suffixes - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D68798

--HG--
extra : moz-landing-system : lando
2020-03-30 14:02:50 +00:00
Cosmin Sabou 7dc93bf032 Backed out changeset 15a52d0bf116 (bug 1624983) for bc failures on browser_RecipeRunner.js
CLOSED TREE
2020-03-27 20:09:40 +02:00
Gijs Kruitbosch 4f3914f12d Bug 1624983 - abort pending read transactions from the DB when quitting, r=asuth,leplatrem
Differential Revision: https://phabricator.services.mozilla.com/D68465

--HG--
extra : moz-landing-system : lando
2020-03-27 16:05:00 +00:00
ffxbld d1bfa2330a No Bug, mozilla-central repo-update HSTS HPKP remote-settings - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D68386

--HG--
extra : moz-landing-system : lando
2020-03-26 13:53:08 +00:00
Sam Foster 2db8ec19f5 Bug 1622514 - Move OSKeyStore.jsm into toolkit/modules. r=jaws
Differential Revision: https://phabricator.services.mozilla.com/D68133

--HG--
rename : browser/modules/OSKeyStore.jsm => toolkit/modules/OSKeyStore.jsm
rename : browser/modules/test/OSKeyStoreTestUtils.jsm => toolkit/modules/tests/modules/OSKeyStoreTestUtils.jsm
rename : browser/modules/test/unit/test_osKeyStore.js => toolkit/modules/tests/xpcshell/test_osKeyStore.js
extra : moz-landing-system : lando
2020-03-25 08:21:24 +00:00
Gijs Kruitbosch 0377d8eece Bug 1598924 - make remote settings handle shutdown gracefully, r=leplatrem,asuth
By and large, this change accomplishes two things:
1. Run db.close() in finally clauses so that even if db access fails, we close
   our connections. It also tries to avoid waiting on other, non-DB operations
   before calling close, to avoid the DB connection needlessly hanging around.
2. Intercept all async database operations from the remote settings client to
   kinto and ensuring they complete before the end of `profile-before-change`.
   Any operations started after Services.startup.isShuttingDown (so after
   quit/restart is initiated by the user) will throw. Operations started
   beforehand are put in a set of operations, and remove themselves once
   complete. We AsyncShutdown block on that set of operations completing.

Differential Revision: https://phabricator.services.mozilla.com/D66995

--HG--
extra : moz-landing-system : lando
2020-03-24 14:55:41 +00:00
Andreea Pavel 3550cada92 Backed out changeset 3b7ccffc0546 (bug 1598924) for permafailing bug 1621759 on a CLOSED TREE 2020-03-23 21:37:55 +02:00
Gijs Kruitbosch 457afaaba0 Bug 1598924 - make remote settings handle shutdown gracefully, r=leplatrem,asuth
By and large, this change accomplishes two things:
1. Run db.close() in finally clauses so that even if db access fails, we close
   our connections. It also tries to avoid waiting on other, non-DB operations
   before calling close, to avoid the DB connection needlessly hanging around.
2. Intercept all async database operations from the remote settings client to
   kinto and ensuring they complete before the end of `profile-before-change`.
   Any operations started after Services.startup.isShuttingDown (so after
   quit/restart is initiated by the user) will throw. Operations started
   beforehand are put in a set of operations, and remove themselves once
   complete. We AsyncShutdown block on that set of operations completing.

Differential Revision: https://phabricator.services.mozilla.com/D66995

--HG--
extra : moz-landing-system : lando
2020-03-23 16:35:08 +00:00
ffxbld 688cc76dfc No Bug, mozilla-central repo-update HSTS HPKP remote-settings tld-suffixes - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D67852

--HG--
extra : moz-landing-system : lando
2020-03-23 13:43:31 +00:00
Amogh Kerigond d1ba6e0606 Bug 1622666 - Removes redundant access specifier r=froydnj
Depends on D67739

Differential Revision: https://phabricator.services.mozilla.com/D67767

--HG--
extra : moz-landing-system : lando
2020-03-22 11:58:15 +00:00
Mathieu Leplatre 924826ecef Bug 1623481 - Fix intermittent failure on Remote Settings Database open r=glasserc
Differential Revision: https://phabricator.services.mozilla.com/D67454

--HG--
extra : moz-landing-system : lando
2020-03-20 09:46:44 +00:00
Mark Banner c2e698bc85 Bug 1542269 - Make the modern search engine configuration be loaded from Remote Settings. r=daleharvey
Differential Revision: https://phabricator.services.mozilla.com/D55464

--HG--
extra : moz-landing-system : lando
2020-03-19 14:11:40 +00:00
Sylvestre Ledru be18fd4dba Bug 1622328 - add license info to all eslintrc files r=Standard8,webcompat-reviewers,miketaylr
Differential Revision: https://phabricator.services.mozilla.com/D67319

--HG--
extra : moz-landing-system : lando
2020-03-19 13:47:51 +00:00
ffxbld 8fdcf8990c No Bug, mozilla-central repo-update HSTS HPKP remote-settings - a=repo-update r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D67475

--HG--
extra : moz-landing-system : lando
2020-03-19 13:43:29 +00:00
Sylvestre Ledru 200b20eb5c Bug 1622328 - fxa_utils.js: Add the license r=markh
Differential Revision: https://phabricator.services.mozilla.com/D66831

--HG--
extra : moz-landing-system : lando
2020-03-14 01:09:01 +00:00