Граф коммитов

123 Коммитов

Автор SHA1 Сообщение Дата
Sylvestre Ledru d57d4905f1 Bug 1519636 - Reformat recent changes to the Google coding style r=Ehsan
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D30883

--HG--
extra : moz-landing-system : lando
2019-05-25 17:46:15 +00:00
arthur.iakab af8e458c5f Backed out changeset a296439a25ff (bug 1519636) for frequent Windows cppunit failures CLOSED TREE 2019-05-24 14:26:01 +03:00
Sylvestre Ledru c82ea97226 Bug 1519636 - Reformat recent changes to the Google coding style r=Ehsan
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D30883

--HG--
extra : moz-landing-system : lando
2019-05-24 09:59:17 +00:00
Jan Varga eef773ad6c Bug 1549654 - LSNG: Compress specific values during migration; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D30181
2019-05-07 12:54:02 +02:00
Jan Varga e25844ad71 Bug 1548788 - LSNG: Datastore preparation doesn't have to create new origin directories if they don't exist; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D29822
2019-05-03 15:03:54 +02:00
Jan Varga ea67826b85 Bug 1547688 - LSNG: Preloading can use gUsages hash table to quickly finish if there's nothing to preload; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D29194
2019-04-29 14:23:55 +02:00
Jan Varga 2ffbce35b7 Bug 1513937 - LSNG: Compress specific values; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D29140
2019-04-29 06:10:42 +02:00
Jan Varga 6360443a3b Bug 1546310 - LSNG: Parent process should store values in UTF8; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D29139
2019-04-29 06:09:42 +02:00
Ryan VanderMeulen 4f044a29d2 Backed out 8 changesets (bug 1513937, bug 1546310, bug 1548788, bug 1547688, bug 1547452, bug 1540777, bug 1542669, bug 1547454) for causing bug 1549362.
Backed out changeset 8dca7df29492 (bug 1548788)
Backed out changeset 688f361e8bb6 (bug 1547688)
Backed out changeset b5d8d57838a3 (bug 1540777)
Backed out changeset d1bd31177b14 (bug 1513937)
Backed out changeset df97dfbb526a (bug 1546310)
Backed out changeset ade08d6dc361 (bug 1547454)
Backed out changeset b622431054b7 (bug 1547452)
Backed out changeset ad73e5604411 (bug 1542669)
2019-05-06 09:02:54 -04:00
Jan Varga 2820fe9cc8 Bug 1548788 - LSNG: Datastore preparation doesn't have to create new origin directories if they don't exist; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D29822
2019-05-03 15:03:54 +02:00
Jan Varga 0d5ae59a7b Bug 1547688 - LSNG: Preloading can use gUsages hash table to quickly finish if there's nothing to preload; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D29194
2019-04-29 14:23:55 +02:00
Jan Varga 12fd20045f Bug 1513937 - LSNG: Compress specific values; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D29140
2019-04-29 06:10:42 +02:00
Jan Varga 120ed0037a Bug 1546310 - LSNG: Parent process should store values in UTF8; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D29139
2019-04-29 06:09:42 +02:00
Sylvestre Ledru 96da5036ad Bug 1519636 - Reformat recent changes to the Google coding style r=Ehsan
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D28948

--HG--
extra : moz-landing-system : lando
2019-04-28 09:30:05 +00:00
Jan Varga 4d4622f55f Bug 1546305 - LSNG: Add temporary support for downgrading; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D28800
2019-04-25 11:25:52 +02:00
Tom Tung 25abf064bb Bug 1423917 - P12 - Return an error if it failed to remove the asmjs directory and move the deprecated client check to InitializeOrigin; r=asuth
The reasons of this patch:
- P9 didn't handle the deletion of deprecated client well. It shouldn't continue
  if the client is failed to be removed. This patch correct this behavior.

- Meanwhile, it's not really good to just crash while finding a deprecated
  client. At least, the client should be removed while finding it before
  crashing the Firefox.

- Besides, if we eventaully only check the deprecated client during the
  initialization. It makes the code simpler to make the deprecated check to
  InitializeOrigin.

Therefore, this patch is a little bit against the P11, but I think it's a right
thing to do here.

Differential Revision: https://phabricator.services.mozilla.com/D24678

--HG--
extra : moz-landing-system : lando
2019-03-25 15:15:03 +00:00
Tom Tung 88e2f17179 Bug 1423917 - P11 - Make the deprecated client check only enable after upgrading to the newest version; r=asuth
The previous patches didn't take care of the case there might have an asmjs
folder in the older version. To fix that, this patch makes Client allow to have
asmjs folders in the older version by requesting the callee of TypeFromText()
for passing the current storage version. If the version is lower than the
deprecate version, then the assertion won't be enabled.
The test verfies the fix by adding the older profile an asmjs folder.

Differential Revision: https://phabricator.services.mozilla.com/D24542

--HG--
extra : moz-landing-system : lando
2019-03-23 07:56:02 +00:00
Jan Varga 44461f8eff Bug 1535221 - Add more robust logging including more detailed logging for CheckClosingDatastore and DirectoryOpenPending state; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D24423
2019-03-21 21:08:00 +01:00
Tom Tung 980e24c534 Bug 1423917 - P5 - Introduce a minor upgrade on QuotaManager to clean obsolete origins; r=asuth
Depends on D21728

Differential Revision: https://phabricator.services.mozilla.com/D21729

--HG--
extra : moz-landing-system : lando
2019-03-20 13:31:10 +00:00
Jan Varga c5284f4f76 Bug 1526891 - Part 15: Remove CreateRunnable; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D20924
2019-02-23 17:33:55 +01:00
Jan Varga f8372b6b8d Bug 1526891 - Part 13: Send an async IPC message instead of dispatching a runnable to the PBackground thread when shutting down quota manager; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D20922
2019-02-23 17:30:41 +01:00
Jan Varga 64174bb9d6 Bug 1526891 - Part 12: Merge ShutdownObserver with Observer; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D20921
2019-02-23 17:28:10 +01:00
Jan Varga 8815209a79 Bug 1526891 - Part 7: Move base dir path initialization to a profile observer; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D20916
2019-02-23 17:12:09 +01:00
Jan Varga 383bad7c55 Bug 1517089 - Part 16: Implement QuotaManager::GetInfoFromValidatedPrincipalInfo; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D19213
2019-02-08 21:02:23 +01:00
Jan Varga 61bb94bcb8 Bug 1517089 - Part 10: Implement QuotaManager::IsPrincipalInfoValid; r=asuth
Differential Revision: https://phabricator.services.mozilla.com/D19204
2019-02-08 21:01:59 +01:00
Jan Varga 5302b36c41 Bug 1517089 - Part 5: Move storage service initialization to InitializeLocalStorage; r=asuth 2019-02-07 19:51:22 +01:00
Tom Tung 2a60c08e55 Bug 1423917 - P1 - Ignore dot files in QM and add .desktop, Desktop.ini, desktop.ini, Thumbs.db into the list of OSMetadata; r=asuth
This patch mainly whitelist all the dot-files in the persistence directories and
origin directories. Ignore dot-files was first proposed in
Bug 944918 comment 39. ".desktop" was also mentioned in that comment Besides,
"desktop.ini" was first mentioned in Bug 944918 comment 42, "Thumbs.db" was
mentioned in 1493262 comment 11, and "Desktop.ini" was first mentioned
Bug 1423917 comment 46.Thus, this patch also whitelist them all during
initialization.

--HG--
extra : rebase_source : 6dc372c7e4bfc6dbe9774b5a9c72b95d20b7bea9
2018-09-20 14:54:42 +02:00
Tom Tung a4b7f90f3f Bug 1436188 - Add telemetry probes to collect the number of failures during the QuotaManager initialization; r=asuth, data-review=chutten
This patch uses categorical keyed Historgram to collect data. While the key is
used to determine whether is it an external error or an internal error (Note:
the external error is referred to low level failure, for example: database
corrupt, OS API errors, ... etc; the internal error is referred to errors, like:
not handle file properly, unexpected filenames, ... etc), the labels for
categorical indicates where the error happens.
Furthermore, this patch make QuotaManager keep traversing the profile even if
an error happens so that we can get more information in the telemetry data.
Please note that these things should only happen in the Nightly Channel.

Differential Revision: https://phabricator.services.mozilla.com/D15908

--HG--
extra : moz-landing-system : lando
2019-01-17 17:12:27 +00:00
Sylvestre Ledru 265e672179 Bug 1511181 - Reformat everything to the Google coding style r=ehsan a=clang-format
# ignore-this-changeset

--HG--
extra : amend_source : 4d301d3b0b8711c4692392aa76088ba7fd7d1022
2018-11-30 11:46:48 +01:00
Jan Varga 6714997188 Bug 1286798 - Part 48: Add ParseOrigin() method to the quota manager; r=asuth 2018-11-29 21:49:49 +01:00
Jan Varga 9c1d177a11 Bug 1286798 - Part 47: Add AboutToClearOrigins() method to the quota client interface; r=asuth 2018-11-29 21:49:46 +01:00
Jan Varga 0649224345 Bug 1286798 - Part 26: Implement a lazy data migration from old webappsstore.sqlite; r=asuth,janv
This patch was enhanced by asuth to bind attached database path.
Places has shown that argument binding is necessary.  (Profiles may include usernames in their path which can have cool emoji and such.)
2018-11-29 21:48:38 +01:00
Jan Varga 7981be440b Bug 1286798 - Part 25: Add checks for the group and global limit; r=asuth 2018-11-29 21:48:34 +01:00
Jan Varga 6e40a9dccb Bug 1286798 - Part 22: Add support for preloading of datastores; r=asuth
Datastores are preloaded only for content principals. The preloading is triggered as soon as possible to lower the chance of blocking the main thread in content process. If there is no physical database on disk for given origin, datastore is not created. Preloaded datastores are kept alive for 20 seconds.
2018-11-29 21:48:25 +01:00
Jan Varga 709a73dabf Bug 1286798 - Part 14: Enhance clearStoragesForPrincipal() to support clearing of storages for specific quota client; r=asuth
See also bug 1402254, original patch by baku.
2018-11-29 21:47:58 +01:00
Jan Varga c934ad618d Bug 1286798 - Part 6: Fix a dead lock in the single process case; r=asuth,janv
Expose the nested main event target, so it can be used in the single process case by the parent side to process runnables which need to run on the main thread.
After this change we don't have use hacks like getting profile directory path on the child side and sending it to the parent. The parent side can now do it freely even in the single process case.

This patch was enhanced by asuth to not tunnel the nested main event target through IPC.
2018-11-29 21:47:30 +01:00
Jan Varga 9f71846e2a Bug 1286798 - Part 4: Basic integration with QuotaManager; r=asuth
This adds a new quota client implementation, but only implements ShutdownWorkThreads.
At shutdown we wait for all running operations to finish including database actors which are closed by using an extra IPC message which avoids races between the parent and child.
Databases are dropped on the child side as soon as they are not used (e.g. after unlinking by the cycle collector).
2018-11-29 21:47:24 +01:00
Tom Tung 7e3170879c Bug 1395102 - P3 - Reuse the code for QuotaManager::UpgradeStorageFromxxToxx(); r=janv
This patch adds a new function QM::UpgradeStorage() to reuse lines of code in
QM:UpgradeStorageFrom0_0To1_0(), QM:UpgradeStorageFrom1_0To2_0(), and
QM:UpgradeStorageFrom2_0To2_1().

--HG--
extra : rebase_source : 7b1cba884d375e0609f5c622a798c9c0f8129b90
2018-10-17 15:37:16 +02:00
Tom Tung 5b3f5f96b1 Bug 1482812: Patch for turning on the origin parser check on both beta and release. r=janv
This patch, basically, turns the check. To avoid checking the same direcotries
multiple time, it creates a member hashtable |mValidOrigins| in QuotaManager and
use it in EnsureOriginDirectory(). Since it needs to use the member hashtable,
this patch also moves EnsureOriginDirectory() to become a QuotaManager member
function.

--HG--
extra : rebase_source : 170f749b07ca955e1dc41a627d339709381ffcad
2018-08-15 16:59:26 +02:00
Jan Varga 75397467ef Bug 1470811 - Update FF 62 to know about upcoming new quota client; r=asuth 2018-06-29 09:58:09 +02:00
Tom Tung 784d146b73 Bug 1373183 - Part 2: Remove the argument for EnsureTemporaryStorageIsInitialized() since it's unnecessary. r=janv
MozReview-Commit-ID: 9sCHI3XEpIj

--HG--
extra : rebase_source : ffc277295f8b4b160223db61a3014d7e7a95b671
2017-08-23 15:56:06 +08:00
Tom Tung dd96d219b4 Bug 1373183 - Part 1: Only initialize the temporary storage for estimate(). r=janv
To do this, reuse the code for initializing temporay storage in
EnsureOriginIsInitializedInternal(). Thus, create a helper function called
EnsureTemporaryStorageIsInitialized() and call it from both side.

MozReview-Commit-ID: vNQVteoicH

--HG--
extra : rebase_source : bb6101662213b099cbd7974b091c6c5e845b6311
2017-08-23 15:22:47 +08:00
Andrew Sutherland 3fcf6eee0f Bug 1404344 - Part 1: Alias QuotaManager schema 3.0 to 2.1. r=janv
To improve the Firefox 57 to 56 downgrade scenario, have 57 and 58
re-number the version 3.0 schema introduced by bug 1290481 to
version 2.1.  Firefox 56's Quota Manager will recognize the minor
schema version and accept the schema from the future.

--HG--
extra : rebase_source : c2458e380966e4f1ec60a6df5f01135231f308fe
extra : source : e895c35e9b4e9dbc6849d40d644af97c028fffcf
2017-10-03 10:02:27 -04:00
Tom Tung 65c21f0c77 Bug 1290481 - P6: Upgrade QuotaManager to v3.0 for adding directory padding file to existing DOM Cache directory. r=bkelly, janv
MozReview-Commit-ID: KlVsaGhpABk

--HG--
extra : rebase_source : ebc8bffa58ec4ab2226254fe5c3333d5425fa2fd
2017-07-18 18:54:20 +08:00
Tom Tung 29522efbef Bug 1290481 - P4: Update padding size to the QuotaManager. r=bkelly, janv
MozReview-Commit-ID: 6poDeyErBjc

--HG--
extra : rebase_source : c7f556ad5c4516c0509a998c16c086795e5fa4b2
2017-07-10 17:02:44 +08:00
Shawn Huang 29eb78c406 Bug 1384492 - Notify storage pressure in CheckTemporaryStorageLimits. r=janv 2017-09-06 17:25:13 +08:00
Jan Varga ee8bdbeba6 Bug 1348660 - Part 6: Rename QuotaManager::IsOriginWhitelistedForPersistentStorage() to QuotaManager::IsOriginInternal(); r=btseng 2017-03-22 12:14:09 +01:00
Tom Tung b21732dac3 Bug 1298329 - Part 1: Implement persist/persisted in QuotaManager and expose them to QuotaManagerService; r=janv 2016-08-25 10:19:31 +08:00
Tom Tung aa5d3ca4c9 Bug 1298329 - Part 0: Add persisted attribute to OriginInfo; r=janv 2017-01-17 09:41:00 +08:00
Jan Varga 2c456d0807 Bug 1339081 - Part 23: Treat it as an error if the origin stored in the database doesn't match the origin used to open the database; r=asuth 2017-03-06 18:40:37 +01:00