Граф коммитов

6084 Коммитов

Автор SHA1 Сообщение Дата
Ben Dean-Kawamura 8e1a7e6e7b Return non-zero exit code when symbol uploading fails
This happened for the 131 release, but we didn't catch it because the
python script exited successfully.
2024-09-19 21:02:17 +00:00
Bastian Gruber 21e5e4540e Switch suggest component from UDL to proc-macros 2024-09-19 18:47:08 +00:00
Ben Dean-Kawamura 7625a2cecc Switch to UniFFI library mode
This removes the need for a lot configuration in our `uniffi.toml`
files.
2024-09-18 20:31:35 +00:00
Bastian Gruber 220af9af6c Switch relevancy component from UDL to proc-macros 2024-09-18 14:12:39 +00:00
Ben Dean-Kawamura 8be45cd323 Improved `cargo suggest-debug-ingestion-sizes`
It now prints out ingestion sizes per record type, which is more usefull
than the total size.
2024-09-16 15:16:40 +00:00
Bastian Gruber b8b598caf6 fix: add proper Rust doc comments to UDL files 2024-09-16 07:42:17 +00:00
Nan Jiang b028222e89 DISCO 2821 - (Part 2): Add a score function to relevancy 2024-09-13 20:01:00 +00:00
Nan Jiang f7f19ed06f DISCO 2821 - (Part 1): Add get user interest vector 2024-09-13 20:01:00 +00:00
Sammy Khamis 5af28e120f Add ability for the tabs engine to close db connection 2024-09-13 01:25:48 +00:00
Ryan VanderMeulen cbb339a345 Update Mockito to version 5.13.0 2024-09-12 19:46:06 +00:00
Ryan VanderMeulen c6d7111c2e Switch Android tests from junit 4 to junit-vintage 2024-09-12 19:46:06 +00:00
Bastian Gruber d9d97e0c09 fix: adjust to new swift lint rule 2024-09-10 19:10:48 +00:00
Bastian Gruber dc397f34ed Build Kotlin docs via Dokka 2024-09-10 14:59:33 +00:00
lougeniaC64 6651984e3b Revert "Exposed webext-storage bridged engine logic"
This reverts commit b94438a80d.
2024-09-06 18:50:17 +00:00
Ben Dean-Kawamura ef780d46d4 Add Java and Android SDK upgrade instructions 2024-09-06 15:03:37 +00:00
Ryan VanderMeulen 3760c22ae9 Update pinned Python dependencies 2024-09-04 19:51:05 +00:00
Ben Dean-Kawamura 9403a4fa6c DISCO-2947 - Bump UniFFI to 0.28.0 2024-09-04 15:23:57 +00:00
Jan-Erik Rediger 9105b3a38d Update to Glean v61.0.0 2024-09-04 15:23:57 +00:00
Bastian Gruber abd2d8a1a6 add swift-docs to GitHub pages documentation 2024-09-04 15:05:25 +00:00
lougeniac64 b94438a80d Exposed webext-storage bridged engine logic 2024-09-04 14:39:36 +00:00
Mark Banner eee6c27f05 Bug 1914145 - Create initial search component stub.
This creates a basic search component stub with a simple function that does nothing except raise an error.
Full functionality will come in later commits
2024-09-04 08:58:28 +00:00
Ben Dean-Kawamura 7902bfb6df Remove taskgraph.memoize usage
This was mentioned in the migration guide and it was needed for me to
make test out some changes locally.

https://taskcluster-taskgraph.readthedocs.io/en/latest/reference/migrations.html#x-9-x
2024-09-03 18:57:32 +00:00
Julien Cristau 4f2a05d54a Declare missing dependencies in toolchain CI tasks
Toolchain scripts source other scripts, which means we need to
invalidate the cached toolchains and rebuild them when the sourced
scripts change.
2024-09-03 18:15:36 +00:00
Andrew Halberstadt e0af1b4e0e Remove 'resource-monitor' toolchain task and associated fetch
This feature relies on an archived repo which hasn't had a commit in
over four years. It's also been noted that the `resource-usage`
artifacts aren't providing much value.

The suggestion was to simply remove these tasks instead.
2024-09-03 18:14:51 +00:00
Bastian Gruber dbeaef2eb2 feat: be able to generate static website docs from swift components 2024-09-03 14:11:19 +00:00
DIinna Smith f9e62b3e2d Start release v132.0 2024-08-30 19:28:19 +00:00
Drew Willcoxon 3a35a1e49b Bug 1915715 - Rename some ingest-related SuggestStoreInner methods 2024-08-30 17:35:06 +00:00
Ryan VanderMeulen d70c6c5662 Fix clang symlink 2024-08-30 15:29:09 +00:00
Ryan VanderMeulen af68772caa Update NSS to version 3.104 2024-08-30 15:29:09 +00:00
Drew Willcoxon 66bfc0b447 Bug 1915299 - Download attachments of unchanged exposure suggestion records if the suggestion type hasn't been ingested 2024-08-29 20:03:55 +00:00
Mark Hammond c3def30308 Back out "Support for a new "close all inactive tabs" command."
This backs out commit 579d17846c.
2024-08-28 20:19:45 +00:00
Ben Dean-Kawamura cfb19af8ee Bug 1889982 - Upload android symbols
- Split the `upload_android_symbols.sh` into a generation script and an
  upload script.
- `module-build` tasks that have `uploadSymbols` set run the generation script.
- Added the `upload-symbols` task that to run the upload script.  This
  runs during the `ship` phase, the nightly cron job, and also for `[ci full]`
  (the latter uses dummy credentials).
2024-08-28 14:10:18 +00:00
Ryan VanderMeulen b8a8cdb474 Update Cargo.lock 2024-08-28 13:27:22 +00:00
Mark Hammond 579d17846c Support for a new "close all inactive tabs" command. 2024-08-27 13:52:32 +00:00
Drew Willcoxon 608b930b02 Bug 1893086 - Port the potential impressions framework to the suggest component 2024-08-21 01:31:16 +00:00
Beth Rennie 6c1d73c997 Bug 1898394 - Use gecko-dev repo for Fenix and Focus Android manifests
Firefox 125 was the last version to use the
mozilla-mobile/firefox-android repo. Now it is in mozilla-central, so
we can use the mozilla/gecko-dev mirror. Unfortunately, gecko-dev does
not have tagged releases, so we cannot look up manifests by their
version and have to use --ref instead.

Additionally, we were looking for Fenix manifests in the
mozilla-mobile/fenix repo for version < 110. However, v110 was released
from the fenix repo and v111 was the first version to use the combnined
mozilla-mobile/firefox-android repo. This has been fixed.
2024-08-20 18:45:14 +00:00
Ben Dean-Kawamura c3774b262f Bug 1908802 - Handle deleted suggest records
The issue is that once a record is deleted, it no longer has a type
field.  Reworked the ingestion client to deal with this.  It now always
fetches all records, then filters them client side.  Client-side
filtering is more flexible and allows us to handle the deleted records.
Updated the code to use caching make the requests more efficient.

Rather than store last modified times for record types, store details on
each record that we've ingested.  This means that if we fail to process
a record for any reason, on the next ingest we have another chance to
process it and recover.

Updated the `rs::Record` type to store the parsed `SuggestRecord`.  This
simplifies a lot of the filtering/caching code.
2024-08-14 15:22:17 +00:00
Ryan VanderMeulen 17cb62b967 Update Gradle to version 8.10 2024-08-14 14:49:06 +00:00
dependabot[bot] ccad43b187 build(deps): bump pyjwt from 2.8.0 to 2.9.0 in /tools
Bumps [pyjwt](https://github.com/jpadilla/pyjwt) from 2.8.0 to 2.9.0.
- [Release notes](https://github.com/jpadilla/pyjwt/releases)
- [Changelog](https://github.com/jpadilla/pyjwt/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jpadilla/pyjwt/compare/2.8.0...2.9.0)

---
updated-dependencies:
- dependency-name: pyjwt
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-14 10:39:04 +00:00
Ben Dean-Kawamura 0161929654 Bug 1911903 - Fakespot keywords and product_type fields
Added support for ingesting these fields and using them to order the
fakespot suggestions.  The fakespot scoring was getting complicated
enough that I split it out into its own module.

Also, changed the Fakespot base score to be 0.31.  After further
discussed it was decided that Fakespot suggestions should have higher
priority than AMP ones.
2024-08-13 21:25:51 +00:00
Ben Dean-Kawamura bac73bb442 Bug 1908397 - Suggest metrics
Defined metrics for suggest.  I used labeled timing distributions, which
is a relatively new metric that seems great for our needs.  Using these
metrics, we can track a separate timing distribution for each record
type / provider.

Updated `ingest` to return metrics.  Added `query_with_metrics`, which
returns metrics alongside the usual results. Added some classes to
record metrics as the operations execute.

Moved the top-level `fetch_suggestions` from db.rs to store.rs.  It's
now responsible for metrics, so I thought it fit better in store.
2024-08-07 18:22:50 +00:00
Jan-Erik Rediger 236fdd9d2d Update to Glean v60.5.0 2024-08-07 15:32:01 +00:00
Sammy Khamis 56e868a6e1 Update the toolchain script to pull from new artifacts 2024-08-05 23:11:39 +00:00
DonalMe 17b942c0f1 Start release v131.0 2024-08-05 15:03:28 +00:00
Ben Dean-Kawamura 959b073776 Changelog fix
I put this entry in the wrong place
2024-08-02 19:47:48 +00:00
Ben Dean-Kawamura bc7eaf8225 Remote settings caching support
Added a `get_cached_records` method that gets all record for a
collection, using a cache make it efficient.  I'm hoping that this will
help out Nish who is experimenting with this in iOS and also that we can
use something like this for remote settings.
2024-08-02 16:54:39 +00:00
Ryan VanderMeulen 4a3df8efe9 Update NSS to version 3.103 2024-08-01 21:05:41 +00:00
Ben Dean-Kawamura caafbbd7f0 Suggest ingestion logging + refactor
This is prep-work for
https://bugzilla.mozilla.org/show_bug.cgi?id=1908802.

Update the Suggest CLI to log ingestion details so that I can test that
the new code works correctly.  Added support for re-ingesting
suggestions and ingesting specific providers.

Map suggestion providers to a single record type, rather than multiple
ones and always ingest icons/global config.  I think this system is
simpler and also having to list icons/global config for each provider
type is a footgun.  For example, we should ingest icons/config for
fakespot, but I forgot to list them.

Removed the `SuggestIngestionConstraints::max_suggestions` field. AFAICT,
it was not being used by any consumers and doesn't seem to be
implemented correctly.  We apply the limit to each record type, but a
single ingestion request will have many record types.  It also doesn't
seem clear to me how this should work, for example should the
config/icons count?  I want to update this code, but I don't want to
worry about this field.

Updated the benchmark code to download all records/attachments directly,
rather than the complex system of running an ingestion to figure out
what to download.  I'm planning on updating the client code and this
will work with the new system better.
2024-08-01 14:44:08 +00:00
cketti 171ef940b5 Switch from JCenter to MavenCentral
JCenter has been sunset. See <https://jfrog.com/blog/into-the-sunset-bintray-jcenter-gocenter-and-chartcenter/>.
2024-07-30 19:48:45 +00:00
Ryan VanderMeulen 4874113f01 Update to Glean v60.4.0 2024-07-29 13:08:13 +00:00