зеркало из https://github.com/mozilla/data-docs.git
Remove obsolete projects from listings
This commit is contained in:
Jeff Klukas
Родитель
f8b5c03649
Коммит
56504b1bc5
|
|
@ -6,37 +6,27 @@ Below are a number of trailheads that lead into the projects and code that compr
|
|||
|
||||
| Name and repo | Description |
|
||||
| -------------------------------- | --------------------------------------------------------------------------------------------------------- |
|
||||
| [`python_moztelemetry`][pymt] | Python APIs for Mozilla Telemetry |
|
||||
| [`moztelemetry`][mt] | Scala APIs for Mozilla Telemetry |
|
||||
| [`spark-hyperloglog`][spark_hll] | Algebird's HyperLogLog support for Apache Spark |
|
||||
| [`mozanalysis`][ma] | A library for Mozilla experiments analysis |
|
||||
| [`glean`][glean] | A client-side mobile Telemetry SDK for collecting metrics and sending them to Mozilla's Telemetry service |
|
||||
|
||||
[pymt]: https://github.com/mozilla/python_moztelemetry
|
||||
[mt]: https://github.com/mozilla/moztelemetry
|
||||
[spark_hll]: https://github.com/mozilla/spark-hyperloglog
|
||||
[ma]: https://github.com/mozilla/mozanalysis
|
||||
[glean]: https://github.com/mozilla-mobile/android-components/tree/master/components/service/glean
|
||||
[glean]: https://github.com/mozilla-mobile/android-components/main/master/components/service/glean
|
||||
|
||||
## ETL code and Datasets
|
||||
|
||||
| Name and repo | Description |
|
||||
| ------------------------------- | ------------------------------------------------------ |
|
||||
| [`bigquery-etl`][bqe] | SQL ETL code for building derived datasets in BigQuery |
|
||||
| [`telemetry-batch-view`][tbv] | Scala ETL code for derived datasets |
|
||||
| [`python_mozetl`][pyetl] | Python ETL code for derived datasets |
|
||||
| [`telemetry-airflow`][airflow] | Airflow configuration and DAGs for scheduled jobs |
|
||||
| [`python_mozaggregator`][pyagg] | Aggregation job for `telemetry.mozilla.org` aggregates |
|
||||
| [`telemetry-streaming`][stream] | Spark Streaming ETL jobs for Mozilla Telemetry |
|
||||
|
||||
See also [`data-docs`][docs] for documentation on datasets.
|
||||
|
||||
[bqe]: https://github.com/mozilla/bigquery-etl
|
||||
[tbv]: https://github.com/mozilla/telemetry-batch-view
|
||||
[pyetl]: https://github.com/mozilla/python_mozetl
|
||||
[airflow]: https://github.com/mozilla/telemetry-airflow
|
||||
[pyagg]: https://github.com/mozilla/python_mozaggregator
|
||||
[stream]: https://github.com/mozilla/telemetry-streaming
|
||||
|
||||
## Infrastructure
|
||||
|
||||
|
|
@ -46,74 +36,51 @@ See also [`data-docs`][docs] for documentation on datasets.
|
|||
| [`gcp-ingestion`][gcp-ingestion] | Documentation and implementation of the Mozilla telemetry ingestion system on Google Cloud Platform |
|
||||
| [`jsonschema-transpiler`][transpiler] | Convert JSON Schema into BigQuery table definitions |
|
||||
| [`mozilla-schema-generator`][msg] | Incorporate probe metadata to generate BigQuery table schemas |
|
||||
| [`hindsight`][hs] | Real-time data processing |
|
||||
| [`lua_sandbox`][lsb] | Generic sandbox for safe data analysis |
|
||||
| [`lua_sandbox_extensions`][lsbx] | Modules and packages that extend the Lua sandbox |
|
||||
| [`nginx_moz_ingest`][nmi] | Nginx module for Telemetry data ingestion |
|
||||
| [`puppet-config`][puppet] | Cloud services puppet config for deploying infrastructure |
|
||||
| [`parquet2hive`][p2h] | Hive import statement generator for Parquet datasets |
|
||||
| [`edge-validator`][edge-validator] | A service endpoint for validating incoming data |
|
||||
|
||||
[schemas]: https://github.com/mozilla-services/mozilla-pipeline-schemas
|
||||
[gcp-ingestion]: https://github.com/mozilla/gcp-ingestion
|
||||
[transpiler]: https://github.com/mozilla/jsonschema-transpiler
|
||||
[msg]: https://github.com/mozilla/mozilla-schema-generator
|
||||
[hs]: https://github.com/mozilla-services/hindsight
|
||||
[lsb]: https://github.com/mozilla-services/lua_sandbox
|
||||
[lsbx]: https://github.com/mozilla-services/lua_sandbox_extensions
|
||||
[nmi]: https://github.com/mozilla-services/nginx_moz_ingest
|
||||
[puppet]: https://github.com/mozilla-services/puppet-config/tree/master/pipeline
|
||||
[p2h]: https://github.com/mozilla/parquet2hive
|
||||
[edge-validator]: https://github.com/mozilla-services/edge-validator
|
||||
|
||||
## Data applications
|
||||
|
||||
| Name and repo | Description |
|
||||
| ---------------------------------- | --------------------------------------------------------------- |
|
||||
| [`telemetry.mozilla.org`][tmo_gh] | Main entry point for viewing [aggregate Telemetry data][tmo] |
|
||||
| [Growth & Usage dashboard][gud_gh] | Dashboard for questions about [product growth and usage][gud] |
|
||||
| [`telemetry.mozilla.org`][tmo_gh] | Main entry point for legacy [aggregate Telemetry data][tmo] |
|
||||
| [Growth & Usage dashboard][gud_gh] | Legacy dashboard about [product growth and usage][gud] |
|
||||
| [Glean Aggregate Metrics][glam] | Aggregate info about probes and measures |
|
||||
| [Glean Debug View][gdv] | Tag and view Glean submissions with low latency |
|
||||
| [Cerberus][cer] & [Medusa][med] | Automatic alert system for telemetry aggregates |
|
||||
| [Mission Control][mc] | Low latency dashboard for stability and health metrics |
|
||||
| [Redash][redash] | Mozilla's fork of the [data query / visualization system][stmo] |
|
||||
| [`redash-stmo`][redashstmo] | Mozilla's extensions to Redash |
|
||||
| [TAAR][taar] | Telemetry-aware addon recommender |
|
||||
| [Ensemble][ensemble] | A minimalist platform for publishing data |
|
||||
| [Hardware Report][hwreport_gh] | Firefox Hardware Report, [available here][hwreport] |
|
||||
| [`python-zeppelin`][pyzep] | Convert Zeppelin notebooks to Markdown |
|
||||
| [St. Mocli][stmocli] | A command-line interface to [STMO][stmo] |
|
||||
| [probe-scraper] | Scrape and publish Telemetry probe data from Firefox |
|
||||
| [test-tube] | Compare data across branches in experiments |
|
||||
| [experimenter] | A web application for managing experiments |
|
||||
| [St. Moab][stmoab] | Automatically generate Redash dashboard for A/B experiments |
|
||||
| [Iodide] ([code][iodide_gh]) | Literate scientific computing and communication for the web |
|
||||
|
||||
[tmo_gh]: https://github.com/mozilla/telemetry-dashboard
|
||||
[gud]: https://gud.telemetry.mozilla.org
|
||||
[gud_gh]: https://github.com/mozilla/GUD
|
||||
[glam]: https://github.com/mozilla/glam
|
||||
[gdv]: https://debug-ping-preview.firebaseapp.com
|
||||
[cer]: https://github.com/mozilla/cerberus
|
||||
[med]: https://github.com/mozilla/medusa
|
||||
[mc]: https://github.com/mozilla/missioncontrol
|
||||
[redash]: https://github.com/mozilla/redash
|
||||
[redashstmo]: https://github.com/mozilla/redash-stmo
|
||||
[taar]: https://github.com/mozilla/taar
|
||||
[ensemble]: https://github.com/mozilla/ensemble
|
||||
[shield]: https://wiki.mozilla.org/index.php?title=Firefox/Shield
|
||||
[tmo]: https://telemetry.mozilla.org
|
||||
[stmo]: https://sql.telemetry.mozilla.org
|
||||
[hwreport_gh]: https://github.com/mozilla/firefox-hardware-report
|
||||
[hwreport]: https://data.firefox.com/dashboard/hardware
|
||||
[pyzep]: https://github.com/mozilla/python-zeppelin
|
||||
[stmocli]: https://github.com/mozilla/stmocli
|
||||
[probe-scraper]: https://github.com/mozilla/probe-scraper
|
||||
[test-tube]: https://github.com/mozilla/firefox-test-tube
|
||||
[experimenter]: https://github.com/mozilla/experimenter
|
||||
[stmoab]: https://github.com/mozilla/stmoab
|
||||
[iodide]: http://iodide.telemetry.mozilla.org/
|
||||
[iodide_gh]: https://github.com/iodide-project/iodide
|
||||
|
||||
## Legacy projects
|
||||
|
||||
|
|
@ -126,10 +93,13 @@ starting a new project using anything in this section.
|
|||
| [`telemetry-next-node`][tnn] | A `node.js` package for accessing Telemetry Aggregates data |
|
||||
| [`emr-bootstrap-spark`][eb_spark] | AWS bootstrap scripts for Spark. |
|
||||
| [`emr-bootstrap-presto`][eb_presto] | AWS bootstrap scripts for Presto. |
|
||||
| [Iodide] ([code][iodide_gh]) | Literate scientific computing and communication for the web |
|
||||
|
||||
[eb_spark]: https://github.com/mozilla/emr-bootstrap-spark
|
||||
[eb_presto]: https://github.com/mozilla/emr-bootstrap-presto
|
||||
[tnn]: https://github.com/mozilla/telemetry-next-node
|
||||
[iodide]: http://iodide.telemetry.mozilla.org/
|
||||
[iodide_gh]: https://github.com/iodide-project/iodide
|
||||
|
||||
## Reference materials
|
||||
|
||||
|
|
|
|||
Загрузка…
Ссылка в новой задаче