mozilla
/
docker-etl
зеркало из https://github.com/mozilla/docker-etl.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
303 коммитов 73 Ветки 0 Теги 6,3 MiB
Граф коммитов

303 Коммитов

Автор SHA1 Сообщение Дата
Anthony Miyaguchi 32b3b78a7e Add a search box for nodes 2021-01-14 17:00:10 -08:00
Anthony Miyaguchi 662cc34734 Update package.json 2021-01-14 16:00:27 -08:00
Anthony Miyaguchi 9ab0105962 Update the frontmatter for minor changes to behavior 2021-01-14 15:58:52 -08:00
Anthony Miyaguchi 75367d6734 Use a store for redraw state 2021-01-14 15:55:33 -08:00
Anthony Miyaguchi 1695babf1f Remove second order nodes 2021-01-14 15:06:47 -08:00
Anthony Miyaguchi 579dd4d261 Simplify drawing options 2021-01-14 13:55:56 -08:00
Anthony Miyaguchi 4cf2a8a5d9 Add option to redraw 2021-01-14 13:10:28 -08:00
Anthony Miyaguchi ef800a4c1d Only show nodes within a certain number of hops 2021-01-14 12:58:08 -08:00
Anthony Miyaguchi 83d797e395 Add checkbox on whether to include dataset as a node 2021-01-04 14:57:42 -08:00
Anthony Miyaguchi eb7e8038ee Add a markdown preprocessor 2021-01-04 12:15:55 -08:00
Anthony Miyaguchi 91da81e523
Merge pull request #2 from acmiyaguchi/svelte 
Refactor web-app using svelte
 2021-01-04 11:58:40 -08:00
Anthony Miyaguchi 6711d4f84e Use component bindings to reduce nesting in components 2021-01-04 11:50:47 -08:00
Anthony Miyaguchi 109a511c44 Set progress bar using idiomatic svelte 2021-01-04 11:16:26 -08:00
Anthony Miyaguchi a8812c3813 Use dom binding instead of a named div 2021-01-04 10:30:51 -08:00
Anthony Miyaguchi 1988b8b410 Refactor summary into a separate component 2020-12-23 17:29:10 -08:00
Anthony Miyaguchi 559d429708 Factor network view out of the main app 2020-12-23 17:12:15 -08:00
Anthony Miyaguchi 618ed35f78 Upgrade packages and fix all warnings 2020-12-23 17:01:18 -08:00
Anthony Miyaguchi 11860f30e9 Bundle vis-network into the app 2020-12-23 16:57:13 -08:00
Anthony Miyaguchi 0242b057cb Move most of the logic into the svelte app 2020-12-23 16:51:36 -08:00
Anthony Miyaguchi b373220607 Add skeleton for sveltified app 2020-12-23 16:16:28 -08:00
Anthony Miyaguchi 4156714ebe Write data to public/data 2020-12-23 16:14:57 -08:00
Anthony Miyaguchi 174c93b65b Remove setting the project 2020-12-23 16:06:06 -08:00
Anthony Miyaguchi f3116621bb Fix issues with duplicate edges in querylog etl 2020-12-23 15:56:49 -08:00
Anthony Miyaguchi 0921e9f9ac
Merge pull request #1 from acmiyaguchi/update 
Remove bigquery-etl resolution
 2020-12-22 17:03:23 -08:00
Anthony Miyaguchi 7204f8ef24 Remove bigquery-etl resolution 2020-12-22 16:55:13 -08:00
Anthony Miyaguchi 8fc8a5a26b
Bug 1682428 - Create custom container for pioneer-debug (#3) 
* Bug 1682428 - Create custom container for pioneer-debug

* Update gitignore for compiled python bytecode

* Update README
 2020-12-15 09:38:55 -08:00
Ben Wu 02529b1265
Port mau dashboard jobs from databricks (#2) 2020-12-10 14:14:51 -05:00
Ben Wu 08951f574f
Setup initial tooling and templates (#1) 2020-12-03 17:33:58 -05:00
Ben Wu 0b0da94968
Initial commit 2020-09-21 17:56:23 -04:00
Anthony Miyaguchi 3801239a13 Update index with date 2020-06-18 17:34:12 -07:00
Anthony Miyaguchi 8dc24eeffe Update notes 2020-06-18 17:23:47 -07:00
Anthony Miyaguchi 2b837cafa8 Update visualization with some front matter 2020-06-18 15:13:45 -07:00
Anthony Miyaguchi da1a03ecce Add summary to visualization page 2020-06-18 11:59:58 -07:00
Anthony Miyaguchi 1c5e1882e8 Add datasets as nodes in the graph 2020-06-17 17:49:56 -07:00
Anthony Miyaguchi 2225feabdd Shorten names and add a new group for each project 2020-06-17 17:26:51 -07:00
Anthony Miyaguchi 1dde9176d2 Add quickstart in README 2020-06-17 16:50:28 -07:00
Anthony Miyaguchi 0d69a7edb4 Add deploy script to bucket in gcs 2020-06-17 16:50:11 -07:00
Anthony Miyaguchi 5b09200eeb Add visualization using vis-network 2020-06-17 16:14:00 -07:00
Anthony Miyaguchi 67260b90f5 Trash the idea of pulling in nodejs 2020-06-17 14:23:01 -07:00
Anthony Miyaguchi ebfe96f89f Add a svelte client app from graph-paper-org/app-template 2020-06-17 11:14:28 -07:00
Anthony Miyaguchi 649c86ad86 Add command to index data into format for visualization 2020-06-17 10:54:11 -07:00
Anthony Miyaguchi 2bc22f9036 Add note about edge weights 2020-06-17 10:13:39 -07:00
Anthony Miyaguchi eca32d997e Add command for extracting shared prod edgelist 2020-06-17 09:57:18 -07:00
Anthony Miyaguchi 5e622ae212 Update notes with parsing relations between tables from job table 2020-06-16 17:15:04 -07:00
Anthony Miyaguchi cb5e225553 Add sql for generating edge-list in shared prod 2020-06-16 17:14:31 -07:00
Anthony Miyaguchi 8d789613d7 Add mostly broken method for scraping info from bigquery etl 2020-06-16 17:13:54 -07:00
Anthony Miyaguchi e9f924be4b Add command line interface via click 2020-06-16 10:56:21 -07:00
Anthony Miyaguchi b8d0c7d529 Add a way to dump edgelist for imports into gephi 2020-06-16 09:54:16 -07:00
Anthony Miyaguchi b417c1b325 Throw away intermediate files for view references 2020-06-15 17:33:07 -07:00
Anthony Miyaguchi 7b0f8d87ab Parallel processing of view references 2020-06-15 17:22:29 -07:00