Граф коммитов

60 Коммитов

Автор SHA1 Сообщение Дата
gmierz bf6b657886 Allow retriggers to be used in side-by-side script. 2022-02-07 12:20:11 -05:00
dependabot[bot] f1f0925cd5
Bump pillow from 8.2.0 to 9.0.0 (#19)
Bumps [pillow](https://github.com/python-pillow/Pillow) from 8.2.0 to 9.0.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/8.2.0...9.0.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-13 10:16:53 -05:00
dependabot[bot] a655aebbde
Bump pillow in /variance-analysis/mach_perftest_notebook_dev (#20)
Bumps [pillow](https://github.com/python-pillow/Pillow) from 8.2.0 to 9.0.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/8.2.0...9.0.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-13 10:16:37 -05:00
davehouse b8a9afab96
docker setup for variance scripts (#15)
* copy req.txt from root

and add flask

* first try dockerfile

Co-authored-by: Gregory Mierzwinski <gmierzwinski@mozilla.com>
2021-12-07 08:52:55 -05:00
gmierz fca1e05e00 Add requirements for mach_perftest_notebook_dev. 2021-12-03 16:29:37 -05:00
gmierz c0120e8b29 Fix and clarify naming/logging in the variance analysis. 2021-10-19 12:05:09 -04:00
gmierz d8cd2134b7 Add simplified version of variance analysis script. 2021-10-19 11:09:14 -04:00
Dave Hunt 303d02d083
Allow multiple apps to be specified on the command line (#14)
* Format Python code using Black

* Allow multiple apps to be provided on the command line
2021-10-18 10:02:41 -04:00
Kimberly Sereduck 15f28e3704
Fix typo in readme (#11)
Co-authored-by: Kimberly <ksereduck@mozilla.com>
2021-10-01 14:26:48 -04:00
gmierz 63000f49b9 Ignore time-series which have only a single temporal data point. 2021-09-15 14:46:06 -04:00
gmierz 91138a98cf Fix merge conflict issues. 2021-09-15 14:27:07 -04:00
jesup 849dfcdf75
Calculate average using a window in days, not points, plus small fixes (#9)
* Update to allow use for fission release criteria; also fixes a bug where it would sometimes use gecko-profiler run data.   Allows output by site optionally.   All output is now sorted (by platform+site, app and variant).   Visualizations are now optional and off by default.   Added a dumb --platform-pattern parameter so I can easily get all the shippable-qr platform data (only).

* Add date filtering

* Add legends to plots; combine variants into a single plot

* add option to save plots; change default size to be larger

* added --end-date.   Use days for moving average period, not points.  Fix a divide-by-zero if there's no data.

Co-authored-by: Gregory Mierzwinski <gmierz1@live.ca>
2021-09-13 10:01:08 -04:00
jesup adfd019733
Update to allow use for fission release criteria; also fixes a bug wh… (#8)
* Update to allow use for fission release criteria; also fixes a bug where it would sometimes use gecko-profiler run data.   Allows output by site optionally.   All output is now sorted (by platform+site, app and variant).   Visualizations are now optional and off by default.   Added a dumb --platform-pattern parameter so I can easily get all the shippable-qr platform data (only).

* Add date filtering

* Add legends to plots; combine variants into a single plot

* add option to save plots; change default size to be larger
2021-09-13 09:58:07 -04:00
Dave Hunt 2f1f7d611e
Add pyproject.toml and poetry usage to README (#7)
* Add pyproject.toml and poetry usage in README

* Add Black as a dev dependency
2021-07-14 11:36:01 -04:00
Dave Hunt cfe9b6f2a8
Increase default platform width to accommodate android-hw-p2-8-0-android-aarch64-shippable-qr (#6) 2021-07-14 11:35:27 -04:00
gmierz 5e6e032f6a Handle case where litte to no data exists for a time series. 2021-07-13 10:43:58 -04:00
Dave Hunt b7d0f4655c
Format Python code using Black (#5) 2021-07-13 09:22:09 -04:00
gmierz 3519c49d09 Ignore black screens at the beginning of tests. 2021-06-14 18:59:14 -04:00
gmierz 054c47a5f4 Revert hstack usage to old method. 2021-06-14 18:47:34 -04:00
gmierz e42f954439 Add histogram optimizations. 2021-06-14 18:34:19 -04:00
Mike Conley 867d72c8af
Add requirements.txt for generate_side_by_side.py (#3) 2021-04-22 13:24:14 -04:00
gmierz 0d4c3807ac Add tabular summary, moving average, and csv file output. 2021-04-14 16:35:00 -04:00
gmierz eace954d78 Remove --compare-browsers option. 2021-04-14 12:09:33 -04:00
gmierz 48e6e5506e Use numpy-only geomean method. 2021-04-14 11:21:36 -04:00
gmierz 288cb553cc Add pageload summary script. 2021-04-14 08:30:40 -04:00
gmierz b355731bc6 Remove orange frames from the videos. 2021-01-06 15:18:15 -05:00
gmierz 9602a5961a Add --most-similar option, and make side-by-side videos fps constant at 60fps. 2020-12-17 11:46:16 -05:00
gmierz 341ccdecb3 Add timestamp overlay to before/after videos. 2020-11-08 13:47:36 -05:00
gmierz e4b8be3bb8 Allow comparisons between different browsers, and gather cron tasks. 2020-11-07 11:28:47 -05:00
gmierz de880d42e5 Allow using try revisions. 2020-11-06 16:07:56 -05:00
gmierz b49a379e6b Update branch changes. 2020-11-06 15:45:56 -05:00
gmierz 8628322e17 Correct the README. 2020-11-06 15:08:30 -05:00
gmierz 5a39599435 Add browsertime comparison script and update README. 2020-11-06 15:07:15 -05:00
Gregory Mierzwinski c5e26fac88
Merge pull request #1 from mcomella/ni-update-applink-script
No issue: update fenix-retrieval script for easier usage
2020-09-21 13:16:29 -04:00
Michael Comella 2b9bd43b65
No issue: add README with easy defaults. 2020-09-18 15:00:47 -07:00
Michael Comella 3f0571c420
No issue: add license. 2020-09-18 15:00:36 -07:00
Michael Comella 0ed082a468
No issue: add .gitignore w/ *.csv; remove existing CSV. 2020-09-18 14:56:06 -07:00
Michael Comella 7561afe3e6
No issue: add ability to output one median value per day.
This may help with debugging noise.
2020-09-18 14:55:47 -07:00
Michael Comella 0651f24d17
No issue: print human-readable CSV in addition to data CSV. 2020-09-18 14:29:04 -07:00
Michael Comella 426b56dfb5
No issue: change x axis to dates instead of epoch time. 2020-09-18 14:24:32 -07:00
Michael Comella 23de82d1b3
No issue: make default median, changing to --replicates arg.
Printing the median by default is a more intuitive default behavior.
2020-09-18 13:53:19 -07:00
Michael Comella b660a0f691
No issue: change default test to view.
Around Jul 31, 2020, the test name changed.
2020-09-18 13:49:46 -07:00
Michael Comella e71336891e
No issue: change python path to allow venv support in generate_applink_data. 2020-09-18 13:42:57 -07:00
gmierz ae86096476 Gather replicates instead of medians by default. 2020-06-18 19:11:18 -04:00
gmierz facdc042d0 Add ability to include fenix try data with --try. 2020-06-18 07:04:41 -04:00
gmierz a26f594c57 Reformat file. 2020-06-17 22:40:27 -04:00
gmierz 68bc835695 Add simple plotting to fenix data. 2020-06-17 22:37:51 -04:00
gmierz a53aae5dfe Add ability to get retriggers. 2020-06-17 22:23:07 -04:00
gmierz 5ddd1fc21d Add fenix CSV generation script. 2020-06-17 20:10:42 -04:00
gmierz 7e59a23ef8 Enable finding tests with unknown platforms. 2020-04-15 17:16:07 -04:00