gecko-dev/testing/mozbase
Andrew Halberstadt 26e9db86f8 Bug 1583353 - [taskgraph] Implement test chunking in transforms r=gbrown
We've long handled chunks by defining the total number of chunks in our CI
configuration, and then passing that value down into the test harnesses at task
runtime (via the '--this-chunk' and '--total-chunks' parameters).  The test
harness then runs an algorithm to determine which tests should be run in "this"
chunk.

There are several problems with this approach, but by far the biggest is that
we can't use test information in our scheduling algorithms. The information
simply isn't available yet. This patch switches things around such that we
determine which tests go in which tasks during the taskgraph generation. This
means we have perfect information around which tasks are running which tests,
and if e.g a ccov or machine learning algorithm deems a particular test
important, we can make sure to *only* schedule the tasks that contain that
test.

I'm planning to enable this a couple suites at a time so we don't accidentally
stop running tests. This specifically only enables this mode for
'mochitest-media', 'mochitest-browser-chrome' and 'mochitest-devtools-chrome'.
I chose these suites because they are the ones that are already using the
'chunk_by_runtime' algorithm.

Differential Revision: https://phabricator.services.mozilla.com/D52729

--HG--
extra : moz-landing-system : lando
2019-12-11 21:10:48 +00:00
..
docs Bug 1589056 - [mozlog] introduce PRECONDITION_FAILED status r=jgraham 2019-10-24 08:34:35 +00:00
manifestparser Bug 1583353 - [taskgraph] Implement test chunking in transforms r=gbrown 2019-12-11 21:10:48 +00:00
mozcrash Bug 1594998 - Make standalone SpiderMonkey use libxul-like panic. r=froydnj 2019-11-15 13:14:42 +00:00
mozdebug Bug 1600771 - turn on --show-mismatched-frees=no for valgrind tests; r=jseward 2019-12-03 13:32:27 +00:00
mozdevice Bug 1600713 - Grant FOREGROUND_SERVICE permission to android test apps; r=bc 2019-12-02 23:17:40 +00:00
mozfile Bug 1582248 - Bump mozfile to version 2.1.0 r=ahal 2019-09-18 21:11:00 +00:00
mozhttpd
mozinfo Bug 1595220 - streamline and sanitize output of distro/platform linux_distribution call in mozinfo r=jmaher 2019-11-13 19:42:41 +00:00
mozinstall Bug 1587206 - [lint.flake8] Enable F632 across the tree, r=sylvestre 2019-10-10 18:50:33 +00:00
mozleak Bug 1598787 - Rename XRE_ChildProcessTypeToString to XRE_GeckoProcessTypeToString. r=froydnj 2019-11-25 22:45:31 +00:00
mozlog Bug 1589056 - [mozlog] Update mozlog version number to 5.0 r=jgraham 2019-10-24 14:12:32 +00:00
moznetwork Bug 1428711 - add python3 compatibility to moznetwork r=ahal 2019-11-15 22:45:12 +00:00
mozpower Bug 1578487 - Add frequency and watts metric to mozpower IPG output. r=stephendonner 2019-10-31 15:59:10 +00:00
mozprocess Bug 1585702 - [mozprocess] Fix "Embedded null character" error in Windows with Python 3, r=gbrown 2019-10-04 17:46:38 +00:00
mozprofile Bug 1589056 - [mozprofile][mozrunner][mozrunner] bump minor versions r=jgraham 2019-10-25 13:15:01 +00:00
mozproxy Bug 1585456 - [mozproxy] Error out when mozproxy can't bind to port r=tarek,perftest-reviewers,davehunt 2019-12-11 10:07:28 +00:00
mozrunner Bug 1599534 - Update help and version names for 'mach android-emulator'; r=erahm 2019-12-10 23:07:59 +00:00
mozscreenshot Bug 1428715 - Create setup.cfg for universal wheels in mozscreenshot. r=ahal 2019-09-24 05:59:57 +00:00
mozsystemmonitor Bug 1587715 - Fix TypeError when submitting build telemetry without cpu_percent present. r=dmajor 2019-10-16 04:01:26 +00:00
moztest Bug 1600314 - [manifestparser] Make 'ancestor_manifest' a relative path, r=gbrown 2019-12-02 21:19:45 +00:00
mozversion Bug 1589056 - [mozprofile][mozrunner][mozrunner] bump minor versions r=jgraham 2019-10-25 13:15:01 +00:00
rust Bug 1601544 - Upgrade mozversion to semver 0.9. r=whimboo 2019-12-05 09:21:58 +00:00
README.md
moz.build Bug 1567954 - Part 1: Initialize Mozpower module and implement PowerBase class. r=perftest-reviewers,ahal,rwood 2019-08-01 20:36:00 +00:00
packages.txt Bug 1567954 - Part 1: Initialize Mozpower module and implement PowerBase class. r=perftest-reviewers,ahal,rwood 2019-08-01 20:36:00 +00:00
setup_development.py Bug 1567642 - [mozbase] Fix flake8 under py3 lint errors r=gbrown 2019-09-09 23:55:32 +00:00
versioninfo.py

README.md

Mozbase

Mozbase is a set of easy-to-use Python packages forming a supplemental standard library for Mozilla. It provides consistency and reduces redundancy in automation and other system-level software. All of Mozilla's test harnesses use mozbase to some degree, including Talos, mochitest, and reftest.

Learn more about mozbase at the project page.

Read detailed docs online, or build them locally by running "make html" in the docs directory.

Consult open bugs and feel free to file new bugs.