Граф коммитов

340 Коммитов

Автор SHA1 Сообщение Дата
Christian Holler f80cef4fdd Bug 1507094 - Use tar.gz for gtest archive instead of zip. r=gps
Differential Revision: https://phabricator.services.mozilla.com/D12219

--HG--
extra : moz-landing-system : lando
2018-11-19 18:41:33 +00:00
Ben Hearsum 648d8a8775 bug 1490119: Build separate updater that always embeds dep certificates. r=ted,firefox-build-system-reviewers
This patch gets us building an updater binary that always embeds the dep certificates (instead of release or nightly), and builds a new tests package that includes it.

This was originally D5900, but that was backed out due to busting artifact builds. I've fixed that by removing the Makefile that Ted pointed out is unnecessary.

Differential Revision: https://phabricator.services.mozilla.com/D6418

--HG--
extra : moz-landing-system : lando
2018-09-21 10:07:27 +00:00
Ahilya Sinha 8f5e322404 Bug 1473915 - Set up infra so we can move the wpt-manifest out of tree r=gps
Changes the wpt manifest path to the topobjdir instead so it can be moved out of tree.
Other changes so that the manifest download and update, and |mach wpt| and |mach test <wpt-test>| work with the new path.
The manifest is also downloaded and updated when creating the tests-archive to ensure that it exists when we run tests on TC.

MozReview-Commit-ID: Fp6UsKJjhTU

Differential Revision: https://phabricator.services.mozilla.com/D5312

--HG--
extra : moz-landing-system : lando
2018-09-20 12:07:58 +00:00
Bogdan Tara e956072fa9 Backed out changeset 96059b4f6d8a (bug 1490119) for breaking OSX builds r=bhearsum a=backout 2018-09-20 02:52:19 +03:00
Ben Hearsum 11188446df bug 1490119: Add build system bits for building dep updater. r=firefox-build-system-reviewers,mshal,rstrong
This patch gets us building an updater binary that always embeds the dep certificates (instead of release or nightly), and builds a new tests package that includes it.

I had a lot of trouble getting the test package generated correctly due to the fact that things in "_tests" won't be included for test packages that aren't "common". My fix for that isn't ideal - I'm open to something better.

Differential Revision: https://phabricator.services.mozilla.com/D5900

--HG--
extra : moz-landing-system : lando
2018-09-19 19:55:23 +00:00
shindli d8f561f92f Backed out changeset dd80de19f142 (bug 1473915) for mb failures in testing/mozbase/moztest/tests/test_resolve.py CLOSED TREE 2018-09-19 18:13:48 +03:00
Ahilya Sinha 67be437f68 Bug 1473915 - Set up infra so we can move the wpt-manifest out of tree r=gps
Changes the wpt manifest path to the topobjdir instead so it can be moved out of tree.
Other changes so that the manifest download and update, and |mach wpt| and |mach test <wpt-test>| work with the new path.
The manifest is also downloaded and updated when creating the tests-archive to ensure that it exists when we run tests on TC.

MozReview-Commit-ID: Fp6UsKJjhTU

Differential Revision: https://phabricator.services.mozilla.com/D5312

--HG--
extra : moz-landing-system : lando
2018-09-19 06:57:50 +00:00
Chris AtLee 182e3f8445 Bug 733530: Use .tar.gz for test archives r=gps
Differential Revision: https://phabricator.services.mozilla.com/D1743

--HG--
extra : moz-landing-system : lando
2018-08-01 16:00:03 +00:00
Bogdan Tara 6eafe1c00b Backed out changeset 9c75cab2e322 (bug 733530) for breaking artifact builds 2018-07-04 14:50:22 +03:00
Chris AtLee 8745339529 Bug 733530: Use .tar.gz for test archives r=gps
Differential Revision: https://phabricator.services.mozilla.com/D1743

--HG--
extra : moz-landing-system : lando
2018-07-03 18:33:02 +00:00
Rob Wood 6802d07a28 Bug 1455872 - Build support for the new raptor performance framework; r=gps
MozReview-Commit-ID: FBvXwkYfz0o

--HG--
extra : rebase_source : eb611d916d1bfda47321f6f424eeefa5598c1f83
2018-05-02 16:42:41 -04:00
Andrew Halberstadt ee69aa133e Bug 1451159 - [testing/profiles] Store profile data in actual profile look alike folders r=gbrown
This moves testing/profiles/prefs_general.js to
testing/profiles/common/user.js. It also adds an 'extensions' folder to the
common profile. Dropping extension files here will get them installed in all
test harnesses (useful for testing on try).

The idea is that all test harnesses will eventually use this 'common' profile.
We'll also create some new per harness profiles, e.g testing/profiles/mochitest
and testing/profiles/reftest. This way there will be a single location
developers can go to set preferences, both for a specific harness, and across
all harnesses.

MozReview-Commit-ID: 8sqBqLiypgU

--HG--
rename : testing/profiles/prefs_general.js => testing/profiles/common/user.js
extra : rebase_source : 72a4a4b691e93c77479c7e70647b0ca373862c51
2018-04-19 16:12:26 -04:00
Bogdan Tara b7924c2ed2 Backed out 4 changesets (bug 1451159) for linux build bustages CLOSED TREE
Backed out changeset 72926ae685af (bug 1451159)
Backed out changeset f90a99682382 (bug 1451159)
Backed out changeset 3914937893de (bug 1451159)
Backed out changeset 79931e4a2bfb (bug 1451159)

--HG--
rename : testing/profiles/common/user.js => testing/profiles/prefs_general.js
2018-05-04 00:25:56 +03:00
Andrew Halberstadt fd23fd839b Bug 1451159 - [testing/profiles] Store profile data in actual profile look alike folders r=gbrown
This moves testing/profiles/prefs_general.js to
testing/profiles/common/user.js. It also adds an 'extensions' folder to the
common profile. Dropping extension files here will get them installed in all
test harnesses (useful for testing on try).

The idea is that all test harnesses will eventually use this 'common' profile.
We'll also create some new per harness profiles, e.g testing/profiles/mochitest
and testing/profiles/reftest. This way there will be a single location
developers can go to set preferences, both for a specific harness, and across
all harnesses.

MozReview-Commit-ID: 8sqBqLiypgU

--HG--
rename : testing/profiles/prefs_general.js => testing/profiles/common/user.js
extra : rebase_source : 7599913e547533f2f57b597ad0f238c6cd391c82
2018-04-19 16:12:26 -04:00
Gregory Szorc c90d9acc4d Bug 1455143 - Generate test archives into final path; r=ted
We currently generate these to dist/ and then use upload.py to copy
them into UPLOAD_PATH. This is wasteful. Let's generate the test
archives into UPLOAD_PATH directly, if the variable is defined.

MozReview-Commit-ID: BHoxZYdxzq4

--HG--
extra : rebase_source : f6d80adb4e1eb7333f0cd3f847fd92cbb75c33bc
2018-04-19 14:21:28 -07:00
Gregory Szorc 1747b7b02f Bug 1455143 - Don't remove common test archive; r=ted
This target is a prereq for all test archives. Why we only remove a
single test archive, I don't know. We always build this test archive.
So it should always get overwritten and we don't need to remove an
existing file.

MozReview-Commit-ID: 1qd1T3w6kVT

--HG--
extra : rebase_source : ab27910a45961da636a4077952a2d67819ad701b
2018-04-18 17:34:25 -07:00
Nick Alexander 068ed9c255 Bug 1443246 - Don't sign Robocop APK during stage-package. r=gbrown
MozReview-Commit-ID: FWIrGbHqt4J

--HG--
extra : rebase_source : 79103d884f38c04a688aa082c653df0b41b58c4b
2018-03-05 11:20:16 -08:00
Gregory Szorc 7b5dac63f8 Bug 1412932 - Inline pgo-profile-run target; r=ted
It is a one-liner and doesn't need to exist in a separate make file.

MozReview-Commit-ID: 5w3eLWD0CuB

--HG--
extra : rebase_source : 15ebb63156f8b4e8d3288dfaf0d9ec2c328b5914
2017-11-07 15:06:45 -08:00
Nick Alexander 96a9c22d8b Bug 1409087 - Part 4: Remove browser JUnit 3 tests and build apparatus for {browser,background}.apk. r=Grisha,ted.mielczarek
The browser JUnit 3 test suite has never run in automation, and no
test has been added or updated since 2016.  Half of the existing
"tests" are broken on my local device.  This allows to clean several
Makefile's related to this undeveloped testing approach, which won't
be pursued post-Gradle.

MozReview-Commit-ID: 1EbGMLntuyR

--HG--
extra : rebase_source : b4751f96851a8df61c0333a3e0ade3805b280dfe
2017-11-02 16:03:00 -07:00
Kris Maglione e99cced382 Bug 1371065: Part 1 - Remove external references to the add-on SDK. r=Mossop,glandium
MozReview-Commit-ID: D5KyHcg8Ujk

--HG--
extra : rebase_source : 1a74ccb2963f2946a49c8bf720af595151b48fd1
2017-09-12 11:54:47 -07:00
Jonathan Kew 4192f89a3a Bug 1335429 - Ensure hyphenation dictionaries are included in the reftest artifact for packaged tests. r=gbrown 2017-07-19 10:10:31 +01:00
Gregory Szorc 612630dd35 Bug 1359965 - Support and generate tar.gz WPT archive; r=glandium
Several years ago there was a single zip file for all test files. Clients
would only extract the files they needed. Thus, zip was a reasonable
archive format because it allowed direct access to members without
having to decompress the entirety of the stream.

We have since split up that monolithic archive into separate,
domain-specific archives. e.g. 1 archive for mochitests and one
for xpcshell tests. This drastically cut down on network I/O
required on testers because they only fetched archives/data that
was relevant. It also enabled parallel generation of test archives,
we shaved dozens of seconds off builds due to compression being
a long pole.

Despite the architectural changes to test archive management, we
still used zip files. This is not ideal because we no longer access
specific files in test archives and thus don't care about single/partial
member access performance.

This commit implements support for generating tar.gz test archives.
And it switches the web-platform archive to a tar.gz file.

The performance implications for archive generation are significant:

before: 48,321,250 bytes; 6.05s
after:  31,844,267 bytes; 4.57s

The size is reduced because we have a single compression context
so data from 1 file can benefit compression in a subsequent file.
CPU usage is reduced because the compressor has to work less with
1 context than it does with N. While I didn't measure it, decompression
performance should also be improved for the same reasons. And of course
network I/O will be reduced.

mozharness consumers use a generic method for handling unarchiving.
This method automagically handles multiple file extensions. So as long
as downstream consumers aren't hard coding ".zip" this change should
"just work."

MozReview-Commit-ID: LQa5MIHLsms

--HG--
extra : rebase_source : 100092c2f2ff609362a724fff60f46dd6e49c94e
extra : intermediate-source : d10f5ccd882b965fcad39914f7c3c930d1301a41
extra : source : a0e257e346ccf3c1db332ec5903241f4eeb9a7ee
2017-05-08 17:19:05 -07:00
Justin Wood a14524a72d Backed out changeset d10f5ccd882b, for Nightly bustage from Bug 1359965 c#29
MozReview-Commit-ID: 6ddN0Y55Bsk
2017-05-25 09:08:54 -04:00
Gregory Szorc 74778951f0 Bug 1359965 - Support and generate tar.gz WPT archive; r=glandium
Several years ago there was a single zip file for all test files. Clients
would only extract the files they needed. Thus, zip was a reasonable
archive format because it allowed direct access to members without
having to decompress the entirety of the stream.

We have since split up that monolithic archive into separate,
domain-specific archives. e.g. 1 archive for mochitests and one
for xpcshell tests. This drastically cut down on network I/O
required on testers because they only fetched archives/data that
was relevant. It also enabled parallel generation of test archives,
we shaved dozens of seconds off builds due to compression being
a long pole.

Despite the architectural changes to test archive management, we
still used zip files. This is not ideal because we no longer access
specific files in test archives and thus don't care about single/partial
member access performance.

This commit implements support for generating tar.gz test archives.
And it switches the web-platform archive to a tar.gz file.

The performance implications for archive generation are significant:

before: 48,321,250 bytes; 6.05s
after:  31,844,267 bytes; 4.57s

The size is reduced because we have a single compression context
so data from 1 file can benefit compression in a subsequent file.
CPU usage is reduced because the compressor has to work less with
1 context than it does with N. While I didn't measure it, decompression
performance should also be improved for the same reasons. And of course
network I/O will be reduced.

mozharness consumers use a generic method for handling unarchiving.
This method automagically handles multiple file extensions. So as long
as downstream consumers aren't hard coding ".zip" this change should
"just work."

MozReview-Commit-ID: LQa5MIHLsms

--HG--
extra : rebase_source : cd029cdbbcccc1d16f03d63a5f1fdf60be5db4fd
extra : source : a0e257e346ccf3c1db332ec5903241f4eeb9a7ee
2017-05-08 17:19:05 -07:00
Wes Kocher afb7b41b84 Backed out 2 changesets (bug 1359965) for likely breaking tc nightlies a=backout
Backed out changeset a0e257e346cc (bug 1359965)
Backed out changeset ae8bce278626 (bug 1359965)

MozReview-Commit-ID: 9rGpv7CFofi
2017-05-23 12:55:35 -07:00
Gregory Szorc fbd5db6a52 Bug 1359965 - Support and generate tar.gz WPT archive; r=glandium
Several years ago there was a single zip file for all test files. Clients
would only extract the files they needed. Thus, zip was a reasonable
archive format because it allowed direct access to members without
having to decompress the entirety of the stream.

We have since split up that monolithic archive into separate,
domain-specific archives. e.g. 1 archive for mochitests and one
for xpcshell tests. This drastically cut down on network I/O
required on testers because they only fetched archives/data that
was relevant. It also enabled parallel generation of test archives,
we shaved dozens of seconds off builds due to compression being
a long pole.

Despite the architectural changes to test archive management, we
still used zip files. This is not ideal because we no longer access
specific files in test archives and thus don't care about single/partial
member access performance.

This commit implements support for generating tar.gz test archives.
And it switches the web-platform archive to a tar.gz file.

The performance implications for archive generation are significant:

before: 48,321,250 bytes; 6.05s
after:  31,844,267 bytes; 4.57s

The size is reduced because we have a single compression context
so data from 1 file can benefit compression in a subsequent file.
CPU usage is reduced because the compressor has to work less with
1 context than it does with N. While I didn't measure it, decompression
performance should also be improved for the same reasons. And of course
network I/O will be reduced.

mozharness consumers use a generic method for handling unarchiving.
This method automagically handles multiple file extensions. So as long
as downstream consumers aren't hard coding ".zip" this change should
"just work."

MozReview-Commit-ID: LQa5MIHLsms

--HG--
extra : rebase_source : 19ec875917546abc147b234a815e1a64c204b92a
2017-05-08 17:19:05 -07:00
Geoff Brown df122d5bfa Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Paul Yang 8d0339f0a5 Bug 1272113: Packaging awsy in build job r=jmaher
MozReview-Commit-ID: 9VhsVIaaWqt

--HG--
extra : rebase_source : ce4768033b0f3a912be9790b5ebe06fa6a2a0803
2017-03-11 02:33:19 +08:00
Andrew Halberstadt 8415b25e37 Bug 1003417 - Add a 'mozbase' subsuite to python unittests on linux, r=ted
The subsuite is added conditionally because we only have the capability of
running source-check tasks on linux at the moment. Once taskcluster support
for windows and mac has matured a bit and the taskcluster configs support
source-check there, we should apply the subuite unconditionally.

MozReview-Commit-ID: Kk9Irz3fn14

--HG--
extra : rebase_source : b9266a06583083c36477d4e93f5462ee614cdb71
2016-11-16 16:43:42 -05:00
Chris Manchester 996bc104f2 Bug 1331090 - Strip the gtest libxul prior to packaging. r=ted
MozReview-Commit-ID: KC3Wgn0OsSM

--HG--
extra : rebase_source : 9d3b928db62757959a094696376c3c10db1dea52
2017-01-13 16:37:55 -08:00
Chris Manchester b3946b997e Bug 1200311 - Build the gtest libxul during the compile tier instead of package-tests. r=ted
MozReview-Commit-ID: HX2ORY8cUV9

--HG--
extra : rebase_source : a5510ea1709313206bd620815f7283832fe3efee
2017-02-06 14:34:07 -08:00
Andrew Halberstadt 79791a2cff Bug 1330772 - Remove all b2g related code from reftests, r=jmaher
MozReview-Commit-ID: HY1XbcliTNA

--HG--
extra : rebase_source : f02093222f1cc619e328c877382361950f83329d
2017-01-12 16:37:37 -05:00
Mike Shal d7a8d558f6 Bug 1325197 - Add logging around mach python-test; r=gps
In bug 1308472 we are seeing 'make -k check' fail intermittently with
the only apparent error message something like:

make: *** [check] Error 245

This debug should make it more clear which test (if any) is responsible
for setting the return code in 'mach python-test', and whether or not
'mach python-test' is actually reaching the end of the function.

MozReview-Commit-ID: 6IQrZQqs8ij

--HG--
extra : rebase_source : 4d2d4b8b139d7f16bda2b22ce79ab2c84e8fe4c7
2016-12-21 11:12:55 -05:00
Andrew Halberstadt fef26faf4b Bug 1309060 - Run |mach python-test| in parallel from make check, r=gps
This duplicates code in client.mk to retrieve the number of cores. We should
probably just get the build system to define a global variable for this, but
I don't know how to do that.

MozReview-Commit-ID: CfAGbVMJXXT

--HG--
extra : rebase_source : 74fb1d1bcbeaafcde602f238a64198ff3ae6935e
2016-10-11 16:06:35 -04:00
Ryan VanderMeulen 48ef8de07d Bug 1263230 - Remove in-tree references to IPC/OOP reftest modes. r=ahal 2016-11-07 08:59:49 -05:00
Eugen Sawin 5999591289 Bug 1307886 - [1.2] Remove szip support. r=glandium 2016-10-28 12:59:23 +02:00
Wes Kocher e1ade7ef8a Backed out 8 changesets (bug 1286900) for win7vm wpt timeouts a=backout
Backed out changeset 3fff88de2f2d (bug 1286900)
Backed out changeset 748abfe6748e (bug 1286900)
Backed out changeset b4844ee1e542 (bug 1286900)
Backed out changeset bde587e47d00 (bug 1286900)
Backed out changeset a1311218621b (bug 1286900)
Backed out changeset 2de97e3cfcb3 (bug 1286900)
Backed out changeset 43df1e962f8e (bug 1286900)
Backed out changeset 6ed46e8ac86c (bug 1286900)
2016-10-04 17:17:07 -07:00
Gregory Szorc f4832137ac Bug 1286900 - Stop producing web-platform tests zip file; r=ted
Now that we access WPT related files from a source checkout, we no
longer need the web-platform tests zip file produced or consumed by
automation. So stop producing it.

MozReview-Commit-ID: Ea8KjKZJ5Yx

--HG--
extra : rebase_source : f22506a02fdd5e78434cdc5d1c1f274db1cd04e2
2016-09-20 18:41:06 -07:00
Andrew Halberstadt 6b48ddc0b0 Bug 1304593 - Use |mach python-test| to run python unittests from make check, r=ted
Currently make check loops over all directories and runs each test file in PYTHON_UNIT_TESTS
individually. This patch instead creates a single top-level check target that runs
|mach python-tests|. This should make automation more similar to running locally, be a bit
quicker and make it easier to pull python tests out of make check completely at a future date.

MozReview-Commit-ID: 4Hg4zdFyc61

--HG--
extra : rebase_source : 31d0c38a76c11b75d3bf569f2bf22a0666161726
2016-09-26 15:29:02 -04:00
Phil Ringnalda 3e7326c4fd Backed out 6 changesets (bug 1286900) for making wpt-7 permanently fail on Windows debug
CLOSED TREE

Backed out changeset 859457467e3c (bug 1286900)
Backed out changeset 4b08ed30e0a5 (bug 1286900)
Backed out changeset 3928e945b584 (bug 1286900)
Backed out changeset 5b0f69c86028 (bug 1286900)
Backed out changeset 01c3527edde5 (bug 1286900)
Backed out changeset 6b5f059a85ad (bug 1286900)
2016-09-27 18:24:38 -07:00
Gregory Szorc 13bf17ed00 Bug 1286900 - Stop producing web-platform tests zip file; r=ted
Now that we access WPT related files from a source checkout, we no
longer need the web-platform tests zip file produced or consumed by
automation. So stop producing it.

MozReview-Commit-ID: Ea8KjKZJ5Yx

--HG--
extra : rebase_source : ee6ec00689696a710faf390d3dec5c5d02d8ec74
2016-09-20 18:41:06 -07:00
Kim Moir 9334cbf678 Bug 1303590 - Remove Luciddream test suite r=aobreja 2016-09-23 09:20:54 -04:00
Henrik Skupin 401257b7ed Bug 1301334 - Package Marionette tests via moz.build entries r=gps
Move packaging for Marionette from make to test_archiver by using root manifest files.

MozReview-Commit-ID: 1cxEBYQeJ2Z
**

--HG--
extra : rebase_source : 372a407d9207bfbccbfb88c689df60b8cc1abcaf
2016-09-20 18:05:43 +02:00
Wes Kocher 4c4ea87ae0 Backed out 2 changesets (bug 1283919) for being the wrong way to fix this a=backout
Backed out changeset a328778db08d (bug 1283919)
Backed out changeset 7e1f25f59298 (bug 1283919)
2016-09-07 14:22:21 -07:00
Henrik Skupin 1aa1a59ead Bug 1283919 - Move packaging of Marionette from make to the test archiver r=gps
MozReview-Commit-ID: AOQHcA46bCh

--HG--
extra : rebase_source : e313c669ad0ae999ecba954538572d22ae28b120
2016-08-17 13:43:51 +02:00
Andrew Halberstadt a757814e36 Bug 1296067 - Add mach test package integration for marionette-test, r=armenzg
This makes it possible to run |mach marionette-test| from a test package (and therefore
also an interactive loaner).

MozReview-Commit-ID: Lxhe8KMQaWq

--HG--
extra : rebase_source : ee2c01a80d863c2044d8d30b0e5116c8a9704253
2016-08-17 12:04:37 -04:00
Wander Lairson Costa 763d526bcc Bug 1268913: Fix test for existence of objcopy. r=ted
If objcopt is not found, it is intentionaly set to semicolon. We compare
it to semicolon value for testing it for existence.
2016-05-26 10:38:58 -03:00
Chris Manchester a7138cfc10 Bug 1242051 - Install test files to the objdir lazily rather than with each invocation of mach. r=gps
This moves test installation for test files out of the monolithic install
manifest for $objdir/_tests, and determines the test and support files
to install based on the object derived from all-tests.json. Additionally,
the files resulting from TEST_HARNESS_FILES are installed, as some tests
will depend on them.

As a result, the time to install tests when invoking the test runner will
scale with the number of tests requested to run rather than the entire set
of tests in the tree, resulting in significantly less overhead.

MozReview-Commit-ID: LeIrUVh1yD4
2016-04-04 14:56:52 -07:00
Nick Alexander 9f1aa81bb1 Bug 969925 - Remove fennec_ids.txt from the build system. r=gbrown
The only consumers are in ash-mozharness, which is just out of date:

http://mxr.mozilla.org/build/search?string=fennec_ids&find=&findi=&filter=%5E%5B%5E%5C0%5D*%24&hitlimit=&tree=build

MozReview-Commit-ID: CQHmKOEUDj1

--HG--
extra : rebase_source : 9aaa83ea41b556b59968bda1f53d5bf13e3e33b2
extra : histedit_source : cc63745f29357a9fec7c014a024918db528ae40e
2016-03-24 13:48:12 -07:00
Nick Alexander e90bd4aabb Bug 1256401 - Part 2: Remove references to b2gdroid. r=fabrice
MozReview-Commit-ID: 63yJGdgPbhe

--HG--
extra : rebase_source : 2256e0a12588703a83f4cba06971231ac3c64592
extra : amend_source : 1f35a04191f37225986bd7ff4d0b6b2c34a71b05
extra : histedit_source : 82d351700936c8e1297eeca91ce00f96340e2f2c
2016-03-18 14:41:51 -07:00