Граф коммитов

32 Коммитов

Автор SHA1 Сообщение Дата
Tom Prince 2819b8db83 Bug 1403131: [mozharness] Run lint against tests; r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D10250

--HG--
extra : moz-landing-system : lando
2018-10-30 17:02:10 +00:00
Tom Prince a8d5331c0b Bug 1502531: [mozharness] Move `abs_upload_dir` code to openh264_build script; r=Callek
That variable, and the function that references it is only used by the openh264
code, so move it there.

Differential Revision: https://phabricator.services.mozilla.com/D9967

--HG--
extra : moz-landing-system : lando
2018-10-29 13:32:10 +00:00
Tom Prince 8626b0ef89 Bug 1502531: [mozharness] Stop needlessly copying around mozharness logs; r=Callek
Taskcluster knows where mozharness generates the logs, and can upload them from
there. Thus, mozharness no longer needs to copy the logs to a new directory.

Differential Revision: https://phabricator.services.mozilla.com/D9966

--HG--
extra : moz-landing-system : lando
2018-10-29 13:29:24 +00:00
Tom Prince d3a0a50592 Bug 1494091: [mozharness] Remove unused rsync support from mozharness; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D6836

--HG--
extra : moz-landing-system : lando
2018-10-02 18:29:19 +00:00
Tom Prince af8a4dd641 Bug 1494091: [mozharness] Remove unused binary transparency code; r=Callek
This code duplicates code in https://github.com/mozilla-releng/binary-transparency/
which is what we'd use if this work is picked up again.

Differential Revision: https://phabricator.services.mozilla.com/D6832

--HG--
extra : moz-landing-system : lando
2018-10-02 17:31:47 +00:00
Tom Prince efb1a949f6 Bug 1494091: [mozharness] Remove unused release/updates.py script; r=Callek
This has been replaced by scriptworkers and update-verify tasks.

Differential Revision: https://phabricator.services.mozilla.com/D6823

--HG--
extra : moz-landing-system : lando
2018-10-01 20:57:26 +00:00
Chris AtLee 444afb9092 Bug 1237182: Remove BuildbotMixin in favour of AutomationMixin r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D1371

--HG--
rename : testing/mozharness/test/test_mozilla_buildbot.py => testing/mozharness/test/test_mozilla_automation.py
extra : rebase_source : 2fdec7a8b06c1b29ea47de1b368c08d9b8b75c3e
2018-05-16 12:51:37 -04:00
Chris AtLee e3d628f8c0 Bug 1237182: Remove mozharness blobber mixin r=mtabara
--HG--
extra : rebase_source : 3a631d554fdd143aa5e06903c067b1907f40a82f
extra : source : aedcb763d9479b484ec4f5603e0f2c4efd0c9511
2018-05-11 18:16:08 -04:00
Tom Prince 4310a06dea Bug 1434365: Specify mozconfig in L10N repacks by using parts; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D509

--HG--
extra : rebase_source : 185f46837087649c790db1ee1ce5eb5ee3ee447b
2018-01-23 15:18:32 -07:00
Tom Prince 3150b8f333 Bug 1415617: Allow specifying mozconfig in mozharness as fragments, rather than repeating the entire path everywhere. r=jlund
MozReview-Commit-ID: 9OCRoFpFw1G

--HG--
extra : rebase_source : dafc42a8f7d143715e623e177ea7c0bc6871996a
2017-10-30 17:53:51 -06:00
Sebastian Hengst bb00fb7597 Backed out changeset e1455a5d2e05 (bug 1410459) for breaking Talos. r=backout on a CLOSED TREE 2017-10-26 18:24:41 +02:00
Andrew Halberstadt afdc499bac Bug 1410459 - [mozharness] Upgrade from optparse to argparse in config.py, r=jlund
Upgrade from optparse to argparse:

1. 'type' field now needs to be callable (deleted if type was 'string' as that is the default)
2. 'extend' action re-implemented for argparse
3. 'callback' action no longer exists, re-implemented as a custom argparse action (only used in buildbase.py)
4. minor api changes, e.g 'add_option' -> 'add_argument'

MozReview-Commit-ID: HcKowF13Da3

--HG--
extra : rebase_source : e5e8160d91263fb273f790dbda5e2c2b2e02eaf6
2017-10-20 11:53:44 -04:00
Axel Hecht 84ab85f0ea bug 1399523, now that we run l10n-merge in-build, drop it from mozharness, r=Callek
MozReview-Commit-ID: 3qF0i39CYjh

--HG--
extra : rebase_source : 71465b8a634e1ddaacfddbf9a79adc925f3930b3
2017-09-15 16:25:18 +02:00
Gregory Szorc 0ce46507f1 Bug 1392700 - Initialize repository using latest requirements; r=aki
We use `hg init` to create the directory. Because this is what
typically occurs.

We also remove the disabling of "dotencode" in the hgrc. This was added
in https://hg.mozilla.org/build/mozharness/rev/b1dbc0f56ff8 (bug 857853)
for reasons that are unclear to me. We should never disable dotencode
because it may make some repositories not clonable on Windows
filesystems.

Disabling dotencode will also interfere with the latest version of
robustcheckout, which requires its presence.

MozReview-Commit-ID: 35qBsgwp0uW

--HG--
extra : rebase_source : b786fb38f6b09da9614ac40f5de8231b8305bf5d
2017-08-22 10:34:29 -07:00
Gregory Szorc ca394488d5 Bug 1330837 - Remove functionality to apply and push; r=aki
Tests based on this code fail in Mercurial 3.8+ due to `hg rebase`
changing its behavior for selecting default revisions. I was going
to update the code to work with 3.8+. However, I could find no actual
consumers of this method! Annotate says this was added back in
mozharness 0.4. However, I can't find a reason for it being added.
Nor can I find any consumers of this method in the mozharness repo
outside the tests. This smells like dead code to me.

MozReview-Commit-ID: 3Q6MTjQJT1p

--HG--
extra : rebase_source : 2c488b70136bc9856f6075297d7c32e3b69079ad
2017-04-11 14:23:00 -07:00
Richard Barnes b698283963 Bug 1346359 - Script to submit transparency certs to CT r=rail
MozReview-Commit-ID: F8uPgoJTFr

--HG--
extra : rebase_source : d45e3db6ff3836057cb3934d2e8d2956f715c8c8
2017-03-10 17:48:37 -05:00
Richard Barnes 26b4bd2509 Bug 1342974 - Add code to generate a Merkle tree summary of a release r=arroway,catlee
MozReview-Commit-ID: COav6N88SOt

--HG--
extra : rebase_source : 7367e7a51da31a53e797e8335327a1f94599af03
2017-02-27 12:56:42 -05:00
Armen Zambrano Gasparnian 9bad2fd425 Bug 1272083 - Download and unpacking should be performed in process. r=gps
Instead of downloading a file first and then unpacking it, we would like to
fetch it into memory and then unpacking directly from there.

This saves writing the file first to disk, thus, saving on IO.

MozReview-Commit-ID: JdNGnxIYEvy

--HG--
extra : rebase_source : 73c280fd23f3066d04dd3af07ac443db77dfd6d0
2016-08-25 11:04:16 -04:00
Henrik Skupin a96b6591d4 Bug 1258539 - [mozharness] Use ZipFile and TarFile classes for unpacking archives. r=jlund
Get rid of external unpack tools (unzip and tar) and use the Python internal classes instead.
This patch only changes this behavior for the base script class but not for custom code in other
test scripts and modules, which would make it too complex. A follow-up bug will be filed instead.

MozReview-Commit-ID: L0eoITlqTdC

--HG--
extra : rebase_source : c8bb3447bece192d6d8cbf3f505f840ec2843112
2016-01-18 19:50:26 +01:00
Wes Kocher 05520e44a5 Backed out 2 changesets (bug 1258539) for winxp pgo talos g2 permafail a=backout CLOSED TREE
Backed out changeset 4939f5d5c16c (bug 1258539)
Backed out changeset 384ff6b4b109 (bug 1258539)
2016-08-05 14:04:56 -07:00
Henrik Skupin 94b537df45 Bug 1258539 - [mozharness] Use ZipFile and TarFile classes for unpacking archives. r=jlund
Get rid of external unpack tools (unzip and tar) and use the Python internal classes instead.
This patch only changes this behavior for the base script class but not for custom code in other
test scripts and modules, which would make it too complex. A follow-up bug will be filed instead.

MozReview-Commit-ID: L0eoITlqTdC

--HG--
extra : rebase_source : 3cda5a442ea25f1098949b7c1a80428188355e7a
2016-01-18 19:50:26 +01:00
Wes Kocher e92959a3bd Backed out 2 changesets (bug 1258539) for mozharness failures a=backout
Backed out changeset 8322ffecd9d9 (bug 1258539)
Backed out changeset cc2996a53b71 (bug 1258539)
2016-07-29 15:56:39 -07:00
Henrik Skupin d8e13f44b1 Bug 1258539 - [mozharness] Use ZipFile and TarFile classes for unpacking archives. r=jlund
Get rid of external unpack tools (unzip and tar) and use the Python internal classes instead.
This patch only changes this behavior for the base script class but not for custom code in other
test scripts and modules, which would make it too complex. A follow-up bug will be filed instead.

MozReview-Commit-ID: L0eoITlqTdC

--HG--
extra : rebase_source : 5c9f04c29eddea09f2bbac18d9fc491671b1ccdf
2016-01-18 19:50:26 +01:00
Gregory Szorc 802fda3e66 Bug 1270317 - Use robustcheckout extension for checking out Mercurial repos; r=jlund
Functionality for doing an optimal clone/pull+share+purge+update is now
implemented in the robustcheckout extension so it can be implemented in one
place and used by all the various tools needing to perform a "robust"
checkout using optimal practices.

This commit switches the MercurialVCS to use it.

Functionality for interfacing with shared repos and associated tests have
been removed because this is all implemented and tested in robustcheckout.

Various other tests have also been removed because they are redundant with
tests in the robustcheckout extension.

MozReview-Commit-ID: FGvmSHKM5e0

--HG--
extra : rebase_source : 8f31a1e79d448478fa63b17582313409ac06fe69
extra : histedit_source : 3031dd8f83b0c64abc110252fd270f1917168663
2016-05-16 16:56:14 -07:00
Carsten "Tomcat" Book 5257224b2f Backed out changeset 86fccb7da8ac (bug 1270317) 2016-05-09 12:34:04 +02:00
Gregory Szorc 9bda169114 Bug 1270317 - Use modern, optimal cloning in MercurialVCS.ensure_repo_and_revision(); r=jlund
The code for ensure_repo_and_revision() has been completely overhauled.

We now require shared repos using auto pooled storage via the share
extension. This ensures that only a single copy of a logical
repository's history is stored on disk. e.g. if you clone
mozilla-central, inbound, and try, they'll all automatically share the
same storage.

The new code ensures the destination repo is using modern conventions
and will delete the destination repo if it isn't. So once this gets
deployed to production, machines will slowly start using optimal
storage. This should make VCS operations significantly faster.

Another optimization that is now in here is we check for presence of the
wanted revision before doing `hg pull`. This saves some communication
with the server if the revision is already present locally.

This change effectively requires a modern version of Mercurial to be
installed to run ensure_repo_and_revision(). Since Mercurial <3.7.3 has
security vulnerabilities, we shouldn't be running <3.7.3 in automation.
So I think this will be OK. If not, it will certainly be easy to
identify which machines aren't updated!

MozReview-Commit-ID: 62jtAsDj7rU

--HG--
extra : rebase_source : a43d7f54b16e71940e45ddf05402449575fccfee
2016-05-06 10:57:28 -07:00
Rail Aliiev 942056deee Bug 1210539 - Add "updates" builder to release promotion task r=jlund DONTBUILD a=release
--HG--
rename : testing/mozharness/mozharness/mozilla/merge.py => testing/mozharness/mozharness/mozilla/repo_manupulation.py
extra : rebase_source : c8a8a2891fcdc50111e497acd33262c295da1ba2
2016-02-19 12:53:03 -08:00
Carsten "Tomcat" Book 6244cfb10e Backed out changeset 200da85932e9 (bug 1230862) for valgrind perma failures 2016-02-10 11:04:50 +01:00
Julien Pagès cb348f4346 Bug 1230862 - Remove mozhttpd. r=wlach
--HG--
extra : commitid : HRDp24nhYo8
extra : rebase_source : 76443fa9938e488fcd06af7ba0676d491c9da36e
2016-02-09 03:26:43 +01:00
Aki Sasaki 081f08c2ae bug 1244781 - mozharness has 3 post_run listeners now. r=jlund
--HG--
extra : histedit_source : ce94bf5ad5e3abe96ec3c75839ed581af134a487
2016-02-02 14:11:05 -05:00
Mike Shal 115ca1ae64 Bug 1192068 - Use long hg revision for sourcestamp in mozharness; r=gps,jlund 2015-08-06 15:39:38 -04:00
Jordan Lund 8405b45930 Bug 1154796 - make a copy of mozharness and put it in gecko tree, based on 4d855a6835ed, r=mshal 2015-07-03 09:04:58 -07:00