Граф коммитов

69 Коммитов

Автор SHA1 Сообщение Дата
Brad Fitzpatrick de72d46c6c build: move Linux and nacl builders to Kubernetes, add ssacheck trybot
And shard the nacl builders.

Fixes golang/go#15242
Fixes golang/go#12546

Change-Id: I3311678dbb64a76026f75f5691cffac0f25d976b
Reviewed-on: https://go-review.googlesource.com/22780
Reviewed-by: Andrew Gerrand <adg@golang.org>
Reviewed-by: Ross Light <light@google.com>
2016-05-04 23:30:26 +00:00
Brad Fitzpatrick 30761a084e dashboard: add test buildlet config for Oracle Solaris
Updates golang/go#15072

Change-Id: I4e02556429ac65d521e6d01687232c1412d078fb
Reviewed-on: https://go-review.googlesource.com/21766
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-04-08 19:46:07 +00:00
Brad Fitzpatrick 874eda751f cmd/coordinator: re-enable Kubernetes in staging
Change-Id: I06ac00b8be9717adf0add3f82e3663883825283a
Reviewed-on: https://go-review.googlesource.com/21761
Reviewed-by: Evan Brown <evanbrown@google.com>
2016-04-08 18:55:09 +00:00
Brad Fitzpatrick 5f6e05435c dashboard: add arm64 buildlet, update ppc64 buildlet definition
Change-Id: I25c6de0f97c3338f9d32f4125b2c7c68c3f3c13c
Reviewed-on: https://go-review.googlesource.com/21656
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2016-04-07 20:45:49 +00:00
Brad Fitzpatrick 011a895a63 cmd/coordinator/buildongce, dashboard: fix basepin creation, add NetBSD
Updates golang/go#8643

Change-Id: I031ffb52537500c52df34f54552296c61dc2df10
Reviewed-on: https://go-review.googlesource.com/21493
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-04-04 23:26:30 +00:00
David du Colombier 77ef5db46c dashboard: use Go 1.6 to bootstrap Go on Plan 9
On the Plan 9 builder, we are experiencing regular
failures in cmd/compile when building go_boostrap.

We suspect the failures to be related to a bug in
the Go 1.4 runtime. This is affecting the cmd/compile
program, since it has been built with Go 1.4 and
linked with the Go 1.4 runtime.

Updates golang/go#14650

Change-Id: I78729c8660314be381d7b668810c6f64214f2358
Reviewed-on: https://go-review.googlesource.com/21411
Reviewed-by: Richard Miller <millerresearch@gmail.com>
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-04-01 22:43:33 +00:00
Andrew Gerrand 8e28dc9fa6 dashboard: rename Go14URL to goBootstrapURLTmpl and provide accessor
Also update all users, and rename another template field.
Includes changes to coordinator, gomote, and release.

Change-Id: I1c4408eadbcb83d61063a910dfa18cc395952bc2
Reviewed-on: https://go-review.googlesource.com/20976
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-03-21 22:19:10 +00:00
Keith Randall a04c8136b9 dashboard: add SSA check builder
Now that SSA checks are off by default, let's run a builder with the
checks on just to make sure they keep passing.

Change-Id: I7edd2a2865681a135ccf755be7a14f8645c0a8aa
Reviewed-on: https://go-review.googlesource.com/20882
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-03-21 08:22:19 +00:00
Evan Brown a731151878 all: consolidate configuration for coordinator and gomote
buildenv.Environment type defines configuration options:

- Coordinator uses the GCE project name to lookup config. A custom
  config name can be provided at runtime to override.

- The conventional prod and stage project names ('symbolic-datum-552'
  and 'go-dashboard-dev') map to prod and staging configuration structs.

- Production and staging status is explicitly defined in configuration.

- GCS bucket names for buildlet, logs, and snapshots are
  configurable.

Change-Id: I7e6d7874eb0bdfe35dbdd5fcf6212ab50d576b88
Reviewed-on: https://go-review.googlesource.com/19502
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-03-04 22:24:11 +00:00
Bryan Chan 2de28ddc9f dashboard: fix bootstrap path for s390x builder
Change-Id: I8d28dfdb18da11e64cd94c7d205990f64793fcc6
Reviewed-on: https://go-review.googlesource.com/20168
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-03-03 21:45:50 +00:00
Brad Fitzpatrick c2a36fd3fd dashboard: add solaris, ppc64le, s390x reverse buildlets
Change-Id: I5061ae1da7884ed82786e8a042e966ccbe423e89
Reviewed-on: https://go-review.googlesource.com/20135
Reviewed-by: Andrew Gerrand <adg@golang.org>
2016-03-03 05:01:50 +00:00
Brad Fitzpatrick 1b6633d251 dashboard: disable Kubernetes builders
Updates golang/go#14112

Change-Id: Ie45029e27d8d8ce421135cc0e38f7019965bfa34
Reviewed-on: https://go-review.googlesource.com/18990
Reviewed-by: Andrew Gerrand <adg@golang.org>
2016-02-01 23:44:42 +00:00
Evan Brown 6cd016f230 all: upgrade nacl builders to pepper_44 and Kube
Updates golang/go#12379

Change-Id: I40bd6e37953bc509f557ff295374b51de550726c
Reviewed-on: https://go-review.googlesource.com/18946
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-01-26 23:40:15 +00:00
Brad Fitzpatrick 11a8ff01ba dashboard: set GOHOSTARCH=386 for the darwin-386 builder
Fixes golang/go#14083

Change-Id: I9db36e669c868d66c1f629636fb08e45f3d63d7c
Reviewed-on: https://go-review.googlesource.com/18872
Reviewed-by: Andrew Gerrand <adg@golang.org>
2016-01-25 20:07:05 +00:00
Joel Sing fa600bf9ec env: update openbsd-{386,amd64} builder images to OpenBSD 5.8
OpenBSD 5.8 is the current release and OpenBSD 5.6 is no longer supported.

Revise build script:

- Use the auto installer and disklabel templates built into later versions of
  OpenBSD, rather than entirely using expect.

- Rather than duplicating the entire script for openbsd-386, provide an ARCH
  environment variable that switches between openbsd/amd64 and openbsd/i386.
  Have the openbsd-386 script invoke the openbsd-amd64 script with the
  appropriate environment.

- Remove the 'ignore classless-static-routes' option for dhclient, as it is
  no longer needed for OpenBSD 5.7 and later.

- Clean up after ourselves, rather than leaving a bunch of temporary files
  lying around.

Updates issue golang/go#13029.

Change-Id: Ic1b11dd5eded317b7be32b8f1c2485617ac02b78
Reviewed-on: https://go-review.googlesource.com/18358
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-01-24 22:52:53 +00:00
Shenghou Ma 465e286ac1 dashboard: test linux-mips* for the misc-compile trybot
Change-Id: I6b0965ba621f6b12d62da9c997d1d27e5e695d72
Reviewed-on: https://go-review.googlesource.com/18688
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-01-19 04:43:01 +00:00
Joel Sing f861cc1a84 dashboard: run freebsd 386 builder with GOHOSTARCH=386
The freebsd 386 builder is run on a FreeBSD amd64 host - without
GOHOSTARCH=386 this is generating a 64-bit tool chain with a 32-bit
runtime and disabling cgo. The previous issue with this configuration
is fixed with https://golang.org/cl/18420.

Fixes #13873.

Change-Id: I3ceef59055c5409773eab06f3980277854c61e89
Reviewed-on: https://go-review.googlesource.com/18421
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2016-01-08 15:49:53 +00:00
Evan Brown 08b68a97c7 all: run dev coordinator locally, allow debug in prod
* flag allows debug (trigger a build) in prod mode
* use default zone (us-central1-f) in staging
* compute.CloudPlatformScope satisfies compute and storage scope
  requirements
* new buildlet for linux-amd64 on Kubernetes

Updates golang/go#12546

Change-Id: I1a0cbc0e0c0552b7ac56943c646378194508d48f
Reviewed-on: https://go-review.googlesource.com/17102
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-11-20 18:13:27 +00:00
David Crawshaw 1a1fe1ee32 dashboard/builders: android 386, amd64, and arm64
Change-Id: Idebe8a08415ac57a67428509c837cc4befe2e8da
Reviewed-on: https://go-review.googlesource.com/17079
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-11-20 17:39:39 +00:00
Brad Fitzpatrick efae87d7f0 cmd/coordinator: disable OS X test sharding for now
Workaround until the Mac failures are understood.

Updates golang/go#12979

Change-Id: I15b9ea8f4b708ebf9b7c6ad61e65d0f9eaaa6d73
Reviewed-on: https://go-review.googlesource.com/16440
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-10-28 17:44:13 +00:00
Brad Fitzpatrick 3cd172357e cmd/coordinator: misc kubernetes fixes
Change-Id: I26a0d86565150567db3bea73117aa0c46001b88f
Reviewed-on: https://go-review.googlesource.com/15252
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-01 22:09:15 +00:00
Brad Fitzpatrick 1288e6653a dashboard: use sharded test helpers for freebsd-386-gce101
It's a trybot, but was only using a single machine, making it the long
tail and slowing down trybot results.

Change-Id: I09ccc56b3866d522e4abf96215a2e293aed4e4d6
Reviewed-on: https://go-review.googlesource.com/14954
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-09-24 16:29:38 +00:00
Brad Fitzpatrick 1f0d8f287c all: tons of builder work
* reverse buildlet rework (multiplexed TCP connections, instead
  of a hacky reverse roundtripper)

* scaleway ARM image improvements

* parallel gzip implementation, which makes things ~8x faster on
  Scaleway.

* merge watcher into the coordinator, for easier deployments

Change-Id: I55d769f982e6583b261435309faa1f718a15fde1
Reviewed-on: https://go-review.googlesource.com/12665
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-15 08:28:33 +00:00
Brad Fitzpatrick 6925ce80a1 cmd/coordinator: start of a Kubernetes buildlet pool
Updates golang/go#12546

Change-Id: Ia70baeb1df441509f70c77e7b94e7eb9fddccbf3
Reviewed-on: https://go-review.googlesource.com/14392
Reviewed-by: Evan Brown <evanbrown@google.com>
2015-09-08 22:31:58 +00:00
David Crawshaw 953e8694af dashboard: use androidtest.bash for android builds
Change-Id: I4763f6a572bf62ada3fde44b9fcb099d9539c7d0
Reviewed-on: https://go-review.googlesource.com/14270
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-03 20:02:50 +00:00
David du Colombier 6ff9135a04 dashboard: run Plan 9 builder on n1-highcpu-4
Updates golang/go#12032.

Change-Id: I7239115b2e0e55f7fc1e5cdf24aa7e314f3bddac
Reviewed-on: https://go-review.googlesource.com/13077
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-08-05 22:59:41 +00:00
Andrew Gerrand 61344adbf9 dashboard: fix build
Change-Id: I9c6a8f554a8bc591b0bab2809c529fad26bcd701
Reviewed-on: https://go-review.googlesource.com/13121
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-08-04 02:44:10 +00:00
Andrew Gerrand cae837b68c cmd/coordinator: set GO_BUILDER_NAME env var when exec'ing on buildlet
This will allow tests to identify that they are running on the
continuous build infrastructure and run extra and/or different tests.

Fixes golang/go#11346

Change-Id: Iafe25babc764b7e012c05f0b62331b11690bf194
Reviewed-on: https://go-review.googlesource.com/13120
Reviewed-by: Russ Cox <rsc@golang.org>
2015-08-04 02:42:17 +00:00
David Crawshaw e29c0bb47c dashboard: add android-arm, darwin-386 buildlets
Change-Id: I2712da649a39db442960dc02e75342dba4dce7c3
Reviewed-on: https://go-review.googlesource.com/12520
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-07-28 12:48:24 +00:00
Andrew Gerrand a4d1a8a64a dashboard: remove obsolete SplitMakeRun exception
We solved the mentioned issue when we got cmd/release working.

Fixes golang/go#11812.

Change-Id: I163f6757c5e930629fb8b840701e9e3ce7edf3cf
Reviewed-on: https://go-review.googlesource.com/12754
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-07-28 07:40:43 +00:00
Brad Fitzpatrick a5383ffaa1 cmd/coordinator: shard linux race builder
Fixes golang/go#11074

Change-Id: I9401122e4d7febd3e38a80be89fcb2e03969f383
Reviewed-on: https://go-review.googlesource.com/11168
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-07-03 20:18:58 +00:00
Andrew Gerrand af7d181ea0 dashboard: build sub-repos on more builders
Change-Id: I57c12f427448281d71b8507ed950038209134143
Reviewed-on: https://go-review.googlesource.com/10915
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-06-11 17:37:02 +00:00
Andrew Gerrand 234725beb8 cmd/coordinator: build sub-repositories
Fixes golang/go#9506

Change-Id: Iebfb52386b5ba3df7d058f266e227d634d210ec6
Reviewed-on: https://go-review.googlesource.com/10732
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-06-10 16:27:33 +00:00
Brad Fitzpatrick 1b1e086fd1 buildlet, cmd/coordinator: GCE quota accounting, fixes
And deal with Preemptible resource exhaustion errors.

And change all-compile to misc-compile and only do the builders
not covered otherwise (Fixes #11073)

And make the watcher serve git source.

And cache and singleflight fetching of git source.

And a million other things.

Fixes golang/go#11073

Change-Id: I0f45610f0c6a06bd0c8ba9632b8624e00aeb52fc
Reviewed-on: https://go-review.googlesource.com/10750
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-06-08 22:21:00 +00:00
Brad Fitzpatrick 79f3fc0823 cmd/coordinator: test sharding, better status, logs
Also gomote updates which came about during the process of developing
and debugging this.

Change-Id: Ia53d674118a6b99bcdda7062d3b7161279b6ad52
Reviewed-on: https://go-review.googlesource.com/10463
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-06-04 20:33:49 +00:00
Brad Fitzpatrick 7d9b0367e9 dashboard, cmd/coordinator: only split make & run for builders where it'll work
Change-Id: I1fdc27ea4adcc83fbd736d2bd1a34a07ca36a50c
Reviewed-on: https://go-review.googlesource.com/10423
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-27 19:21:10 +00:00
Andrew Gerrand fb774889dc cmd/coordinator, dashboard: split build into 'make' and 'run' steps
Change-Id: Ib60a601ef21163d5e0d1fed3a2609d9b719c616a
Reviewed-on: https://go-review.googlesource.com/10073
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-21 05:57:28 +00:00
Andrew Gerrand 717160018b cmd/coordinator, dashboard: be aware of the dev cluster
Change-Id: Ia235856624fa1d5aac4d839bd946c06d957e8401
Reviewed-on: https://go-review.googlesource.com/10130
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-18 05:05:02 +00:00
Brad Fitzpatrick 2e02091674 dashboard: fix regexps describing ARM trybot test sharding
Whoops.

Change-Id: Iddaf0a623c842f95c27629d67246483a842bf4ca
Reviewed-on: https://go-review.googlesource.com/10145
Reviewed-by: Minux Ma <minux@golang.org>
2015-05-16 01:48:52 +00:00
Brad Fitzpatrick ac39ba8218 dashboard, cmd/coordinator: sharded ARM trybot-only builders
This is a quick & hacky version of our eventual sharding plan.  Later
we want to run make.bash once, snapshot it, and then intelligently
schedule all the tests out over N machines (starting with the built
snapshot), giving each the next test to run as they become idle.
And then we want to stitch together all of their output.

But this CL just makes 6 ARM builders, each of which runs make.bash (4
minutes) and then each which runs a statically-configured subset of
the tests. Based on measurements, each should run between 8.2 and 10.6
minutes. We can break up some of the larger test cases later into more
shardable pieces (in particular: "test").

Update golang/go#10029

Change-Id: Ib3e008b61ce6f28d799ae298c8467bf62d89e5d4
Reviewed-on: https://go-review.googlesource.com/10056
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-14 22:44:22 +00:00
Brad Fitzpatrick eb52e71587 dashboard, cmd/coordinator: add concept of trybot-only builders
Make all-compiler a trybot-only builder. This will be used for
temporary sharded ARM trybots.

Updates golang/go#10029

Change-Id: I6cc3188887c2f24edef97d0a9354e39553a15896
Reviewed-on: https://go-review.googlesource.com/10051
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-14 01:48:52 +00:00
Brad Fitzpatrick bab07187ed dashboard: set linux-arm-arm5 GOARM env correctly to 5 instead of arm5
Change-Id: Ie9a965f328c5cbd5b1c09d63bd1b44c2c1c73f2f
Reviewed-on: https://go-review.googlesource.com/10023
Reviewed-by: Dave Cheney <dave@cheney.net>
2015-05-13 22:31:30 +00:00
Brad Fitzpatrick 1c43756bb2 dashboard: adjust GO_TEST_TIMEOUT_SCALE for linux-arm-arm5
It's slow.

This has been running for a week but I forgot to mail the CL.

Change-Id: Ibe0646e18ffb23eb0b10d9fc0c18864bfba08a44
Reviewed-on: https://go-review.googlesource.com/9853
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-11 15:48:34 +00:00
Brad Fitzpatrick f319bb6831 dashboard: add linux-arm and linux-arm-arm5 builders
Change-Id: Ib8997f76bdf7965d34543cbb6221d6bdb25246fa
Reviewed-on: https://go-review.googlesource.com/9840
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-05-07 18:47:37 +00:00
Shenghou Ma ace75faaa6 dashboard: fix typo
Change-Id: If1fa829db594f7d78e19aae4be8c1940b12c6010
Reviewed-on: https://go-review.googlesource.com/9820
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-07 02:17:27 +00:00
David Crawshaw eef380f4e8 cmd/coordinator: generate table of builders
To replace the always-out-of-date wiki.

Change-Id: I63d56d4bcf9252e56c833eaa15656b0321ac91dc
Reviewed-on: https://go-review.googlesource.com/9571
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-01 11:31:17 +00:00
Brad Fitzpatrick 6bf0fc461b dashboard: give the all-compiler builder much more CPU
Change-Id: I171a39ed1fd874d090e5e1bc37c18a49a886f2ec
Reviewed-on: https://go-review.googlesource.com/9536
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-04-30 18:37:55 +00:00
Brad Fitzpatrick ab7ff8a1a2 dashboard: add all-compile builder
Runs buildall.bash only.

Change-Id: I1a68d54569ccb511d956c5b181e463503353d4d4
Reviewed-on: https://go-review.googlesource.com/9512
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-04-29 21:57:22 +00:00
David Crawshaw 2c91215622 dashboard: iOS rename and add notes from wiki
Updates #10617

Change-Id: I194cf7deba495e27e46d0f77bccdab9ec3fde75b
Reviewed-on: https://go-review.googlesource.com/9490
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-29 15:34:27 +00:00
David Crawshaw e078c6fb52 dashboard: add darwin-arm/arm64 buildlets
Tested by running a local coordinator on the darwin-arm64 builder.

Change-Id: Id38faaa3275d6535b897f3c65df6d01ed9c1847e
Reviewed-on: https://go-review.googlesource.com/9459
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-29 14:29:49 +00:00