Граф коммитов

716 Коммитов

Автор SHA1 Сообщение Дата
Dmitry Vyukov fc46995f27 x/build: add racebuild utility
Racebuild builds race runtime (syso files) on all supported OSes using gomote.
For now only freebsd is supported.
Usage:
	$ racebuild -rev <llvm_revision> -goroot <path_to_go_repo>
The rest should happen automatically (provided you have gomote access).

Update golang/go#8653

Change-Id: Ie9df99860616084471dc92b8dbf369020fbb8f72
Reviewed-on: https://go-review.googlesource.com/16823
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-11-12 10:42:54 +00:00
Brad Fitzpatrick a2a6908254 cmd/release: don't ship the api tool source or binary in releases
Fixes golang/go#13030

Change-Id: I3067bdc91ed33ec9f97af2c2da4f77853e10ce73
Reviewed-on: https://go-review.googlesource.com/16802
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-11-12 08:50:05 +00:00
Austin Clements 20feaba241 cmd/fetchlogs: put logs in a standard directory
Currently fetchlogs downloads logs to a directory structure created in
the current directory. This makes it difficult to run (you have to
make sure you're in the right directory) and makes it hard for other
tools (e.g., log processing tools) to find these logs.

This change adds a -dir flag to fetchlogs to specify a download
directory. The default value of this flag is derived from the cache
directory of the XDG Base Directory Specification.

Change-Id: I05f01a3db7423250cfef18c42ff38b599b097b35
Reviewed-on: https://go-review.googlesource.com/16818
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-11-11 19:52:38 +00:00
Austin Clements 892348f71f cmd/fetchlogs: new tool to download failure logs
This tool downloads build failure logs from the Go dashboard so they
can be accessed and searched from the local file system.

Change-Id: I9d3f90dd8886cb5446d2fb7276c5d24da5c9a8e3
Reviewed-on: https://go-review.googlesource.com/10671
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-11-11 19:20:50 +00:00
Brad Fitzpatrick 9a1973d19f cmd/upload: add flag for GCE project
This allows either overriding the default, or using cmd/upload for
non-builder buckets.

Change-Id: If9a242c9e5cbb4be50768870eec5705b5a265cd5
Reviewed-on: https://go-review.googlesource.com/16800
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-11-10 09:10:32 +00:00
Austin Clements cf97336113 app/build: expand JSON format output
This expands the JSON dashboard output to include everything that's
visible on the HTML dashboard (which includes all of the obviously
meaningful fields from the Commit objects).

Change-Id: Ib0437bec276a78ca9efd57fcc16041e40ccd3d4c
Reviewed-on: https://go-review.googlesource.com/16632
Reviewed-by: Andrew Gerrand <adg@golang.org>
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-11-05 16:39:53 +00:00
Evan Brown 83f9748046 all: display pool status and delete failed/old pods
* status page shows kube pool details
* pods created by the coorindator are tracked
* pods that fail to create are deleted
* pods older than delete-at are deleted
* pods created by a different coordinator are deleted

Updates golang/go#12546

Change-Id: I4c4f8ff906962b4a014a66d0a9d490ff17710d62
Reviewed-on: https://go-review.googlesource.com/16101
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-11-05 11:33:24 +00:00
Andrew Gerrand 4154d4f503 app/build, cmd/pushback: add time sub-repo
Fixes golang/go#13022

Change-Id: Ie3f3da3ae8d878949f0440610dccc22aefe1accc
Reviewed-on: https://go-review.googlesource.com/16587
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-11-03 06:57:38 +00:00
Andrew Gerrand 476aff75c5 app/build, cmd/pushback: add sync repo
Update issue golang/go#13058

Change-Id: I24e136b955e7556af2c24c25b10f6d4abb630dbd
Reviewed-on: https://go-review.googlesource.com/16506
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-30 04:29:42 +00:00
Brad Fitzpatrick efae87d7f0 cmd/coordinator: disable OS X test sharding for now
Workaround until the Mac failures are understood.

Updates golang/go#12979

Change-Id: I15b9ea8f4b708ebf9b7c6ad61e65d0f9eaaa6d73
Reviewed-on: https://go-review.googlesource.com/16440
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-10-28 17:44:13 +00:00
David Crawshaw a1a07fb139 cmd/coordinator: fix build log link for -mode=dev
Change-Id: If62e66b3ce323f368e18616c31a8aef8cf4ae2d8
Reviewed-on: https://go-review.googlesource.com/16290
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-28 14:03:06 +00:00
Brad Fitzpatrick 117ac82c42 cmd/coordinator: update package doc a bit
Change-Id: I36375e97872a06731f2f50ff6e81e21a42947145
Reviewed-on: https://go-review.googlesource.com/16401
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-10-28 04:00:55 +00:00
Brad Fitzpatrick a56d015dcb cmd/coordinator: disable plan9 builder for now
GCE broke it. GCE is being fixed, but not immediately.

Updates golang/go#13077

Change-Id: I289e382b0a4affc4fc8faee5da053474d1cabc35
Reviewed-on: https://go-review.googlesource.com/16314
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-28 01:25:40 +00:00
Matthew Dempsky d5f422f474 all: fix vet warnings
Change-Id: Ia4519d9b050136b4d46dc8361f546e3c4205a9cd
Reviewed-on: https://go-review.googlesource.com/16288
Reviewed-by: Dave Cheney <dave@cheney.net>
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-25 04:14:39 +00:00
Chris Manghane 4ec6dec7c4 cmd/coordinator: avoid ambiguous branch names
When trying to resolve a branch name, if there is a remote or tag
of the same name, git cannot resolve it and issues an warning that
"refname 'BRANCH' is ambiguous."  This was discovered in gccgo's
watcher process on the branch 'asan' which is also the name of a tag
in the gcc repo.  To disambiguate between a remote and a tag, any
refname can be prepended with "heads/" or "tags/", respectively.

Change-Id: I16679f5249a5f22df59ab3a0ed49459bbbf5367b
Reviewed-on: https://go-review.googlesource.com/16083
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-10-23 09:09:17 +00:00
Chris Manghane 23c48177a6 env: update linux-x86 gccgo Dockerfile
Change-Id: Ifed268cdb1c4e73d2aa1865221bdee4f4ce290ac
Reviewed-on: https://go-review.googlesource.com/16084
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-10-22 18:11:21 +00:00
Austin Clements 16adb8c13d gerrit: add GitCookies auth mode
This adds an auth mode that fetches Gerrit authentication cookies the
same way git does: from the .gitcookies file or from .netrc. This code
is loosely based on the authentication code from git-codereview.

Change-Id: If3c4efc76300b0d2c4b69f7d8af45ebc2a222313
Reviewed-on: https://go-review.googlesource.com/16157
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-10-22 01:56:53 +00:00
Austin Clements df7c940775 gerrit: add parents field to CommitInfo
Change-Id: I7cb20909d2476dc720f6c5283b48e838099fad1a
Reviewed-on: https://go-review.googlesource.com/16156
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-10-22 01:56:48 +00:00
Chris Manghane 108bdf6238 cmd/gomote, cmd/upload, build: add gccgo-specific TODOs and constants
Change-Id: If4060367da6e9a769b692f408584104193e14502
Reviewed-on: https://go-review.googlesource.com/16085
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-19 21:21:53 +00:00
Evan Brown 956434c23a all: improved monitoring of buildlet pods after creation
* Replaced cancel with context.Context
* StartPod can be canceled
* Wait for buildlet to come online, but fail fast if pod fails first
* Support timeout waiting for pod to leave pending phase
* Use Kubernetes watch API (long poll)

Updates golang/go#12546

Change-Id: I792a3b8fed615362a0290feee7de0c2cefe43c0e
Reviewed-on: https://go-review.googlesource.com/15285
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-15 23:45:50 +00:00
Brad Fitzpatrick 654bcec846 cmd/upload: support cross-compiling Go targets
Cleans up Makefiles. Correct and much faster now.

Change-Id: I78a7437492d5d1a21b8f7cddf4abffdb70c9c604
Reviewed-on: https://go-review.googlesource.com/15540
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-10-08 00:34:36 +00:00
Brad Fitzpatrick 667d180de2 revdial: fix ABBA deadlock
Fixes golang/go#12816

Change-Id: I0fade5937a138459fbdeb00695c07028c6b8060b
Reviewed-on: https://go-review.googlesource.com/15530
Reviewed-by: Ian Lance Taylor <iant@golang.org>
2015-10-07 20:17:31 +00:00
Evan Brown 88be0695fe env/linux-x86-std-kube: use correct tags for Docker images
Updates golang/go#12546

Change-Id: Icaa0504791522837fcbf0256b144c13158777c6e
Reviewed-on: https://go-review.googlesource.com/15258
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-10-02 22:43:39 +00:00
Brad Fitzpatrick 8b50a06874 cmd/coordinator: fix negative waitgroup crash
Not sure what I was thinking. Hopefully a copy/paste-o.

Fixes golang/go#12813

Change-Id: Idf63301f8f4098db07c3203575a085f7dab8e6a6
Reviewed-on: https://go-review.googlesource.com/15253
Reviewed-by: Austin Clements <austin@google.com>
2015-10-01 22:18:35 +00:00
Brad Fitzpatrick 3cd172357e cmd/coordinator: misc kubernetes fixes
Change-Id: I26a0d86565150567db3bea73117aa0c46001b88f
Reviewed-on: https://go-review.googlesource.com/15252
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-01 22:09:15 +00:00
Evan Brown f5b495b2a6 cmd/coordinator/buildongce: support application default credentials
Change-Id: I167b631252ed93dac5388fdf6944c0154b6b62a0
Reviewed-on: https://go-review.googlesource.com/15281
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-01 20:47:22 +00:00
Evan Brown 55b69b321c env/linux-x86-std/kubelet: Makefile for Kubernetes Docker images
Change-Id: I212fe5d7a6d22b6cb66abd65e16a11784b374a86
Reviewed-on: https://go-review.googlesource.com/15179
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-01 18:16:58 +00:00
Brad Fitzpatrick 5518efea22 cmd/buildlet/stage0: kubernetes Makefile target
Change-Id: I77d5a42bbb0b467492e8527a11ed27dedfc56f6e
Reviewed-on: https://go-review.googlesource.com/15251
Reviewed-by: Evan Brown <evanbrown@google.com>
2015-10-01 17:52:42 +00:00
Evan Brown 4dfb85f32a all: basic support for linux-amd64 buildlets on Kubernetes
* set correct metadata as env vars on each container in pod

* stage0 detects when running in a pod

* add scope to support farmer on GCE communicating with Google
  Container Engine API

* dev mode supports GCE and Kubernetes even when not running
  on GCE

* pod buildlet returns a configured http.Client

* pod buildlets work, but pods are not removed after completion
  (or on creation failure)

Updates golang/go#12546

Change-Id: If91673b49223130c1e7077c130f1abe1e7966d02
Reviewed-on: https://go-review.googlesource.com/15041
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-10-01 17:25:38 +00:00
Andrew Gerrand bbe4f7c899 cmd/pushback: poll for open pull requests and close them
Change-Id: I44c9bb645a7da47e0bb38504c4746ade84d37a77
Reviewed-on: https://go-review.googlesource.com/14900
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-24 21:22:18 +00:00
Brad Fitzpatrick 1288e6653a dashboard: use sharded test helpers for freebsd-386-gce101
It's a trybot, but was only using a single machine, making it the long
tail and slowing down trybot results.

Change-Id: I09ccc56b3866d522e4abf96215a2e293aed4e4d6
Reviewed-on: https://go-review.googlesource.com/14954
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-09-24 16:29:38 +00:00
Evan Brown 882e20c4c9 cmd/coordinator: discover kube cluster
Find the default Kubernetes cluster and configure a client to talk to it.
Use application default credentials.

Updates golang/go#12546

Change-Id: Ifb1ce57f52f4fbbee3267f8cc3cf02a78146bd5b
Reviewed-on: https://go-review.googlesource.com/14532
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-21 18:28:38 +00:00
Brad Fitzpatrick 1cc6bfc67b cmd/coordinator: don't reuse main buildlet when broken, make timeouts fatal
This CL makes the main buildlet and any helper buildlets all
equivalent once we get to the final stage of the build (test
execution). Now the death of the main buildlet isn't critical and the
testing continues as long as any buildlet is alive (or any helper
buildlet is on its way).

It also makes timeouts (20 minutes) of remote commands fatal, now that
health checking is reliable for all buildlet types.

Fixes golang/go#12685

Change-Id: I07d1e1fabf1027ee24ce679e4fcc8bd09bed6d83
Reviewed-on: https://go-review.googlesource.com/14774
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-20 15:29:36 +00:00
Brad Fitzpatrick ce74e0b6e0 cmd/coordinator: don't write truncated snapshots to GCS
Updates golang/go#12671

Change-Id: Ife3354f4a013cbfd9a5e960077adde8406da67ca
Reviewed-on: https://go-review.googlesource.com/14739
Reviewed-by: Glenn Lewis <gmlewis@google.com>
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-18 21:46:42 +00:00
Brad Fitzpatrick ab3e6dfd6e cmd/coordinator: verify snapshot before using it
We were creating corrupt snapshots before (golang/go#12671), so
double-check them before use, for now. We can relax this in the future
(see TODO).

Fixes golang/go#12671

Change-Id: I10b7929d4b78c717f29c67a0ce495ecd435a1d26
Reviewed-on: https://go-review.googlesource.com/14772
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-18 21:37:22 +00:00
Brad Fitzpatrick d79d77f945 cmd/coordinator/buildongce: use CoreOS stable
Alpha introduced a problem with "docker logs":

https://groups.google.com/forum/#!topic/coreos-user/VhqeIjkO2VA

So, revert for now.  No need for bleeding edge.

Also, be sure to make the coordinator's service declaration restarts on
failure, even if there are many errors in a row.  (I learned this the
hard way with another project and just realized this service file
omits the StartLimitInterval=0 line to disable the rate limit)

Change-Id: I9717e3b665bd4540d3cf4921018b619af1539178
Reviewed-on: https://go-review.googlesource.com/14771
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-18 21:36:51 +00:00
Brad Fitzpatrick ab5f898662 cmd/coordinator: use go install instead of go build in Makefile
More caching this way.

Change-Id: I2a5b8edcb3c1f99c3b028132aae3dbfc6d0874ef
Reviewed-on: https://go-review.googlesource.com/14770
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-18 21:36:34 +00:00
Brad Fitzpatrick db9e0738f2 cmd/coordinator: remove the blacklist of the shootout target
The previous blacklisting was because of golang/go#12668, since fixed.

Further, the tests are now sharded (golang/go#12623) and this test
name doesn't even exist, so this change is a no-op.

Change-Id: Id141923e904a5aec91e53ba6f1d44e6cdf137cd2
Reviewed-on: https://go-review.googlesource.com/14773
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-18 21:35:09 +00:00
Andrew Gerrand cf22ab38cc cmd/retrybuilds: retry on concurrent transaction failure
Change-Id: Idf36abd807db9796482921eea44b9e5fb4f696a4
Reviewed-on: https://go-review.googlesource.com/14740
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-18 02:18:49 +00:00
Brad Fitzpatrick 72f3eae620 revdial, cmd/coordinator: notice when buildlet TCP conns go away immediately
Previously it wasn't noticing their death until the next health check.

Take advantage of that the revdial is always blocked in a Read, so it
will see a TCP shutdown in the case of normal shutdowns. (health checks
will still catch disappearing machines)

Change-Id: I9a7f60a38b3acaf02057b2da9e0cbc91d328f651
Reviewed-on: https://go-review.googlesource.com/14736
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-09-18 02:03:18 +00:00
Brad Fitzpatrick 953211a3e3 pargzip: fix blocked goroutine on write error
Change-Id: Ifdcc24ef0e04b855882dc21b31182d6492bc54c6
Reviewed-on: https://go-review.googlesource.com/14730
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-09-18 01:35:35 +00:00
Brad Fitzpatrick 8a7ceb75fa cmd/coordinator: remove buildlet from list when closed, notice buildlets faster
Also show build steps with -x in Makefile. It's slow to use go build,
but go install doesn't quite work. Need to figure that out.

Change-Id: I79093dc7c84912b3f04c9e4708c9f65086c4445c
Reviewed-on: https://go-review.googlesource.com/14733
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-09-18 01:35:28 +00:00
Brad Fitzpatrick 5053cc8f51 cmd/buildlet: add a timeout and set TCP keep-alives on reverse connections
I noticed some hung forever during the initial connect + TLS handshake, which
can happen if the server is restarted/rebooted and TCP connections hang.

Change-Id: I4ada86aa2e5629b82de27fa6cfea376211490068
Reviewed-on: https://go-review.googlesource.com/14734
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-09-18 01:35:21 +00:00
Brad Fitzpatrick 1feffd3ec8 cmd/coordinator: fix buildlet sorting
It was not producing correct results before.

Change-Id: I77c857e8064ad36a5fdb982507b265271beb7bbd
Reviewed-on: https://go-review.googlesource.com/14735
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-09-18 01:35:19 +00:00
Brad Fitzpatrick 12529db5cb cmd/retrybuilds: add -branch flag
Works for detecting new flaky builds from different pages, but I
can't actually clear them yet. (caching bug in the dashboard?)

Change-Id: Iad9c3a5aef2016a81ad71559bb140044b68e42e2
Reviewed-on: https://go-review.googlesource.com/14732
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-09-18 01:35:17 +00:00
Brad Fitzpatrick 9620f5578a buildlet: log on heartbeat failures
should be rare now.

Change-Id: Icc4bfd13c8dfe8f2e189db819bc0d552f35fb3c9
Reviewed-on: https://go-review.googlesource.com/14731
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-09-18 01:35:04 +00:00
Brad Fitzpatrick d011dfc978 buildlet: try a bit harder to cancel slow HTTP requests
Use the new Go 1.5 mechanism to abort HTTP requests with a channel.
This is respected by the Go 1.5 http.Transport, which we always use.

This CL shouldn't be necessary (CL 14700 was the real bug), but
doesn't hurt. This still would've probably prevented most of
golang/go#12666

Change-Id: I6890e016ee04183fc0d600baed8046c2f79113d8
Reviewed-on: https://go-review.googlesource.com/14701
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-17 20:06:39 +00:00
Brad Fitzpatrick 30d52a20ad revdial: fix Lock-after-Lock bug, where server EOF wouldn't unblock conns
If the server's conn stopped reading, we acquired a Lock twice
(blocking forever) and never killing all the active connections on it.

Add test.

Probably fixes golang/go#12666

Change-Id: I4ff670a55e8d92e6e2ebe14a94137d6f15f3768e
Reviewed-on: https://go-review.googlesource.com/14700
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-17 20:03:31 +00:00
Andrew Gerrand 5299bb075d cmd/coordinator: disable linux-arm trybots, re-enable mirroring
Change-Id: I4a9036c05cb36587bc35281542efa151f09d8d6a
Reviewed-on: https://go-review.googlesource.com/14637
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-09-17 00:21:21 +00:00
Matt Drollette cd04c5a618 livelog: correct comment typo
Change-Id: Id41fb9edea46f8048cf78ba8f1afc607321c0472
Reviewed-on: https://go-review.googlesource.com/14641
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-09-16 16:50:28 +00:00