Most of these are documentation fixes.
Change-Id: If100cc2ef0ee0b8b47a1e96e4c51a2be8caf5842
Reviewed-on: https://go-review.googlesource.com/22366
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
These IDs will become the cloud datastore keys for keeping history and logs.
Many more CLs will follow: changing farmer URLs, logging to datastore,
fetching old logs from datastore, etc.
Updates golang/go#13076 (make all logs URLs permanent)
Updates golang/go#12669 (collect logs, stats)
Change-Id: I5b9fd21bf23581c59724b0ed32c8459baa9683f7
Reviewed-on: https://go-review.googlesource.com/21968
Reviewed-by: Andrew Gerrand <adg@golang.org>
Until we can use historical data, keep this roughly-accurate handmade
table up to date. This helps with the coordinator's critical path
scheduling of tests over buildlets. (I noticed this stuck at the end
of a build, rather than the beginning)
Change-Id: I6e64b138b1f5b3163157d93c59ba19c25c959730
Reviewed-on: https://go-review.googlesource.com/21966
Reviewed-by: Andrew Gerrand <adg@golang.org>
Also start of some solaris stuff.
Fixesgolang/go#10601 (all five ppc64le now in systemd)
Fixesgolang/go#14197 (all five arm64 up and also in systemd)
Updates golang/go#15072 (not a fix for Sun Solaris, but progress)
Updates golang/go#9515 (more progress towards SmartOS)
Change-Id: I9c878017904441823dae7b6945938396b0c2974b
Reviewed-on: https://go-review.googlesource.com/21670
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
Improvements to support rapid scheduling of many build jobs:
- Retry logic in Kubernetes client to handle sporadic connection
closes from their API server under heavy load
- Cluster autoscaler scales on default CPU utilization metric
- Debug mode allows scheduling multiple builds to test scaling
- Account for scheduled vs. provisioned resources in a cluster
and use that information to estimate when a build's pod
will be scheduled and in running state
- Use estimated scheduled time to set context timeout
- Track pod lifecycle (requested time, estimated available time,
actual available time, terminate time, etc)
Change-Id: I14d6c5e01af0970dbb3390a29d1ee5c43049fff8
Reviewed-on: https://go-review.googlesource.com/19524
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
Next step is logging it to datastore/bigquery. Then stats and
visualizing with trace viewer later.
Updates golang/go#12669
Change-Id: I039097791993dbe3d4aceb18d2a08db8299f3c05
Reviewed-on: https://go-review.googlesource.com/21640
Reviewed-by: Andrew Gerrand <adg@golang.org>
The Docker watcher process wasn't being restarted when the coordinator
restarted, leading to confusion when trying to deploy new versions,
and spammy error messages.
Also, make the watcher start up faster by reusing its previous
instance's git mirrors if they appear to be not corrupt. This reduces
the start from 45+ seconds to 11 seconds. (All the repos are fetched in
parallel and most 1-2seconds, but the "go" repo is 11 seconds.)
It's no longer on tmpfs, but it's still on SSD and will be in the page
cache, and there's plenty of disk:
farmer watcher-git # pwd
/var/cache/watcher-git
farmer watcher-git # du -h -c | tail -1
412M total
farmer watcher-git # df -h .
Filesystem Size Used Avail Use% Mounted on
/dev/sda9 47G 5.7G 39G 13% /
Fixesgolang/go#12673
Change-Id: I1ad58ab94b02dbe79340e2226023a3e52cf3be49
Reviewed-on: https://go-review.googlesource.com/21625
Reviewed-by: Evan Brown <evanbrown@google.com>
Reviewed-by: Andrew Gerrand <adg@golang.org>
It got lost at some point.
Change-Id: I50f262d971ce4de418dbb5ee4f0ddd383ce72d0e
Reviewed-on: https://go-review.googlesource.com/21616
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
Now events and phases of the build are represented by a span, with a
stop and start, and each has timing and a success status.
These will visualize nicer (later) and will be able to be logged and
queried in Cloud Datastore + BigQuery.
Also, remove the overloaded and not-to-be-used "rev" parameter from
the GetBuildlet interface. An upcoming change disconnects the
buildlet's lifetime from that of a single build, so the rev isn't even
known at the time of the GetBuildlet call; the buildlet will be handed
out to the most worthy current waiter (and the rev might not have even
existed at the tim the GetBuildlet call started)
Updates golang/go#12669
Change-Id: I02b28fea8bbbc16dc95c1ea0507418be01aa8ca8
Reviewed-on: https://go-review.googlesource.com/21570
Reviewed-by: Andrew Gerrand <adg@golang.org>
On the Plan 9 builder, we are experiencing regular
failures in cmd/compile when building go_boostrap.
We suspect the failures to be related to a bug in
the Go 1.4 runtime. This is affecting the cmd/compile
program, since it has been built with Go 1.4 and
linked with the Go 1.4 runtime.
Updates golang/go#14650
Change-Id: I78729c8660314be381d7b668810c6f64214f2358
Reviewed-on: https://go-review.googlesource.com/21411
Reviewed-by: Richard Miller <millerresearch@gmail.com>
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
One was in buildenv anyway.
The other hasn't been used in ages.
Change-Id: I1d5f652ca3bf713f59d50a11bdba1339653867bb
Reviewed-on: https://go-review.googlesource.com/20978
Reviewed-by: Andrew Gerrand <adg@golang.org>
Also update all users, and rename another template field.
Includes changes to coordinator, gomote, and release.
Change-Id: I1c4408eadbcb83d61063a910dfa18cc395952bc2
Reviewed-on: https://go-review.googlesource.com/20976
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
This local variable was shadowing the global one.
Change-Id: If4a28de430050d884097a5474f8bb56c45c31fb1
Reviewed-on: https://go-review.googlesource.com/20958
Reviewed-by: Andrew Gerrand <adg@golang.org>
Now that SSA checks are off by default, let's run a builder with the
checks on just to make sure they keep passing.
Change-Id: I7edd2a2865681a135ccf755be7a14f8645c0a8aa
Reviewed-on: https://go-review.googlesource.com/20882
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
This makes it easier to programmatically verify the
integrity of the binaries.
Fixesgolang/go#14385
Change-Id: Ie3688d9b07412018b74d6189ab0d7bc72ef50398
Reviewed-on: https://go-review.googlesource.com/19783
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
buildenv.Environment type defines configuration options:
- Coordinator uses the GCE project name to lookup config. A custom
config name can be provided at runtime to override.
- The conventional prod and stage project names ('symbolic-datum-552'
and 'go-dashboard-dev') map to prod and staging configuration structs.
- Production and staging status is explicitly defined in configuration.
- GCS bucket names for buildlet, logs, and snapshots are
configurable.
Change-Id: I7e6d7874eb0bdfe35dbdd5fcf6212ab50d576b88
Reviewed-on: https://go-review.googlesource.com/19502
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
The actual spelling of DoNotReview that has meaning
to the dashboard includes spaces, but I can't put that
string in the commit message because it makes the
CL uncommitable. :-)
Add dnr flag so people can ask for them.
If people do ask, show DoNotReview as the reviewer.
Similarly, show Closed as the reviewer for closed CLs.
Change-Id: Ibe758bbb5f5f03fcb5035e7cb068c6d8d0b6baa4
Reviewed-on: https://go-review.googlesource.com/11260
Reviewed-by: Andrew Gerrand <adg@golang.org>
Run-TryBot: Russ Cox <rsc@golang.org>
This is stuff needed for my Github->Gerrit bot.
Change-Id: Ie072d7b66be2b219ba48245305a8187446238c9e
Reviewed-on: https://go-review.googlesource.com/19380
Reviewed-by: Andrew Gerrand <adg@golang.org>
Revise Makefile in linux-x86-std-kube and linux-x86-nacl:
- Support a target named `dev` that allows specifying a non-default
Docker repository name.
- Replace hard-coded image names with the directory name that Makefile
resides in. This uses the existing convention of naming directories
according to image name.
- When Dockerfile inherits from a custom image (i.e., linux-x86-nacl
inherits FROM linux-x86-std-kube), use sed to dynamically set the
repository prefix in the Dockerfile.
Change-Id: I372c834175a38bb34d80a18f2f0e23c5a1d007af
Reviewed-on: https://go-review.googlesource.com/19021
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
Andrew Gerrand
Brad Fitzpatrick
Evan Brown
Benny Siegert
David du Colombier
Keith Randall
Shenghou Ma
Bryan Chan
Russ Cox