Граф коммитов

110 Коммитов

Автор SHA1 Сообщение Дата
Andrew Gerrand aa078a3723 cmd/coordinator: fix nostream feature
Change-Id: Iae8c46ccf7d87ecd33850ed2c750cb81022be3eb
Reviewed-on: https://go-review.googlesource.com/10494
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-28 23:14:30 +00:00
Andrew Gerrand ff978d757e cmd/coordinator: add query parameter to disable live log streaming
Change-Id: I2fd16ef9491c42c1ddb7cda9e12de12765fa6827
Reviewed-on: https://go-review.googlesource.com/10490
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-28 22:20:40 +00:00
Andrew Gerrand dbb9eb4467 cmd/coordinator: delete annoying log message
Change-Id: Ib5b2766636f7fc0a69be23190f05f60bf88f085f
Reviewed-on: https://go-review.googlesource.com/10491
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-28 22:11:29 +00:00
Chris Manghane ae81ba52e3 cmd/watcher: filter logs by file or directory name
Adds a new flag, "filter," that accepts a comma-separated list of
file or directory names to pass to git log.

Change-Id: Id89018b0591c7af8f425654c9d9256940b6c37f5
Reviewed-on: https://go-review.googlesource.com/10422
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-28 18:54:39 +00:00
Chris Manghane d3682196ec cmd/watcher: record files changed in each commit
Change-Id: I1c0140c564689d6f673494ddaf7c3d7cccd30397
Reviewed-on: https://go-review.googlesource.com/10320
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-28 18:53:12 +00:00
Brad Fitzpatrick 44de54d2c7 cmd/coordinator: query list of dist tests to run
Change-Id: I9be6a50f172f08e24cd81d872e7ce8fe3ce34064
Reviewed-on: https://go-review.googlesource.com/10462
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-28 03:29:06 +00:00
Andrew Gerrand 7d4dc222c7 cmd/coordinator: only write snapshot on successful build
Change-Id: Idc578b51ff8232b6a2790cee714fcd3ecef07ca5
Reviewed-on: https://go-review.googlesource.com/10461
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-28 00:47:22 +00:00
Brad Fitzpatrick 6de4d3f7ae cmd/coordinator/buildongce: add --dev flag, use dev token files, fix build
Change-Id: I490cb8922a552a3c2528fedd901299c1828f1522
Reviewed-on: https://go-review.googlesource.com/10447
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-27 22:30:39 +00:00
Andrew Gerrand c53a577db0 cmd/coordinator: write snapshots of build to cloud storage
Change-Id: I1eb4ec4d1879ecf5b5d4bcec437995d6531a3ddc
Reviewed-on: https://go-review.googlesource.com/10446
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-27 22:26:46 +00:00
Andrew Gerrand a9469a8602 cmd/coordinator: remove logbucket flag, add devPrefix function
Change-Id: Ie9f9de55551d187d85d5443f008e6bb9cc268192
Reviewed-on: https://go-review.googlesource.com/10445
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-27 21:18:27 +00:00
Brad Fitzpatrick 4623e1a5d1 cmd/coordinator: don't post that trybots are starting if we already said that
This means we don't spam Gerrit when trybots are interrupted by Andrew
or I restarting the coordinator with a new version.

Change-Id: Ic5d96708f74845bb3c556d7b06fa79d5605ab21e
Reviewed-on: https://go-review.googlesource.com/10441
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-27 20:36:00 +00:00
Brad Fitzpatrick 7d9b0367e9 dashboard, cmd/coordinator: only split make & run for builders where it'll work
Change-Id: I1fdc27ea4adcc83fbd736d2bd1a34a07ca36a50c
Reviewed-on: https://go-review.googlesource.com/10423
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-27 19:21:10 +00:00
Andrew Gerrand 1826ad46c0 cmd/coordinator, cmd/buildlet: add windows builder images to dev cluster
Change-Id: I2094181ed9c51e7ce37d1c6a9f56124003c76928
Reviewed-on: https://go-review.googlesource.com/10381
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-25 18:56:13 +00:00
Andrew Gerrand fb774889dc cmd/coordinator, dashboard: split build into 'make' and 'run' steps
Change-Id: Ib60a601ef21163d5e0d1fed3a2609d9b719c616a
Reviewed-on: https://go-review.googlesource.com/10073
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-21 05:57:28 +00:00
Andrew Gerrand 1fc56ca750 buildlet: add Path option to ExecOpts
Change-Id: I1353ecc14dfe232886dcfadc47547bbcf91f0b6d
Reviewed-on: https://go-review.googlesource.com/10303
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-21 03:38:07 +00:00
Andrew Gerrand a91ae261ce envutil: move dedupEnv function from gomote to new package
Change-Id: Ib6856cdfced65e1bec818ac3a80d03a5269e2bd0
Reviewed-on: https://go-review.googlesource.com/10301
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-21 02:13:27 +00:00
Andrew Gerrand 90f449a36c cmd/coordinator: actually limit cpus in dev cluster
Change-Id: I1400e1dfd5f520b548d91aebc365cd5454960608
Reviewed-on: https://go-review.googlesource.com/10193
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-18 06:52:45 +00:00
Andrew Gerrand 717160018b cmd/coordinator, dashboard: be aware of the dev cluster
Change-Id: Ia235856624fa1d5aac4d839bd946c06d957e8401
Reviewed-on: https://go-review.googlesource.com/10130
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-18 05:05:02 +00:00
Andrew Gerrand f7dc6a2585 cmd/watcher: correctly assemble query string when posting commits
Change-Id: I97b6e77103bfd0e7a6efae9d73cfa61a546ffc59
Reviewed-on: https://go-review.googlesource.com/10096
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-15 01:43:39 +00:00
Brad Fitzpatrick ac39ba8218 dashboard, cmd/coordinator: sharded ARM trybot-only builders
This is a quick & hacky version of our eventual sharding plan.  Later
we want to run make.bash once, snapshot it, and then intelligently
schedule all the tests out over N machines (starting with the built
snapshot), giving each the next test to run as they become idle.
And then we want to stitch together all of their output.

But this CL just makes 6 ARM builders, each of which runs make.bash (4
minutes) and then each which runs a statically-configured subset of
the tests. Based on measurements, each should run between 8.2 and 10.6
minutes. We can break up some of the larger test cases later into more
shardable pieces (in particular: "test").

Update golang/go#10029

Change-Id: Ib3e008b61ce6f28d799ae298c8467bf62d89e5d4
Reviewed-on: https://go-review.googlesource.com/10056
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-14 22:44:22 +00:00
Andrew Gerrand 3c77f22665 cmd/coordinator/buildongce, cmd/upload: support dev project
Change-Id: I88a02eb5ec6aae75b8c4ff804334e0716d87d959
Reviewed-on: https://go-review.googlesource.com/10075
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-14 05:09:49 +00:00
Brad Fitzpatrick 1bfb106869 cmd/scaleway, env/linux-arm/scaleway: notes, configs, and tools for Scaleway
This is what I used to start the ARM scaleway servers.

I forgot to mail it out. I'd like to submit this before I tweak it
further.

Updates golang/go#8647

Change-Id: Icf789de4e3acae8084fd75151ef5ef02d8073b73
Reviewed-on: https://go-review.googlesource.com/10052
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-14 02:26:27 +00:00
Brad Fitzpatrick eb52e71587 dashboard, cmd/coordinator: add concept of trybot-only builders
Make all-compiler a trybot-only builder. This will be used for
temporary sharded ARM trybots.

Updates golang/go#10029

Change-Id: I6cc3188887c2f24edef97d0a9354e39553a15896
Reviewed-on: https://go-review.googlesource.com/10051
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-14 01:48:52 +00:00
Brad Fitzpatrick 46d9b001a1 cmd/coordinator: add more detail on reverse pool's in-use counts
Also:

* work around a Chrome bug in flushing chunks and mime detection
  in the log handler.
* fix Makefile missing files
* fix vet bug where Println should be Printf
* include builder name & rev at top of output, so they're included
  uniformally in failure log's bodies. (for trybots they were in the URL,
  but for non-trybots they were not and you had to carefully analyze
  the failure body to guess the OS/arch/options, which wasn't always
  possible)

Fixes golang/go#10723

Change-Id: I7db5e4c31f51f6be8223be45d36019e3c62ce27d
Reviewed-on: https://go-review.googlesource.com/10050
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-13 23:51:57 +00:00
Andrew Gerrand 02b8ee3c61 cmd/watcher: remove origin prefix from internal branch handling
The new use of "git clone --mirror" creates local tracking branches
instead of remote tracking branches, so we don't need to use the
"origin/" prefix everywhere. Simpler code: yay!

Change-Id: I48bd5c67124d7d00e1cc968654c35078b701c092
Reviewed-on: https://go-review.googlesource.com/9944
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-12 06:31:17 +00:00
Andrew Gerrand 5b22eaf6dd cmd/watcher: use --mirror when cloning repos (fix sync)
Change-Id: I146411f14dd0ea11fb4e7c9489169ca22b2d202e
Reviewed-on: https://go-review.googlesource.com/9943
Reviewed-by: Andrew Gerrand <adg@golang.org>
2015-05-12 05:30:52 +00:00
Johan Euphrosine f27c2b8244 build/cmd/coordinator: fix typo in gce comments
Change-Id: I439ba378d0b7ef6655366c8aa5268c22504fb219
Reviewed-on: https://go-review.googlesource.com/9931
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-11 22:14:40 +00:00
Brad Fitzpatrick acb32b412f cmd/coordinator: only email on first failure, show rest in final report
Change-Id: I903d330c1047c599ffcd1ae8f17772705a04f8cc
Reviewed-on: https://go-review.googlesource.com/9854
Reviewed-by: Russ Cox <rsc@golang.org>
2015-05-11 17:51:31 +00:00
Alex Brainman c288a9f61d cmd/buildlet: kill all child processes on windows
Fixes golang/go#10706

Change-Id: I2c1acede02adf84c3b37f5d3cf712bb6b4d44feb
Reviewed-on: https://go-review.googlesource.com/9837
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-11 06:11:32 +00:00
Andrew Gerrand 68a0711d80 cmd/watcher, cmd/coordinator: add repository mirroring feature
Change-Id: I93b0b6e7999716bcc2a371902935f51891aa432f
Reviewed-on: https://go-review.googlesource.com/5418
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-11 04:50:45 +00:00
David Crawshaw cd166e047b cmd/buildlet: cleanup dead coordinator net.Conn
The farmer.golang.org flapping got the reverse buildlets stuck.

Tested manually.

Change-Id: I0e7dca2747b2c36bb8c39c41ebaaf4bf997c6f35
Reviewed-on: https://go-review.googlesource.com/9762
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-08 16:22:51 +00:00
Brad Fitzpatrick f46ac13008 cmd/buildlet: fix deadlock and non-blocking receive syntax
Fixes golang/go#10750
Fixes golang/go#10682 probably

Change-Id: I7fd9cc638d5c20381121f8c3cdcd05586f897caf
Reviewed-on: https://go-review.googlesource.com/9851
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-05-07 22:12:22 +00:00
Andrew Gerrand 38bde5952a cmd/gomote: fix push, put, and run for instances with -n suffix
Fixes golang/go#10708

Change-Id: Iea2a2aec3b6af8fadb646916617015ef08929123
Reviewed-on: https://go-review.googlesource.com/9770
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-06 19:41:49 +00:00
Russ Cox 63d6318c38 cmd/cl: fix issue refs for subrepos
Before (running "cl file:audio"):
CL 9708    1/  1d mobile  crawshaw  hyangah*    app: introduce Config and start registration
CL 9782    0/  1d mobile  jbd       nigeltao*   audio: have a global audio device and context
CL 9698    0/  2d mobile  jbd       crawshaw*   example/audio: add sample audio app
CL 9693    0/  2d mobile  jbd*      nigeltao    mobile/audio: player should close its audio source

After:
CL 9708    1/  1d mobile  crawshaw  hyangah*    app: introduce Config and start registration #10226 #10327 #10442 #10461 #10686
CL 9782    0/  1d mobile  jbd       nigeltao*   audio: have a global audio device and context #10636
CL 9698    0/  2d mobile  jbd       crawshaw*   example/audio: add sample audio app
CL 9693    0/  2d mobile  jbd*      nigeltao    mobile/audio: player should close its audio source

Change-Id: I6baf053a91ecc9462d5cb31322a878608566522a
Reviewed-on: https://go-review.googlesource.com/9786
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-06 15:47:33 +00:00
David Crawshaw a4a05b3dcc cmd/coordinator: cleanup reverse buildlet net.Conn
Avoids an FD leak. Tested by hand with lsof.

Fixes golang/go#10698 (probably)

Change-Id: Ic81db7eb504da9f1d9e4fa0518792c1e02da21cc
Reviewed-on: https://go-review.googlesource.com/9742
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-05 21:03:30 +00:00
David Crawshaw 6c597e3911 cmd/coordinator: add darwin trybot
The racked machines are not completely set up yet, but they are in
good enough shape to run darwin-amd64 reverse buildlets. There are
currently 4 registered with farmer.golang.org. So let's try a
trybot.

Change-Id: Icb2a0ceb9232b7eace2a3b1d97b36b4637262aa1
Reviewed-on: https://go-review.googlesource.com/9603
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-01 16:53:42 +00:00
David Crawshaw eef380f4e8 cmd/coordinator: generate table of builders
To replace the always-out-of-date wiki.

Change-Id: I63d56d4bcf9252e56c833eaa15656b0321ac91dc
Reviewed-on: https://go-review.googlesource.com/9571
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-05-01 11:31:17 +00:00
David Crawshaw dd0cf9f519 cmd/coordinator: add some style to status page
No very significant improvements. I hope that by moving it to a
template and giving it a tiny bit of CSS, someone else might come
along and be tempted to improve what's there.

Modeled on http://build.golang.org.

Change-Id: Idfa6bf5c66d75b4e09903c1ee8b097054296c1ab
Reviewed-on: https://go-review.googlesource.com/9497
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-30 19:49:20 +00:00
Brad Fitzpatrick 28de2aaa2b cmd/coordinator: add all-compile to the set of trybots
Change-Id: Ia9b98c0c8211eb8d6b08d906d7e715ec2ed7ad77
Reviewed-on: https://go-review.googlesource.com/9514
Reviewed-by: David Crawshaw <crawshaw@golang.org>
2015-04-29 22:07:24 +00:00
David Crawshaw 5d38b25f89 cmd/coordinator: don't count waiting as cleanup
Change-Id: Icfe67fb57a41cbe438cb2d5cf50ed1391cecee34
Reviewed-on: https://go-review.googlesource.com/9495
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-29 21:43:08 +00:00
David Crawshaw 6fed4c2dc7 cmd/coordinator: clean up after non-VM buildlet runs
Reverse buildlets get reused. Make sure files from previous builds
don't interfere.

Fixes #10604

Change-Id: Ieab48debe1446b5fe04b8b1e3c0f9b7498c975d2
Reviewed-on: https://go-review.googlesource.com/9458
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-29 15:14:32 +00:00
David Crawshaw e078c6fb52 dashboard: add darwin-arm/arm64 buildlets
Tested by running a local coordinator on the darwin-arm64 builder.

Change-Id: Id38faaa3275d6535b897f3c65df6d01ed9c1847e
Reviewed-on: https://go-review.googlesource.com/9459
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-29 14:29:49 +00:00
David Crawshaw 3d8b78fc07 cmd/buildlet: retry when coordinator is unhealthy
Change-Id: I66ce76add2e267d1f95185df2a3f3a3abd0fd504
Reviewed-on: https://go-review.googlesource.com/9452
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-28 23:56:08 +00:00
David Crawshaw 89cddc6e8b cmd/coordinator: say when reverse pool is empty
Change-Id: Icd9933d42a1d0b04703ae23827532e8c2eecc4c7
Reviewed-on: https://go-review.googlesource.com/9451
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-28 22:22:52 +00:00
David Crawshaw dd57a13174 cmd/coordinator: minor status improvements
Address post-submit comments from cl/9248.

Change-Id: Ibe57678661c68c4f7b7db8a999a21b7ac001eac8
Reviewed-on: https://go-review.googlesource.com/9450
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-28 21:22:19 +00:00
David Crawshaw d3d010af27 cmd/coordinator: very simple health checks
In a future CL, buildlets will redial if they don't recieve a regular
health check.

Change-Id: If40652c0943da5df28aeb9e923e6365ae71e28e8
Reviewed-on: https://go-review.googlesource.com/9407
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-28 18:45:33 +00:00
David Crawshaw 24c9c9f424 cmd/coordinator: make wait loop actually wait
This bug was handing out in-use buildlets to work, causing the
coordinator to panic.

Change-Id: I4026ec3c637a02e5e80b20201ce067f6ee1ddfe1
Reviewed-on: https://go-review.googlesource.com/9420
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-28 18:20:29 +00:00
David Crawshaw 66c36dd35f cmd/coordinator: run builds on reverse buildlets
Also introduces more dev mode manual testing machinary. It is now
possible to start a coordinator and buildlet on a local machine and
hit localhost:8119/dosomework/buildername to rebuild the latest
revision from build.golang.org.

No support for VMs on reverse buildlets yet. That will have to wait
for some future work.

Change-Id: I590a9bc1779add030bde8dbf496eb6814ef57126
Reviewed-on: https://go-review.googlesource.com/9248
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-28 13:43:50 +00:00
Russ Cox 8f9b6de7ac cl: document, implement R= parsing, adjust default output, add -json output
Sample of new default output:

CL 9259    1/  1d go      0intro        bradfitz+2*     archive/tar: fix error message
CL 6790   15/ 52d go      vbatts@gma... bradfitz*       archive/tar: fix round-trip attributes #9027
CL 9267    2/  2d go      josharian     *               cmd/5g, etc: prepare Node.Val to be unexported
CL 9263    2/  3d go      josharian     minux*          cmd/5g, etc: prepare to unexport gc.Mp*
CL 8773    1/ 14d go      michael.hu... iant*           cmd/6l, cmd/internal/ld: abort on shared library ABI mismatch
CL 8214    4/ 26d go      aram          iant+2*         cmd/6l: use .plt instead of .got on Solaris

The old default behavior of "cl" is now "cl -r -url".

Change-Id: I5befaa0edffa965a041d223aa75aca7c26c6984a
Reviewed-on: https://go-review.googlesource.com/9360
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-27 14:35:15 +00:00
Shenghou Ma 14f7f84854 cmd/builder: pass through $GO_TEST_TIMEOUT_SCALE
Change-Id: I518010751a4d1b98dcec63a3bf8fdd08bf57fabe
Signed-off-by: Shenghou Ma <minux@golang.org>
Reviewed-on: https://go-review.googlesource.com/9301
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
2015-04-24 20:39:40 +00:00