build/cmd
Carlos Amedee 725674f5ab internal/cloud, cmd/coordinator: add a rate limiter for the AWS client
This change adds an optional rate limiter which implements both rate
and resource limits. This change should enable the coordinator to add
additional builders hosted on EC2. This change will reduce the chance
that we encounter one of the limits.

The rate limiter is essential for any calls which mutate cloud
resources. While the EC2 client.DefaultRetryer should be sufficient
enough to handle the non-mutating requests, it would implement a best
practice in having client side rate limiting for those types of requests.

Amazon EC2 throttles requests EC2 API requests
https://docs.aws.amazon.com/AWSEC2/latest/APIReference/throttling.html

Fixes golang/go#40950

Change-Id: Ib80bcf7c5ab0b0483d5beb11f3581cdb1d0174fe
Reviewed-on: https://go-review.googlesource.com/c/build/+/267901
Trust: Carlos Amedee <carlos@golang.org>
Run-TryBot: Carlos Amedee <carlos@golang.org>
TryBot-Result: Go Bot <gobot@golang.org>
Reviewed-by: Alexander Rakoczy <alex@golang.org>
2020-11-09 20:12:48 +00:00
..
buildlet cmd/buildlet: fix bash wrapper check for iOS 2020-10-06 16:47:21 +00:00
buildstats cmd/coordinator: use historical test timing data for critical path scheduling 2019-01-30 21:44:06 +00:00
cl maintner: change type/name of GerritCL meta fields, ensure Meta always non-nil 2018-04-15 21:06:32 +00:00
coordinator internal/cloud, cmd/coordinator: add a rate limiter for the AWS client 2020-11-09 20:12:48 +00:00
debugnewvm buildenv, cmd/debugnewvm: add a region to the AWS configuration 2020-07-17 20:48:01 +00:00
docker2boot all: add README.md files where missing, and tool to keep them updated 2017-08-02 22:17:52 +00:00
fetchlogs cmd/fetchlogs: fetch repo data using the 'repo' query param 2020-05-18 19:47:01 +00:00
gcpinit cmd/coordinator, all: fix more things related to multi-zone buildlets 2019-12-09 19:46:22 +00:00
genbootstrap all: upgrade scaleway linux-arm builders, stop using deprecated --reverse flag 2019-11-06 20:48:46 +00:00
genbuilderkey cmd/genbuilderkey: add usage information 2020-05-05 19:03:33 +00:00
gerritbot internal/secret: add a must constructor for the secret client 2020-09-22 02:20:15 +00:00
gitmirror internal/secret: add a must constructor for the secret client 2020-09-22 02:20:15 +00:00
gomote cmd/gomote: list current instances on emtpy gomote destroy command 2020-06-24 16:00:30 +00:00
gopherbot cmd/gopherbot: rename a function to be more descriptive 2020-10-07 20:08:45 +00:00
gopherstats cmd/gopherstats: change top 20->40, ignore file changes in CLs with many 2019-11-21 22:23:31 +00:00
makemac dashboard, cmd/makemac: add macOS 10.15 Catalina builder 2019-11-21 14:35:11 +00:00
perfrun buildlet: add context argument to most of the remaining Client methods 2019-11-20 17:29:10 +00:00
pubsubhelper internal/secret: add a must constructor for the secret client 2020-09-22 02:20:15 +00:00
racebuild cmd/racebuild: add OpenBSD platform 2020-11-09 16:40:11 +00:00
release cmd/release: adjust comment to not begin with "// +build" 2020-10-16 16:16:08 +00:00
releasebot cmd/releasebot: remove obsolete checkDocs check 2020-07-29 15:32:44 +00:00
relnote cmd/relnote: include closing dd tags in HTML output 2020-10-09 18:35:30 +00:00
relui cmd/relui: publish task start message to pubsub 2020-09-25 21:44:07 +00:00
retrybuilds cmd/coordinator,cmd/retrybuilds: add wipe API to coordinator 2020-02-20 15:37:57 +00:00
rmplaysnippet cmd/rmplaysnippet: account for local datastore host env var 2019-07-12 17:07:44 +00:00
rundockerbuildlet cmd/rundockerbuildlet: retrieve host type from metadata on EC2 2020-09-01 20:43:17 +00:00
scaleway internal/secret: add a must constructor for the secret client 2020-09-22 02:20:15 +00:00
tip cmd/tip: use website repo on disk for installing cmd/golangorg 2019-09-26 15:07:00 +00:00
updatecontrib cmd/updatecontrib: add golang.org/{dl,x/mod,x/pkgsite} repos 2020-08-10 21:50:40 +00:00
updatedisks internal/buildgo, cmd/updatedisks: clean up old, unused VM disks 2019-12-09 22:09:24 +00:00
upload cmd/upload: use specified go version for building 2020-01-29 19:24:36 +00:00
xb cmd/coordinator, all: fix more things related to multi-zone buildlets 2019-12-09 19:46:22 +00:00