Граф коммитов

59 Коммитов

Автор SHA1 Сообщение Дата
Jonathan Chauncey fd249b3e4f remove southcentral us from e2e tests since it is out of capacity (#1725) 2017-11-07 13:10:12 -08:00
Jack Francis fdca0193e9
add more e2e regional coverage (#1709)
* add more e2e regional coverage

* exposing regions whitelist as env var

* region randomization for swarm and swarmmode e2e

* swarm and swarmmode poke

* swarm swarmmode poke encore

* poke k8s 1.6

* poke k8s circle config
2017-11-03 16:05:24 -07:00
Jonathan Chauncey 1527508aee fix(test/e2e): Provides a few fixes for various issues around the e2e tests (#1685)
record an error count when we fail around waiting for nodes
fix dashboard check so that it doesnt keep iterating even after success
feat(test/e2e/config): Add the ability to select a region at random from a preselect list of 5
* eastus, westcentralus, southcentralus, westus2, westcentralus
feat(test/e2e/metrics): Add jenkins metrics
* Also provide tags that specify which ci system ran the tests
2017-10-30 12:34:50 -07:00
Jonathan Chauncey bfadd5cfde ref(runner.go): Move test runner and provisioning into its own structs 2017-10-20 14:14:26 -04:00
Jonathan Chauncey 5ce61cf6ff feat(metrics): Add the ability to collect performance metrics from test runs (#1614)
* feat: Add test metrics and publish them to influx

* install influx dep
2017-10-18 15:50:39 -07:00
Jonathan Chauncey 16192ab224 feat(kubernetes_test, config/config.go): Add configurable timeout (#1489)
* feat(kubernetes_test, config/config.go): Add configurable timeout
* You can now specify timeout using the TIMEOUT env var and specifying a string such as 5s, 10m, 1h

* update circle/config.yml to set TIMEOUT=15m

* fix space at top of config.yml
2017-09-25 15:29:36 -07:00
Jonathan Chauncey 824501d570 chore(circleci/config.yml): Add hybrid and windows builds to circle config (#1387)
* The linux definition now builds a more feature complete kubernetes cluster. This means we can provision fewer clusters while testing more surface area
2017-09-18 11:30:54 -07:00
Jonathan Chauncey 2f1fc77aa8 feat(runner.go): port bash ginkgo runner to go (#1365)
* feat(runner.go): port bash ginkgo runner to go
* Ports bash runner to golang
* Updates the version check for the k8s test so that it uses the version specified in the cluster definition if provided
* Adds some retry logic to the pod networking test since that was failing locally

* ref(runner.go, kubernetes_test.go):
* Refactored runner.go into a few more methods to help readability
* Fixed orchestrator version test for k8s.
* You can now set ORCHESTRATOR_RELEASE as an env var to provision clusters with a given release

* fix(runner.go): Remove unused const

* feat(runner.go): Add provision retries
* We will now retry upto 3 times by default (override using PROVISION_RETRIES env var)

* fix(runner.go): Remove excessive teardown calls
2017-08-30 11:38:09 -07:00
Jack Francis 97ab47bd94 Delivers a `make test-kubernetes` ginkgo e2e test (#1256)
* delivers a `make test-kubernetes` ginkgo e2e test

with circle config

* chore(make) make test needs to skip e2e dirs

* using ginkgo coverage script

* chmod +x scripts/ginkgo.coverage.sh

* added ginkgo-k8s-e2e to circleci jobs options

* include test.mk

* chmod +x test/e2e/runner

* split out into two circleci workflows

* master only test filter and tab correction

* missing colon after test expansion

* undo

* removing azure region from code
2017-08-16 13:19:41 -07:00