github
/
vitess-gh
зеркало из https://github.com/github/vitess-gh.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
9 422 коммитов 101 ветка 22 Теги 482 MiB
Граф коммитов

230 Коммитов

Автор SHA1 Сообщение Дата
Michael Berlin cf87989c51 Change client protocols from BSON RPC to gRPC. 
This commit changes the following protocols:

- binlog_player_protocol
- vtctl_client_protocol

The only BSON protocol left is vtgate pending the implementation of the
gRPC vtgate client.

Note that we originally added this change in
https://github.com/youtube/vitess/pull/1230

However, we reverted it because the Kubernetes tutorial and images were
out of sync. Therefore, this commit technically is the revert of the
revert.

Revert "Revert "Change protocol defaults to grpc.""

This reverts commit 5e5f40a04e.
 2015-10-23 13:46:52 -07:00
Anthony Yeh 597503d3ee k8s: Fix vttablet-down.sh for removal of ScrapTablet. 2015-10-23 13:23:03 -07:00
Anthony Yeh c976134b8f backup: Use GCS backup in Kubernetes example. 2015-10-21 16:19:36 -07:00
Anthony Yeh 0b26d82823 k8s: container engine commands are no longer under 'gcloud beta' 2015-10-20 15:28:40 -07:00
Michael Berlin 5e5f40a04e Revert "Change protocol defaults to grpc." 2015-10-19 15:45:44 -07:00
Michael Berlin 3ee5d3d028 Change default client protocol for vtctld to "grpc" (from "gorpc"). 
Updated local and Kubernetes to start vtctld with gRPC now.
 2015-10-15 18:20:39 -07:00
Anthony Yeh c1671d8f4e Merge pull request #1210 from enisoc/sharding-doc 
Update horizontal sharding guide
 2015-10-14 14:04:58 -07:00
Sugu Sougoumarane cc20205dcc vttest, v3 demo: make vschema explicit 2015-10-14 11:54:38 -07:00
Sugu Sougoumarane 573f9f62b2 v3 demo: is now self-contained 
It's been changed to use vttest, and there is a script
that brings up everything, and tears down at the end.
The one problem with the new scheme is that the querylog
doesn't tell you which tablet the query came frome. Something
to think about in the future.
 2015-10-13 21:30:27 -07:00
Anthony Yeh 2a115d8969 examples/local: Add service_map whitelist for updatestream. 2015-10-13 17:56:45 -07:00
Alain Jobart 87693af4c7 Removing direct tablet access from python. 
One hack left in vtrouting.py, and then topology.py can go too.
Dean, I'll let you handle that one.
 2015-10-13 07:41:58 -07:00
Michael Berlin 84d9ab36b6 examples/kubernetes: Let sharded-vtworker.sh return an error when vtworker failed. 2015-10-06 20:23:40 -07:00
Anthony Yeh 93302cdc45 k8s: Add explicit service_map flag for updatestream. 2015-10-02 23:24:18 -07:00
Anthony Yeh abe6af6b80 guestbook: Add dependencies for protobuf and grpc. 
The Python libs import these now.
 2015-10-02 23:24:18 -07:00
Anthony Yeh a12c257d50 k8s: Fix templates for service_map whitelisting. 2015-10-02 23:24:18 -07:00
Joshua Thompson 6de712b4af Some fixes to k8s templates and bson client codec (currently used by YCSB client) 2015-10-01 18:22:58 -07:00
Anthony Yeh 3de6e1ddea Merge pull request #1149 from enisoc/k8s 
k8s: Make vtctld a replication controller, and other fixes.
 2015-09-30 09:56:59 -07:00
Anthony Yeh 96ccdfc0d6 examples/local: Add -service_map flags since bson is no longer default. 2015-09-28 11:21:29 -07:00
Anthony Yeh b8aa8fcf2b k8s: Make vtctld a replication controller, and other fixes. 
vtctld should be a replication controller rather than a single pod,
so it gets restarted if the node fails.

Also made other fixes as suggested in a review by some Kubernetes folks.
 2015-09-25 17:16:39 -07:00
Erez Louidor 0e36c01223 Merge remote-tracking branch 'upstream/master' 2015-09-22 18:35:51 -07:00
Erez Louidor fbfdb57799 Addressed comments 2015-09-22 17:48:39 -07:00
Anthony Yeh eaf140174f kubernetes: Root certs aren't always in /etc/ssl/certs 
Fixes #1112
 2015-09-21 15:28:50 -07:00
Anthony Yeh cdca786023 kubernetes: Fix get_node_ip() for Vagrant. 
Fixes #1114
 2015-09-21 15:22:08 -07:00
Anthony Yeh e830e28dea Make grpc the default for Go binaries talking to queryservice. 
Since go/bson no longer encodes the non-standard uint64 type,
it's not safe to send uint64 over bsonrpc for a field that is
unmarshaled into interface{}, since it will be unmarshaled as int64.

The only case where this happens is bind vars. We could fix bsonrpc
by switching it to use bson-encoded proto3 structs, since those
use concrete field types for bind vars rather than interface{}.

However, bsonrpc is deprecated anyway so instead of fixing it,
we will just switch to grpc for all clients written in Go that
talk to queryservice.
 2015-08-22 16:01:45 -07:00
Anthony Yeh b203fcda46 web/vtctld: Add new -web_dir flag everywhere -templates was. 2015-08-03 14:43:45 -07:00
Joshua Thompson f122b6fa96 Fix vitess-up.sh default initial master tablet 2015-07-24 17:40:30 -07:00
Joshua Thompson 8ba34e2b72 Fix vttablet-down.sh 2015-07-24 16:27:22 -07:00
Joshua Thompson 9637da9626 k8s: revert starting cell index back to 0 2015-07-22 15:53:05 -07:00
Joshua Thompson 4f18f37162 Update k8s scripts to allow for multiple cells 2015-07-22 11:33:38 -07:00
thompsonja fa0df9ad91 Merge pull request #873 from thompsonja/master 
K8s updates: split cluster scripts into separate files, use resource limits for vt jobs
 2015-07-13 15:28:57 -07:00
Joshua Thompson 56e0cec3d6 Another merge 2015-07-13 14:01:00 -07:00
Joshua Thompson 4240edd60c Merge v1 updates 2015-07-13 13:55:55 -07:00
Joshua Thompson 456ff7751b k8s: split cluster-*.sh into separate files, use resource limits for vtgate/vttablet templates 2015-07-13 13:48:56 -07:00
Anthony Yeh 31ec5d75db vtctld: Add experimental new web interface. 2015-07-13 11:46:28 -07:00
Anthony Yeh 20bca32bbc Add backup settings to local vttablet-up.sh. 2015-07-13 11:25:43 -07:00
Anthony Yeh 0cb01c33e7 Update docs for etcd v2. 2015-07-10 16:49:23 -07:00
Anthony Yeh aaeb818c3d Update Docker/Kubernetes configs to etcd v2.0.13. 2015-07-10 16:29:13 -07:00
Anthony Yeh 52ff1562a9 Fix kvtctl.sh for multiple args. 2015-06-29 14:58:13 -07:00
Anthony Yeh f21f5357d3 Kubernetes example: find address of vtctld automatically. 2015-06-29 14:52:43 -07:00
Anthony Yeh 26b54905b8 Add Sharding in Kubernetes guide to vitess.io. 2015-06-29 13:24:31 -07:00
Anthony Yeh 8cf50331b8 Add scripts and configs for sharded Kubernetes example. 2015-06-27 19:10:30 -07:00
Anthony Yeh 3856154fde Remove tablets from topology in vttablet-down.sh. 
Optionally, if we've been given the address of vtctld.
 2015-06-27 19:07:05 -07:00
Anthony Yeh 13a2de2df7 Add EMD keyspace_id comment in Guestbook app. 
This is needed for filtered replication to work.
 2015-06-27 17:41:04 -07:00
Anthony Yeh 3412631186 Allow uid_base to be specified in vttablet-up/down. 2015-06-27 15:10:56 -07:00
Anthony Yeh e8f8062888 Add rdonly tablets to example Kubernetes cluster. 
These will be needed for the sharding guide.
 2015-06-27 14:55:29 -07:00
Anthony Yeh 11d7b75728 Add multi-page feature to Guestbook sample app. 2015-06-23 17:37:01 -07:00
Anthony Yeh 4adaee2f39 Update Kubernetes API from v1beta3 to v1. 2015-06-23 13:18:27 -07:00
Anthony Yeh 9ab63da138 Update gcloud alpha commands to beta. 2015-06-23 12:07:26 -07:00
Joshua Thompson ab1a146daa /s/vttablet_type/tablet_type 2015-06-22 12:00:02 -07:00
Joshua Thompson dc4c08a7fd Add ability to create rdonly vttablets 2015-06-20 11:13:35 -07:00
Joshua Thompson 58904f3fd6 Assorted k8s updates for v1beta3 2015-06-13 12:35:53 -07:00
Anthony Yeh f3f221ccd3 Merge pull request #785 from enisoc/k8s-v1beta3 
Update Kubernetes example for v1beta3 API.
 2015-06-12 11:42:34 -07:00
Anthony Yeh 70a2f57632 Update Kubernetes example for v1beta3 API. 2015-06-11 17:15:25 -07:00
Anthony Yeh c8c19f80a2 Replace kubernetes README.md with a link to vitess.io. 2015-06-11 16:46:38 -07:00
Anthony Yeh 95cd866177 Make $KUBECTL default to just 'kubectl'. 2015-06-11 16:46:03 -07:00
thompsonja a626e8a1b5 Merge pull request #782 from thompsonja/master 
k8s benchmarking - use 'kubectl get nodes' to obtain node names
 2015-06-11 09:30:25 -07:00
Joshua Thompson c515de7dfa Use 'k8s benchmarking - use kubectl get nodes' to obtain node names 2015-06-10 15:59:24 -07:00
Anthony Yeh 7c475ace68 Update docs for new ApplySchema command. 2015-06-09 13:27:23 -07:00
Amith Tudur 11dc55ec73 fixes typo in newrelic instrumentation script 2015-06-07 10:38:23 +05:30
Joshua Thompson 3ac14de9a6 Couple small fixes 2015-06-01 11:20:25 -07:00
thompsonja c3aba2a40b Merge pull request #721 from thompsonja/update_kubectl 
replace gcloud alpha container kubectl with kubectl
 2015-05-26 17:09:05 -07:00
Joshua Thompson c13bf8dd20 Tweak README.md wording 2015-05-26 16:50:59 -07:00
Joshua Thompson 1e87496ad4 replace gcloud alpha container kubectl with kubectl 2015-05-26 15:50:21 -07:00
Anthony Yeh cbc39cd7b5 Add empty lines before bulleted lists in Markdown. 
The 'recarpet' Markdown converter we use doesn't convert bulleted lists
if they aren't preceeded by empty lines.
 2015-05-11 13:55:17 -07:00
Joshua Thompson f36f80c376 Updates for k8s updates to forwarding-rule/target-pool naming 2015-05-08 13:09:36 -07:00
thompsonja 889bf99e1e Merge pull request #629 from thompsonja/k8s_pin_vtgates 
Switched vtgate from controller to pod template to force them to specifi...
 2015-05-08 12:59:07 -07:00
Joshua Thompson 42b2e0df3b Reverted vtgate-down as well, added benchmarking version for pods 2015-05-07 15:21:48 -07:00
Joshua Thompson 848d2d64a8 Use vtgate pod template only when running benchmarks 2015-05-07 14:16:16 -07:00
Anthony Yeh c935f5ca06 Add extra_my_cnf for MySQL 5.6. 2015-05-05 15:30:56 -07:00
Anthony Yeh a872390683 Fix examples/local for MySQL 5.6. 2015-05-05 15:30:56 -07:00
Anthony Yeh b2c491f7b1 Build lightweight Docker images for deployment. 
The base images are meant for development, and include everything needed
to bootstrap and build Vitess.

For actual deployment, we can drop all the dev packages and just put the
binaries into a fresh image.

At this time, the savings in image size are:

vitess/base = 2.269GB -> vitess/lite = 568.4MB
vitess/etcd:v0.4.6 = 442.4MB -> vitess/etcd:v0.4.6-lite = 108.6MB

This makes Kubernetes pods start a lot faster, since each node has to
download the images.
 2015-04-27 17:05:06 -07:00
Joshua Thompson bbeef74751 Switched vtgate from controller to pod template to force them to specific nodes 2015-04-27 12:59:11 -07:00
Alain Jobart 4d915484a3 Merge branch 'master' into resharding 2015-04-14 16:45:54 -07:00
Joshua Thompson ebff43698d Add a separate shard_label parameter to vttablet templates 2015-04-14 10:51:09 -07:00
Alain Jobart 0fa5667d1a Merge branch 'master' into resharding 2015-04-14 06:59:16 -07:00
Joshua Thompson d8194b1fcb append/prepend xx to vttablet pod labels where shards start/end with - 2015-04-13 14:07:11 -07:00
Joshua Thompson 3ec4f078ea Updated k8s scripts for benchmarking efforts 2015-04-13 10:07:18 -07:00
Joshua Thompson f00174287b revert change to installing vtctlclient 2015-04-03 13:42:52 -07:00
Joshua Thompson 66f987ec02 Update kubernetes example 2015-04-03 11:48:22 -07:00
Joshua Thompson e513b116b0 Update kubernetes example 2015-04-03 11:45:28 -07:00
Alain Jobart 8683b27671 Updating doc in other places to use InitShardMaster. 2015-04-02 14:10:38 -07:00
Alain Jobart 260392e2ca Now updating Shard with new master. 
And converting the new master to 'master' type.
Fixing the directions tfor local cluster to use InitShardMaster.
 2015-04-02 14:01:24 -07:00
Anand Henry 5ad89a6a33 Benchmarking: increase connection pool for reads 2015-03-30 16:46:37 -07:00
Joshua Thompson 830a2f704d Remove debug line 2015-03-30 10:42:54 -07:00
Joshua Thompson 36f92aed51 Add separate benchmarking template 2015-03-30 10:42:00 -07:00
Joshua Thompson 5fb5703fc5 Enable support for running vttablets on SSD on GKE 2015-03-29 23:28:00 -07:00
Joshua Thompson cf612ea16f Force tablet onto specific nodes. Automatically deduce node count when creating a cluster. 2015-03-13 10:58:12 -07:00
Joshua Thompson 8098121c7e Support SSD flag. Remove hardcoded region in cluster-down.sh. Start vt pods in parallel in cluster-up.sh 2015-02-27 13:07:03 -08:00
Joshua Thompson 27090e1e9d Fix ListAllTablets result in README 2015-02-23 14:30:07 -08:00
Joshua Thompson d1a3443779 cleanup readmes, replace GCE w/ GKE 2015-02-23 14:28:03 -08:00
Joshua Thompson bac2f0d734 Fix shard keyranges in scripts and readme 2015-02-20 19:35:50 -08:00
Joshua Thompson b6ad069fd3 /s/CLUSTER_NAME/GCE_CLUSTER_NAME in cluster-down.sh 2015-02-20 14:31:25 -08:00
Joshua Thompson 820fcee562 Add cluster-{up,down}.sh for bringing up clusters on GCE. Modify vttablet scripts for multi-shard 2015-02-20 12:33:20 -08:00
Anthony Yeh 61d6cbbb01 Explain `init` versus `start` in local example. 
Fixes #362
 2015-02-06 13:29:08 -08:00
Anthony Yeh a7b7933637 Fail fast in *-down.sh scripts. 
This way the user is more likely to see the errors.

It's also easier to reason about the state of the system if you know the
script stopped at a certain point.
 2015-02-02 15:30:41 -08:00
Anthony Yeh 62a2e5a4d3 Make Kubernetes example run on Container Engine. 
Previously, it ran directly on Kubernetes in Compute Engine.
Running on Container Engine eliminates the need to worry about
setting up Kubernetes itself. It's still possible to run the
Vitess example on a bare Kubernetes deployment by setting the
KUBECTL environment variable accordingly.

[ci skip]
 2015-01-29 18:15:32 -08:00
Anthony Yeh 3a78145343 Log to stderr so it gets picked up by Kubernetes logsaver. 2015-01-27 16:05:48 -08:00
Shruti Patil a44c924550 Removed the dependency of topology from vtgate client. 2015-01-27 11:41:32 -08:00
Rushi Agrawal aa3b3f84a5 Fix trailing whitespaces if they're >=4 chars long 2015-01-27 15:07:35 +05:30
Rushi Agrawal b16f9014a3 Fix typo: s/client/click/ 2015-01-27 15:04:33 +05:30
Rushi Agrawal 6170ec9c85 Fix incorrect reference in examples/local/README.md 
vtctlclient binary is in $VTROOT, not $VTTOP
 2015-01-27 14:53:11 +05:30
Anthony Yeh 2a9ec17057 Migrate Kubernetes example from kubecfg to kubectl. 
This will allow the instructions to work in Container Engine, which only
supports the new kubectl (kubecfg is deprecated).

[ci skip]
 2015-01-26 18:02:15 -08:00
Anthony Yeh 1c8068e508 Clarify keyspace rebuild in Kubernetes example. 2015-01-21 19:27:04 -08:00
Anthony Yeh 4178df8c79 Fix guestbook example for _vt -> vt port rename. 2015-01-21 19:27:04 -08:00
Anthony Yeh b51111579f Fix local example client for _vt -> vt port rename. 2015-01-21 19:27:04 -08:00
Anthony Yeh 7858375ec7 Redirect output of daemons in local example. 
This prevents confusing output sent by background tasks to
the user's terminal while they're doing other things.
 2015-01-21 19:27:04 -08:00
Sugu Sougoumarane 38a1ae27bc demo -> examples/demo 2015-01-19 21:49:15 -08:00
Anthony Yeh 7626a30892 Add docs and scripts to bring up a local cluster. 2015-01-18 00:02:02 -08:00
Anthony Yeh 9961318e05 Use cell-local etcd service host, not each pod's IP. 2015-01-13 17:19:23 -08:00
Anthony Yeh ccb8bcc896 Automatically add local etcd cluster addresses to global etcd. 
On startup, the cell-local etcd instances will try to add or update the
cell record in global etcd. If global etcd isn't ready yet, the curl
command will fail and the startup script will wait 1 second and try
again.
 2015-01-13 15:08:58 -08:00
Anthony Yeh 64d0f56e2d Port the Kubernetes guestbook example app to Vitess. 2015-01-09 17:14:02 -08:00
Anthony Yeh d4ff9ba7fa Kubernetes example scripts should be run from their own dir. 
Since they access other files in their dir.

Fixes #301
 2015-01-08 14:45:27 -08:00
Anthony Yeh be5d61100a Use new built-in vttablet InitTablet in Kubernetes example. 2015-01-07 19:12:19 -08:00
Anthony Yeh 2e32152e44 Remove hacky ZooKeeper example for Kubernetes. 2014-12-19 00:20:40 -08:00
Anthony Yeh 20eb66c4cd Use etcd in Kubernetes example, and update to Kubernetes 0.6. 2014-12-19 00:19:26 -08:00
Anthony Yeh 3d4f767e4a Read topology from vtgate. 
This is a temporary work-around until the VTGate V2 client is
topology-free.
 2014-11-05 13:53:42 -08:00
Anthony Yeh c804bddf65 Use vitess/base Docker image for client commands. 
Instead of running as root with vitess/root. The user shouldn't need to
download any additional image since vitess/root has vitess/base as a
dependency.
 2014-11-05 13:33:17 -08:00
Anthony Yeh 5eb0c12476 Add Kubernetes config for vtgate, and a sample vtgatev2 client. 2014-11-04 17:38:02 -08:00
Anthony Yeh 40e8797d6a Enable rowcache in Kubernetes example. 
Without it, we can't do ApplySchemaShard -simple, because the replicas
will never notice the new schema and will fail to build query plans.
 2014-11-04 17:34:39 -08:00
Anthony Yeh fe532c2165 Add instructions for launching vttablet. 2014-10-31 17:02:39 -07:00
Anthony Yeh a0daec7ebc Wait for MySQL to come up and create database. 2014-10-31 16:52:36 -07:00
Anthony Yeh 3555cdd8ac First pass at vttablet config for Kubernetes. 2014-10-30 14:34:50 -07:00
Anthony Yeh 2000d1bd67 Create log dir in Kubernetes pod startup script. 2014-10-30 14:33:56 -07:00
Anthony Yeh 90c13997c0 Add Kubernetes version requirements. 2014-10-30 14:32:30 -07:00
Anthony Yeh b90cadec9d Remove obsolete zk Docker example. 
The useful parts of the zk Docker example have been absorbed into the
Kubernetes example. The Docker-only version is now broken anyway and
there's no point in fixing it since we're not planning to flesh out the
rest of Vitess in Docker-only mode.
 2014-10-28 13:40:53 -07:00
Anthony Yeh d8cc29491b Rename .markdown to .md and move Contributing.md 
The prevailing convention on GitHub seems to be .md

Also by moving CONTRIBUTING.md to the root, GitHub will automatically
link to it when someone tries to contribute:

https://github.com/blog/1184-contributing-guidelines
 2014-10-17 15:40:55 -07:00
Anthony Yeh 3720b0eb55 Create services before pods. 
This will become important with the new IP-per-service model:

https://github.com/GoogleCloudPlatform/kubernetes/pull/1402
 2014-10-14 12:49:40 -07:00
Anthony Yeh fb4a75378b Add Kubernetes config for vtctld. 2014-10-14 10:46:05 -07:00
Anthony Yeh 559e598458 First pass at Kubernetes support. 2014-10-14 10:46:05 -07:00
Anthony Yeh 0eeda5a74c Move Docker examples to top-level examples dir. 2014-10-14 10:46:04 -07:00