Граф коммитов

1552 Коммитов

Автор SHA1 Сообщение Дата
Ryszard Szopa 96b5b632f6 Initial version of the vtjanitor binary. 2014-03-13 10:04:07 -07:00
Ryszard Szopa c904ca3ef7 Initial version of the drifter janitor module. 2014-03-13 10:04:07 -07:00
Ryszard Szopa 162cd5700e Initial version of the vtjanitor framework. 2014-03-13 10:04:07 -07:00
Ryszard Szopa 703f46ef7a faketopo: module for mocking up tests that need to deal with the topology. 2014-03-13 10:04:07 -07:00
Alain Jobart d001797a76 Rebuild doesn't check parent. 2014-03-13 10:03:25 -07:00
Alain Jobart 13c7840093 Removing all checks from ShardExternallyReparented. 2014-03-13 09:32:57 -07:00
Sugu Sougoumarane 242e8a9048 Merge branch 'vtocc' 2014-03-11 10:56:59 -07:00
Alain Jobart 639ee62163 Merge branch 'master' into replication 2014-03-11 09:37:13 -07:00
Alain Jobart a7f1819486 Adding a flag to be able to specify vtaction full path. 2014-03-11 09:36:34 -07:00
Sugu Sougoumarane 0be1a35f76 queryservice: improved SET handling
Long overdue change: Receive interger values as int64
instead of float64 on SET statements.
Add a new SET parameter vt_allow_pass_dml so we can
test the feature.
2014-03-11 01:24:47 -07:00
Sugu Sougoumarane 58e8cbab3f queryservice: support for allow-pass-dml 2014-03-11 00:41:49 -07:00
Sugu Sougoumarane 81bbb6a4cf Fix typos 2014-03-10 16:55:30 -07:00
Alain Jobart 281579255b Disabling http, gob and json for RPC.
We only use bson, might as well reflect that.
2014-03-07 10:35:37 -08:00
Sugu Sougoumarane 5a560645d5 queryservice: sensitive mode flag wiring 2014-03-06 23:58:06 -08:00
Sugu Sougoumarane 8f3dbd8a7e queryservice: sensitive mode: alternate approach
The previous approach is causing too many random changes
in the code. The new approach of deciding what the display
query should be upfront should lead to a more robust scheme.
2014-03-06 22:15:45 -08:00
Sugu Sougoumarane db3548281e queryservice: sensitive mode: query plan change
query service is going to support sensitive mode where
it will suppress potentially sensitive info when displaying
diagnostics data.
This CL adds a new field to ExecPlan: AnonymizedQuery.
It's an anonymized version of the original query.
2014-03-06 18:51:00 -08:00
Alain Jobart de8060b3f1 Moving port parameter to servenv. 2014-03-06 10:31:49 -08:00
Alain Jobart 500c34e604 Moving secure ports to servenv.
That way all of our binaries can have it.
2014-03-06 09:26:35 -08:00
Alain Jobart edd9d18786 Adding support for unix socket files.
For all of our servers, and bson rpc python client.
Testing it in update_stream because it's simple.
2014-03-05 20:52:58 -08:00
Ryszard Szopa b176df19cd vtworker: worker that diffs two SQL sources. 2014-03-05 13:51:03 -08:00
Ryszard Szopa 2d53c68b1a servenv: Framework to display information about the running process at /debug/status. 2014-03-03 19:41:38 -08:00
Sugu Sougoumarane dde469494b Merge branch 'bson' 2014-03-01 15:11:54 -08:00
Sugu Sougoumarane 5789e34650 bson: convert custom marshalers to new API 2014-02-28 20:50:42 -08:00
Liang Guo e178bbcdf1 Fix timeout support in vtclient2 2014-02-28 10:46:04 -08:00
Liang Guo 20ffc49cd5 Fix timeout is being ignored 2014-02-27 16:17:32 -08:00
Alain Jobart b9ecc4cc02 Merge branch 'master' into replication 2014-02-27 11:01:29 -08:00
Alain Jobart 8cc57450ea Minor cosmetic changes, using a single channel. 2014-02-27 10:43:01 -08:00
Alain Jobart 6310d1b91d More robust version, test is automated now.
(test uses sudo and takes a long time, so it's ot possible
to run all the time).
2014-02-26 21:29:53 -08:00
Sugu Sougoumarane b4999d05ac bsongen: Slice support
Also changed ExpectIndex to SkipIndex. The check
is not worth it.
2014-02-26 15:09:30 -08:00
Alain Jobart 3a42ff8f18 Working version of primecache. 2014-02-26 13:03:41 -08:00
Alain Jobart d2dad3c71a First pass at primecache in go.
There is a feature test that allows us to run it and try it.
It doesn't work right now, mysqlbinlog doesn't return anything.
2014-02-26 10:58:17 -08:00
Liang Guo fdacea5dbc Merge branch 'master' of github.com:youtube/vitess 2014-02-25 14:56:32 -08:00
Sugu Sougoumarane 353168b71f bson: Plan B on encoding of QueryResult
Switching the types back to uint64, and encoding
to encode as unsigned instead of the other way round.
2014-02-25 14:05:52 -08:00
Sugu Sougoumarane faed110d1c bsongen: []byte support 2014-02-24 16:56:13 -08:00
Sugu Sougoumarane e1402b8c4f bsongen: EncodeInt
Also make some of the types match the encoding.
2014-02-23 19:19:40 -08:00
Sugu Sougoumarane e90e694e90 Increase tolerance for memcache timeout 2014-02-21 16:54:52 -08:00
Liang Guo 2e814f1050 Add connection timeout support in binlog player 2014-02-21 16:00:50 -08:00
Liang Guo 6be8a50f4e No timeout for streaming in VTGate 2014-02-21 14:23:19 -08:00
Sugu Sougoumarane 1d49fc1173 Merge branch 'monitoring' 2014-02-21 12:07:15 -08:00
Sugu Sougoumarane ecd456cb54 Implement queryz
First cut of queryz. For now, it orders queries by
average latency. We'll need to support more features
on this page.
2014-02-21 09:56:14 -08:00
Alain Jobart d8609f674d Merge branch 'replication' 2014-02-20 09:39:24 -08:00
Alain Jobart e9c954b6a3 Linking topo BlacklistedTables to query service.
And correctly restart the query services when conditions
change. See comment in code.
2014-02-20 09:22:54 -08:00
Sugu Sougoumarane fbc43fbf14 Merge branch 'monitoring' 2014-02-19 21:05:07 -08:00
Sugu Sougoumarane a00edab0f3 Add comment about why upserts are unsafe 2014-02-19 21:03:09 -08:00
Alain Jobart bc9a0376cc Merge branch 'master' into replication 2014-02-19 20:45:53 -08:00
Alain Jobart 054be90b60 Addressing comments from review. 2014-02-19 20:45:15 -08:00
Sugu Sougoumarane 164c1892bb Categorize upserts as PASS_DML
Upserts are not safe for statement based replication:
http://bugs.mysql.com/bug.php?id=58637
So, vttablet now categorizes it as pass-though DML,
which will eventually get rejected because of
update stream & rowcache.
In the future, we can allow a 'dumb mode' where
PASS_DML plans are allowed if people don't care
about rowcache or update stream.
2014-02-19 14:09:45 -08:00
Liang Guo 54fea5670e Merge branch 'master' of github.com:youtube/vitess 2014-02-19 13:11:29 -08:00
Alain Jobart 995ff9ed11 Merge branch 'master' into replication 2014-02-19 11:05:50 -08:00
Alain Jobart 7f4d2dd635 Merge branch 'master' of github.com:youtube/vitess 2014-02-19 11:05:37 -08:00
Alain Jobart adc9050f14 Adding ShardRemoveCell command. 2014-02-19 11:04:43 -08:00
Alain Jobart 6e86e0f69b Fixing all bson encoders to support extra fields.
In the process, fixing a bug in '*Session' decoding,
where a field with a 'bson.Null' kind would fail.
2014-02-19 10:19:12 -08:00
Liang Guo 183ee58a30 Adding timeout support in VTGate 2014-02-18 23:40:21 -08:00
Sugu Sougoumarane 04325bae34 Formatting tweaks 2014-02-18 20:42:19 -08:00
Sugu Sougoumarane 836aa3174e querylogz 2014-02-18 20:25:55 -08:00
Sugu Sougoumarane 50cc660031 Fix test for unrecognized tag 2014-02-18 15:13:09 -08:00
Alain Jobart 37c0ce938b Dropping the logging for unknown fields. 2014-02-18 12:31:51 -08:00
Alain Jobart fff5576886 Making svrshard objects backward compatible
With bson decoding. I wanted to add a new field to SrvShard,
but I can't as is.

Sugu, I'd like to monitor the unknown fields, instead of logging them.
Let's talk about it.
2014-02-18 10:57:14 -08:00
Sugu Sougoumarane dcc7900c92 txlogz first cut. 2014-02-16 21:54:08 -08:00
Sugu Sougoumarane 763a1dd8ee Improved streamlogger.
Simplified the streamlogger code.
Extended it to allow for local non-http subscribers.
Added tests.
The non-http subscription will be used for additional
monitoring and status reporting.
2014-02-16 11:02:54 -08:00
Sugu Sougoumarane aa53bd3164 query_rules can now filter by table names. 2014-02-15 15:01:09 -08:00
Sugu Sougoumarane 7c13251cc5 Check dbname in rowcache invalidator. 2014-02-15 13:39:42 -08:00
Sugu Sougoumarane 5c1bb4d090 Merge branch 'rowcache' 2014-02-14 21:17:31 -08:00
Sugu Sougoumarane 37d457c2b6 Minor tweaks to the query service API. 2014-02-14 21:14:52 -08:00
Alain Jobart 0354cdf92e Merge branch 'master' of github.com:youtube/vitess 2014-02-14 20:08:51 -08:00
Alain Jobart 09792f7be5 Small fix in error message. 2014-02-14 20:08:29 -08:00
Sugu Sougoumarane 09dcc4ea57 Merge branch 'rowcache' 2014-02-14 17:25:46 -08:00
Sugu Sougoumarane 3e7db5bc00 Rowcache invalidator launch revamp
- Rowcache invalidator is now launched as part of query service
- vtocc can also launch rowcache invalidator, with new flag binlog-path
- Explicit flags: enable-rowcache, enable-invalidator
- vtocc also needs dba credentials for invalidator
- New sync2.ServiceManager for managing goroutine start & stop
2014-02-14 15:14:33 -08:00
Alain Jobart a4f1b89638 Adding Shard deletion code, using it in test. 2014-02-14 14:09:38 -08:00
Alain Jobart 0c8d6c3dcc Merge branch 'replication' 2014-02-14 11:15:15 -08:00
Alain Jobart 124ba11ff8 Small fixes from review. 2014-02-14 11:13:53 -08:00
Alain Jobart 90aeb7658c Now supporting wildcards for keyspaces and shards. 2014-02-14 10:40:36 -08:00
Ryszard Szopa 8910e779e6 Merge branch 'slave-was-restarted' 2014-02-13 12:03:07 -08:00
Liang Guo 32071a011c Fix AllErrorRecorder func name 2014-02-13 08:36:23 -08:00
Liang Guo 7f8c56059c Fix integration test 2014-02-12 21:50:24 -08:00
Liang Guo edc2cdd338 Merge branch 'master' into liguo 2014-02-12 20:43:36 -08:00
Liang Guo 7b9546a5e5 Fix VTGate logging and tests 2014-02-12 20:26:17 -08:00
Ryszard Szopa 3da78ae72e SlaveWasRestarted is now a wrangler exported method. 2014-02-12 16:59:38 -08:00
shrutip af61decc7f Added missing test to Makefile. 2014-02-12 15:59:45 -08:00
shrutip 59a088e3af ServedFrom support in vtgate with the tests. 2014-02-12 15:25:57 -08:00
shrutip 78f11ffca9 WIP Framework for re-resolution of keyspace and servedFrom implementation. 2014-02-12 15:25:57 -08:00
Alain Jobart 744b43797f Fixing a few details. 2014-02-12 13:00:20 -08:00
Alain Jobart aa9652fdef Merge branch 'master' into replication 2014-02-12 11:26:44 -08:00
Alain Jobart e6ccfa2dd0 Properly handling bytes EMD comment. 2014-02-12 11:25:06 -08:00
Liang Guo a5ade6aea0 Modify AllErrorRecorder to properly store errors 2014-02-11 15:33:33 -08:00
Sugu Sougoumarane 73bfbdc451 Merge branch 'rowcache' 2014-02-10 16:46:19 -08:00
Sugu Sougoumarane efa816f87b Better cleanup and improved readability.
If query_engine fails to start, it doesn't cleanup properly.
Somehow, this hasn't bitten us yet. Fixed now.
Methods checking for nil is not a common code pattern.
To prevent confusion, I've moved the nil checks one level up,
which is what people usually do.
2014-02-10 16:06:22 -08:00
Alain Jobart cfa03047c0 Making use-served-types the default.
Now when we rebuild a keyspace, we use the shard's ServedTypes
by default.
2014-02-10 10:07:20 -08:00
Sugu Sougoumarane 7c7b770eba Ignore cross-db transactions in rowcache invalidator 2014-02-09 14:10:04 -08:00
Sugu Sougoumarane 7f65741675 Convenience function to detect cross-db DMLs. 2014-02-09 08:48:12 -08:00
Sugu Sougoumarane 959c21ec7d Allow cross-db DMLs in the parser.
Changed parser to allow cross-db DMLs like:
UPDATE a.b...
These constructs will always become PASS_DML plans, which
will eventually be blocked on execution to protect update stream.
We need to allow the syntax to make sure that the rowcache invalidator
can parse and ignore such spurious DMLs introduced by
a non-vttablet process, but which don't affect rowcache.
2014-02-08 19:16:23 -08:00
Sugu Sougoumarane 18a5039a7f More resilience for rowcache_invalidator
Make binlog parser send unrecognized statements instead
of failing. This lets the subscriber handle the error.
2014-02-08 15:47:32 -08:00
Alain Jobart 5dd0582c22 Merge branch 'replication' 2014-02-07 10:23:51 -08:00
Alain Jobart 28ec8c76c7 Closing RPC connection in case of failure. 2014-02-07 10:17:29 -08:00
shrutip 153c69bfc1 Reintroduced StreamExecuteShard and rolled back the client to call that. 2014-02-06 11:05:25 -08:00
Liang Guo d80cb4b30f Merge branch 'master' of github.com:youtube/vitess 2014-02-06 08:42:27 -08:00
Sugu Sougoumarane 50ea2db4a6 Merge branch 'rowcache' 2014-02-05 17:59:07 -08:00
Liang Guo d080fced7a Minor fix to log string 2014-02-05 17:39:28 -08:00
Sugu Sougoumarane 97487eb575 More resilient Rowcache invalidator
Changed rowcache invalidator to:
1. Keep retrying on unexpected errors.
2. Not to stop query service. This is done by the tablet manager.
2014-02-05 17:00:16 -08:00
shrutip 2de49727e7 Test for SrvKeyspace bson encoding and decoding and small fixes. 2014-02-05 15:41:17 -08:00
shrutip d38b48be8a Test for ServedFrom in the client and fixes to bson encoding of SrvKeyspace. 2014-02-05 15:41:17 -08:00
Alain Jobart afc970a259 Disabling ContinueOnUnexpectedMaster. 2014-02-03 11:21:19 -08:00
Alain Jobart 4fb827fcec Adding a test for json/bson encoding. 2014-02-03 09:51:54 -08:00
Alain Jobart be8a9544c6 Merge branch 'master' of github.com:youtube/vitess 2014-01-31 17:00:38 -08:00
Alain Jobart ab9e3b267c Fixing a small detail. 2014-01-31 13:30:16 -08:00
Alain Jobart 6b580d1ab1 Refactoring mysql passwords for CredentialServer.
We now ask the CredentialsServer everytime we connect for
an up to date password. Refactor code everywhere to use that
feature, and not duplicate mysql.ConnectionParams everywhere.
2014-01-31 13:21:33 -08:00
shrutip 31428b60d7 Post-merge fixes. 2014-01-31 01:47:09 -08:00
shrutip 97625ca7a7 Change in api for StreamExecuteKeyRange and vtgate tests. 2014-01-31 01:31:06 -08:00
shrutip 8ab0dd92d9 Changed StreamQueryKeyRange to accept only one keyrange. 2014-01-31 01:29:56 -08:00
shrutip 14925feaf7 Replaced SessionId to Session to make it compatible with previous protocol changes. 2014-01-31 01:27:27 -08:00
shrutip ed7a6c97b3 Api, functional changes and test for StreamExecuteKeyRange. 2014-01-31 01:22:53 -08:00
shrutip 0a767f58ab Added function to derive shard name for SrvShard. 2014-01-31 01:03:50 -08:00
shrutip 4d66eaf0e4 Added bson encode and decode functions for KeyRange Arrays. 2014-01-31 01:03:50 -08:00
Alain Jobart 5360e083e1 Supporting plug-ins for DB credentials.
Might want to get passwords from another source some day...
2014-01-30 11:01:30 -08:00
Alain Jobart 047810c7bc Adding a ReloadSchema command. 2014-01-29 16:33:03 -08:00
Alain Jobart ef290159c4 Fixing all unit tests. 2014-01-29 14:12:36 -08:00
Alain Jobart 42ec640375 Now forwarding the context through vtgate. 2014-01-29 12:45:38 -08:00
Alain Jobart 4424825b4b Fixing unit tests. 2014-01-29 11:47:19 -08:00
Alain Jobart 47346a81e0 Simplifying registration glue. 2014-01-29 11:42:05 -08:00
Alain Jobart 09dacd4df3 Updating comments. 2014-01-29 11:31:57 -08:00
Alain Jobart 0f2b1fb010 Move server side of vtgate to its own package. 2014-01-29 11:23:23 -08:00
Alain Jobart 443b8859c8 Merge branch 'master' of github.com:youtube/vitess 2014-01-29 10:42:04 -08:00
Alain Jobart 9ab7218b62 Fixing package name. 2014-01-29 10:41:36 -08:00
Sugu Sougoumarane ccb7c11732 Merge branch 'rowcache' 2014-01-29 09:12:12 -08:00
Sugu Sougoumarane b4a7090051 Disallow PASS_DML plan
PASS_DML doesn't play well with rowcache, update stream,
and filtered replication. Blacklisting it for now.
We'll need to later clean up the code paths that lead to
it once things stabilize.
2014-01-29 07:30:54 -08:00
Alain Jobart 778beca049 Removing passowrd support from sharded.go.
It's handled via protocol-specific plugin now.
2014-01-28 17:27:48 -08:00
Alain Jobart f738d5ffc0 Now the client2 library uses tabletconn.
Same as vtgate. Code re-use, woohoo!
2014-01-28 17:14:09 -08:00
Alain Jobart dbcbe209b1 Fixing test after tabletconn change. 2014-01-28 16:33:55 -08:00
Alain Jobart c71c5a1b33 Moving client side of queryservice to its own lib. 2014-01-28 16:26:45 -08:00
Alain Jobart 428e929fdb Adding context, removing unused params. 2014-01-28 15:48:40 -08:00
Alain Jobart 99dad4d1ff Gorpc service is now a plugin for vttablet/vtocc 2014-01-28 15:30:22 -08:00
Alain Jobart d6df975c90 Refactoring sharded.py test.
Changing the client2 library to register more consistent
topo servers, and use the default topo server.
2014-01-28 14:21:34 -08:00
Alain Jobart d15a001bb8 Adding continueOnUnexpectedMaster flag. 2014-01-28 10:35:11 -08:00
Sugu Sougoumarane 41f5435e17 Merge branch 'rowcache' 2014-01-27 15:44:06 -08:00
Alain Jobart 1022febc83 Merge branch 'replication' 2014-01-27 15:36:57 -08:00
Alain Jobart dcd66642de Merge commit 'a64f1a634ff57f3902770cfc75bd10249d898245' 2014-01-27 15:36:42 -08:00
Alain Jobart 1ae834cbe8 Adding missing parts of API. 2014-01-27 15:35:24 -08:00
Sugu Sougoumarane 50b5cf6bd2 Handle unrecognized DDLs as non-fatal.
Stopping query service for unrecognized DDLs is too abrupt.
Instead, increment the InternalErrors.Invalidation counter
so we can tie that variable to an alert.
2014-01-27 15:30:49 -08:00
Liang Guo 893a2afa0e Add unit test for vtgate picking up new vttablet port 2014-01-27 14:37:36 -08:00
Liang Guo 639ce8b2a3 Fix bug where vtgate does not pick up new vttablet port after marking it down 2014-01-27 14:01:38 -08:00
Alain Jobart a64f1a634f Fixing tests in here. 2014-01-27 12:03:20 -08:00
Alain Jobart 5af902d026 Switching a few more places to glog. 2014-01-27 11:59:14 -08:00
Alain Jobart 3616ccf727 Typing the UpdateStream replies. 2014-01-27 11:29:43 -08:00
Alain Jobart 98a191c89b Adding registration for server side of binlog. 2014-01-27 10:50:40 -08:00
Alain Jobart 0d23f4e343 Adding registration mechanism for bl player. 2014-01-27 10:32:25 -08:00
Alain Jobart 8aa9dca8cf Moving binlog into its own package. 2014-01-27 09:49:54 -08:00
Alain Jobart df1955d3c9 Adding gorpctmclient to this test. 2014-01-24 13:41:29 -08:00
Alain Jobart 544435eca9 Fixing package name. 2014-01-24 11:51:29 -08:00
Alain Jobart 67ea8c4be5 Moving tabletmanager client to its own lib
Most dependencies for clients are now clean, they don't
include server code.
2014-01-24 11:04:48 -08:00
Alain Jobart fb06b338ca Now moving gorpc tabletmanager client. 2014-01-24 10:47:55 -08:00
Alain Jobart e922dda5c8 Another refactor of tabletmanager structures. 2014-01-24 10:35:08 -08:00
Alain Jobart 9ff3d03fb4 Refactoring server side of tabletmanager rpc. 2014-01-24 10:21:51 -08:00
Alain Jobart 85e0efc2f3 More work towards moving rpc code.
Now rpc_server_bson.go can move, I think.
2014-01-24 10:05:07 -08:00
Alain Jobart b25b0a7e88 Simplifying rpc_server to be agent methods. 2014-01-24 09:58:03 -08:00
Alain Jobart ee0e4f6446 Not passing MycnfFile to agent now.
Can get it from mysqld directly.
2014-01-24 09:46:54 -08:00
Alain Jobart 66b97c3323 Now checking MySQL port after every action. 2014-01-24 09:37:34 -08:00
Alain Jobart be9a2cb521 moving blpposition to proto 2014-01-23 16:02:16 -08:00
Alain Jobart 646215e9bb moving permissions structs to proto. 2014-01-23 14:46:43 -08:00
Alain Jobart d7a2135441 Moving mysqlctl/replication into proto 2014-01-23 14:37:10 -08:00
Alain Jobart 07517f0d4b Moving shcema objects into mysqlctl/proto 2014-01-23 13:53:27 -08:00
Alain Jobart 26803212c1 Moving ActionNode constructors to actionnode 2014-01-23 13:35:46 -08:00
Alain Jobart c64eba6221 Moving ActionNode to its own package. 2014-01-23 12:22:06 -08:00
Alain Jobart 1e2f3256df Fixing error message. 2014-01-22 19:13:02 -08:00
Alain Jobart 201998337d Now re-reading mysql server port when re-parenting 2014-01-22 17:28:22 -08:00
Alain Jobart 79437da07a Adding test for new tablet field. 2014-01-17 14:37:19 -08:00
Alain Jobart bd91064ec3 Adding blacklisting to vertical split.
The query service dosn't do anything with it yet,
but soon.
2014-01-17 14:34:43 -08:00
Sugu Sougoumarane ef68f4a115 Fix typo 2014-01-17 10:33:25 -08:00
Sugu Sougoumarane f9134f3703 Comment out flaky tests 2014-01-17 09:14:41 -08:00
Sugu Sougoumarane aa39eda497 Merge branch 'vtgate' 2014-01-16 17:57:17 -08:00
Alain Jobart 2756d39773 Removing the tabletmanager->tm rename. 2014-01-16 11:24:38 -08:00
Alain Jobart e51056d211 Now handling schema being a superset on source. 2014-01-16 10:41:20 -08:00
Alain Jobart d1c022dcc6 Adding vertical diff code and test. 2014-01-16 10:08:28 -08:00
Sugu Sougoumarane cc43a41f58 Alternate error mechanism
rpcplus can only return a response or an error, not both.
Since we have to return a session for every execute request,
we cannot return errors the traditional way. So, the error is
now returned as part of the response, which will also contain
the updated session info.
2014-01-15 23:49:24 -08:00
Sugu Sougoumarane 7dc8438210 Merge branch 'master' into vtgate 2014-01-15 21:30:21 -08:00
Alain Jobart 3d229b634d Adding MigrateServedFrom command. 2014-01-15 15:45:53 -08:00
Alain Jobart 532f502008 Adding ServedFrom in the keyspace code. 2014-01-15 14:18:19 -08:00
Alain Jobart eee6cc1af0 Implementing and testing tables filter. 2014-01-15 13:38:45 -08:00
Alain Jobart 4ad525d326 Using proper case in KeyRange. 2014-01-15 10:56:46 -08:00
Alain Jobart 6e9dce58a7 Plumbing for table filtering. 2014-01-15 10:51:02 -08:00
Alain Jobart 9e4b708710 Adding table list to SourceShard. 2014-01-15 10:25:59 -08:00
Alain Jobart 368b9d9da1 Multirestore now works for tables. 2014-01-15 10:03:59 -08:00
Alain Jobart a7a35961b8 Fixing the keyRanges for multirestore.
They happened to work for splits, wouldn't have worked for merges.
2014-01-15 09:47:33 -08:00
Alain Jobart 08ab756c19 Adding test for plain csv reader. 2014-01-14 18:02:23 -08:00
Alain Jobart 69a8534955 New multisnapshot for subset of tables now works. 2014-01-14 17:46:49 -08:00
Sugu Sougoumarane be67244006 tablet_api uses mproto structs
Changing tablet_api to use mysql/proto structs instead of
vtgate/proto. This simplifies many things, and avoids
future circular dependencies for stubby glue code.
2014-01-14 17:43:58 -08:00
Sugu Sougoumarane 3b8930aafe Reorder TabletType in structs: better consistency 2014-01-13 14:04:53 -08:00
Sugu Sougoumarane 2558d7783e Sessn -> Session 2014-01-13 11:04:51 -08:00
Sugu Sougoumarane 19a586820e vtgate.py done 2014-01-12 19:47:03 -08:00
Sugu Sougoumarane 188e06b225 Merge branch 'master' into vtgate 2014-01-12 15:25:32 -08:00
Sugu Sougoumarane c421652c47 Fix race conditions in tests 2014-01-12 15:24:39 -08:00
Sugu Sougoumarane cd338b243b vtgate_test done 2014-01-12 11:21:39 -08:00
Sugu Sougoumarane a52d9d600c scatter_conn_test done 2014-01-11 20:31:53 -08:00
Sugu Sougoumarane 3cd5d4b254 shard_conn_test done 2014-01-11 16:56:37 -08:00
Sugu Sougoumarane e569392844 Better formatting of long lines. 2014-01-10 20:26:04 -08:00
Sugu Sougoumarane 56ff3cbb49 vtgate_proto tests 2014-01-10 14:05:47 -08:00
Alain Jobart dde8a61724 Small cleanup in this file. 2014-01-10 12:49:23 -08:00
Sugu Sougoumarane 967f1c7380 drop balancer_map 2014-01-10 11:03:05 -08:00
Sugu Sougoumarane fbc5d60f5e remove infinipool 2014-01-10 11:00:10 -08:00
Sugu Sougoumarane ce0c72a124 Sessionless VTGate rewrite: WIP (it builds) 2014-01-10 00:55:41 -08:00
Sugu Sougoumarane 8c574d50d2 Sessionless VTGate rewrite: WIP (not building yet) 2014-01-09 15:13:46 -08:00
Alain Jobart a98ad0dee8 Fixing CSV format for hex. 2014-01-09 10:27:50 -08:00
Alain Jobart cf1b5df03d Fixing differ to work with key.KeyspaceIdType. 2014-01-09 09:53:56 -08:00
Alain Jobart d585cee219 Supporting hex in csvsplitter. 2014-01-09 09:30:40 -08:00
Alain Jobart 48359afb33 Using keyspace's type in multisnapshot. 2014-01-08 14:54:34 -08:00
Alain Jobart 6f5f591553 Moving keyspace id type to key.
I need it in mysqlctl, which is lower than topo.
2014-01-08 14:28:59 -08:00
Alain Jobart 3b73edfdfc Using GetShardCritical for reparents.
We already have the lock on the shard anyway, so global
topo server is working for sure.
2014-01-08 10:54:31 -08:00
Alain Jobart 20a8425689 Adding SetKeyspaceShardingInfo.
Also adding Sharding fields to SrvKeyspace.
2014-01-08 10:31:33 -08:00
Alain Jobart 8b239c8fe4 Basic support for sharding key name and type. 2014-01-08 09:50:43 -08:00
Ryszard Szopa 499abf0e60 Fix typo. 2014-01-07 18:08:40 -08:00
Ryszard Szopa 99cde1e6ac ShardExternallyReparented uses a critical read when rebuilding the shard graph. 2014-01-07 18:01:30 -08:00
Ryszard Szopa da5bb5b38d Add GetShardCritical to topology.Server API. 2014-01-07 13:53:55 -08:00
Sugu Sougoumarane 65b2ce058a Nifty technique to reuse boiler-plate code. 2014-01-03 17:26:49 -08:00
Sugu Sougoumarane 2c4ad6c923 Add .9 precision for nanosecond accuracy. 2014-01-03 12:17:25 -08:00
Sugu Sougoumarane 4c691db695 Change streamlogs to not use scientific notation. 2014-01-03 11:56:10 -08:00
Alain Jobart 569b40e32c Implementing binlog player StartUntil. 2013-12-27 15:43:17 -08:00
Alain Jobart 7c85fa4411 Moving some topo code into a small library. 2013-12-27 10:35:49 -08:00
Alain Jobart 93704bbadf Better diff report display. 2013-12-26 15:39:16 -08:00
Alain Jobart 8df31d5907 Fixing a couple issues in diff.
1. need to reset wrangler timeout before calling ChangeType.
2. using more local variables for state names.
2013-12-26 14:53:25 -08:00
Alain Jobart f0c939e20b Refactoring diff tools a bit. 2013-12-26 11:59:34 -08:00
Alain Jobart 382d2caed9 Now using time.Duration everywhere in rpcs.
We used to have times in seconds for some reason.
2013-12-26 09:48:26 -08:00
Alain Jobart 7a88118c74 Fixing concurrency on RPC calls with no param. 2013-12-26 09:24:41 -08:00
Sugu Sougoumarane db9747fa21 Merge branch 'vtgate' 2013-12-24 15:25:43 -08:00
Sugu Sougoumarane 064d69300d go vet cleanup 2013-12-24 15:24:45 -08:00
Ryszard Szopa f6c8c38157 Wrangler.ChangeTypeNoRebuild, a bit of refactoring. 2013-12-20 17:06:54 -08:00
Alain Jobart fc0ca0a272 Move BlpPositionList down to mysqlctl. 2013-12-20 15:49:10 -08:00
Alain Jobart 64f5c757d8 Fixing fatal -> fatalf 2013-12-20 14:56:25 -08:00
Alain Jobart a6bfc7b1e8 Fixing the tag order in diff job. 2013-12-20 14:22:58 -08:00
Alain Jobart 24b1d2a058 Adding a missing close on the listening socket. 2013-12-20 14:07:24 -08:00
Alain Jobart 8530ffb3f1 Fixing ListeningURL in servenv. Adding QPS to diff. 2013-12-20 13:58:16 -08:00
Alain Jobart fb3dc43b25 Splitting IsServingType.
Into IsInServingGraph for types that are exposed to the serving
graph, and IsRunningQueryService for types that are running
the query service. Easier to individually manipulate them now.
2013-12-20 12:21:10 -08:00
Alain Jobart 440d729758 Comparing row types before the diff now. 2013-12-20 12:06:25 -08:00
Alain Jobart deb3a55076 Adding 'worker' tag to tablet.
When a worker is working on a tablet, add a URL that
points back to the worker.
2013-12-20 11:36:23 -08:00
Alain Jobart 796edd7570 Re-organizing code a bit, adding comments. 2013-12-20 11:06:25 -08:00
Alain Jobart 48189f7bb9 Adding mysql types to go/mysql/proto.
Using them in client2 and diff_utils.
2013-12-20 10:46:06 -08:00
Alain Jobart 0c2cf952e5 Merge branch 'master' into replication 2013-12-19 18:19:11 -08:00
Alain Jobart cb3e2d2f80 Merge commit '865c9ff07febad76b56ec75913c75c5dc0ad1866' 2013-12-19 18:18:55 -08:00
Alain Jobart f45c5535a2 General clean up. 2013-12-19 17:26:45 -08:00
Alain Jobart ffccb84685 Adding keyrange and handling diff better. 2013-12-19 16:48:37 -08:00
Alain Jobart b8c1b1f94c Checkpoint of more differ work.
Changing TYPE_CHECKER to have query service enabled.
The diff is still missing a few things, and comparing PK
values is the sticky point for me now.
2013-12-18 23:37:25 -08:00
Alain Jobart 9a53e1a772 Now also returning primary key columns.
So the schema is more complete and useful.
2013-12-18 21:05:45 -08:00
Liang Guo 9eccebf797 Rename rowcache parameter names 2013-12-18 16:23:44 -08:00
Alain Jobart 865c9ff07f Merge branch 'master' into replication 2013-12-18 13:27:32 -08:00
Alain Jobart ebec282139 Merge branch 'master' of github.com:youtube/vitess 2013-12-18 13:27:16 -08:00
Alain Jobart d7d49ba99a Almost finishing synchronizeReplication.
Only missing part is the run binlog client until group_id
code, but that requires lower layer changes.
2013-12-18 13:25:47 -08:00
Alain Jobart f994d4e5fa Implementing phase 2 of synchronizeReplication.
Phase 2 of synchronizeReplication for split_diff is to
stop all the source 'checker' at a binlog position higher than the
destination master. This has all the plumbing for it.
2013-12-18 11:45:11 -08:00
Sugu Sougoumarane 6e13a72f92 Merge branch 'vtgate' 2013-12-18 09:53:52 -08:00
Alain Jobart a272a5b993 Group id is now always an int64. 2013-12-18 09:43:13 -08:00
Sugu Sougoumarane e415c1269a vtgate: stateless sessions WIP
InfiniPool initial implementation. We need a connection pool
since we won't be reserving connections to clients.
2013-12-17 20:12:29 -08:00
Alain Jobart 18202cfc6f Merge branch 'master' into replication 2013-12-17 15:17:45 -08:00
Alain Jobart 261c72e341 Fixing bug in GetTabletMapForShardByCell.
The master was exported to all the cells. Adding a unit
test to prove it's not happening any more.
2013-12-17 14:42:38 -08:00