Граф коммитов

462 Коммитов

Автор SHA1 Сообщение Дата
Anthony Yeh 0fb0a0fd00 Merge branch 'typofixes-vlajos-20141204' of github.com:vlajos/vitess into vlajos-typofixes-vlajos-20141204 2014-12-04 14:53:41 -08:00
Veres Lajos 18fb59b104 typofixes - https://github.com/vlajos/misspell_fixer 2014-12-04 22:33:57 +00:00
shrutip 810281bed0 Merge pull request #203 from youtube/vtclient
Improved the cursor creation api and changed vtgatev2 test to use cursor
2014-12-04 10:40:06 -08:00
Shruti Patil b3309a50bc Remove unused vtgate client. 2014-12-03 22:47:40 -08:00
Shruti Patil f80989d9e3 Improved the cursor creation api and changed vtgatev2 test to use cursor
api where possible.
2014-12-03 13:10:20 -08:00
Anand Henry 5984be80b2 Exponential backoff retry in VtGate client 2014-11-26 11:30:22 -08:00
Anand Henry 6aa70b298d Add ThrottledError exception 2014-11-25 19:37:40 -08:00
Shruti Patil d64aafc402 Explicit conversion of exception args to tuple. 2014-11-25 14:53:06 -08:00
Shruti Patil 48c11c0884 Pruned the query out of the integrity error. 2014-11-24 14:22:49 -08:00
Shruti Patil 2f3032b4fb Add a mechanism to log private data from exceptions and use case for bind_variables. 2014-10-29 10:32:46 -07:00
Sugu Sougoumarane ce89746dab tabletserver: list bind vars support complete
You can now specify a new syntax for queries that
have an IN clause:
select * from t where id in ::list
The corresponding bind variable would be:
{"list": field_types.List([1,2,3])}

- List bind vars are only allowed for IN and NOT IN clauses.
- A bind variable can be a list if and only if
  it's referred as ::list.
- A list must contain at least one value.

For the python client, you need to supply lists using the
field_types.List class. This is because of legacy behavior
where lists were previously encoded as strings.
We should soon change this API to use native lists once we
confirm that no one will be affected by this change.
2014-10-24 13:53:25 -07:00
Shruti Patil 9e7097dffa Handle IntegrityError separately, fixed vtgatev2_exception handling. 2014-10-16 14:23:49 -07:00
Shruti Patil 294ff00758 Fixed KeyRange object and associated references. 2014-10-14 14:21:57 -07:00
Liang Guo dc219fa07a Fix vtrouting.py 2014-10-13 14:43:34 -07:00
Shruti Patil 597f882b4a small linter improvements. 2014-10-13 09:42:58 -07:00
Shruti Patil 80b4fb9836 Refactored keyrange.py and added documentation. 2014-10-13 09:42:58 -07:00
Peter Lobsinger 508a51b49a Rename to 'refresh' since 'update' is a semantically loaded term in Python. 2014-10-08 16:17:55 -07:00
Peter Lobsinger cf7fa28e87 Be more flexible with addresses in ZkOccConnection.
Allow the set of zkocc hosts to be updated. Also, limit the number of
dial attempts for any given operation - this is useful when the set of
zkocc hosts gets large.
2014-10-07 22:04:09 -07:00
shrutip 228de94bac Removed v1bson protocol and its usage. 2014-10-01 11:15:44 -07:00
shrutip 7fa963a997 Fixed the BatchCursor to use the correct api for execute. 2014-10-01 11:15:43 -07:00
Liang Guo 42254e8c0b Fix vtgate_cursor with missing func 2014-09-19 12:13:46 -07:00
Liang Guo 7d880ed5b5 Rename VTKeyRange to VTRoutingInfo, and func name. Also fix keyrange_test 2014-09-19 11:56:36 -07:00
Liang Guo 23dd9f3088 Update checkpointing api 2014-09-18 20:32:40 -07:00
Anthony Yeh 5b8415ec87 Use GTIDSet to specify replication position. 2014-09-03 17:45:10 -07:00
Peter Lobsinger 075edda1ee Add new client-side error type to represent request backlog errors.
fixup
2014-08-26 15:49:24 -07:00
Alain Jobart 44451751f0 Better doc and interface definitions for these files. 2014-08-25 11:40:26 -07:00
Alain Jobart e58b5db21a Converting a bunch of tests to vtctl RPCs. 2014-08-22 14:35:26 -07:00
Alain Jobart eb9ea9d73e ixing short timeout. 2014-08-22 10:02:36 -07:00
Alain Jobart 05377a6aa7 Adding test glue to run vtctl commands in various ways.
Also fixing a few things here and there.
2014-08-22 09:27:06 -07:00
Alain Jobart 3a90117fab Adding vtctl python gorpc client, and tests. 2014-08-20 22:50:34 -07:00
Liang Guo 5bc828ee1d Update keyspace.py to use Name field from shard 2014-08-13 10:41:57 -07:00
Liang Guo 6e74b3c806 Update keyspace.py so not depending on shard order 2014-08-12 20:19:52 -07:00
Liang Guo 5fdfe92545 Fix topology.py bug 2014-08-08 20:56:38 -07:00
Liang Guo b906aad2db Do not use obsolete SrvKeyspace.Shards 2014-08-08 12:16:19 -07:00
Liang Guo 8bb9accbbd Add an integration test for VTGate V2 2014-08-06 15:32:30 -07:00
Anthony Yeh 8206436dee Merge branch 'master' into gtid 2014-07-28 14:46:14 -07:00
Anthony Yeh 150d8da3c3 Update integration tests for GTID refactor. 2014-07-28 14:08:17 -07:00
Anthony Yeh c89f3252a3 Update test/update_stream.py for GTID refactor. 2014-07-25 15:43:22 -07:00
Liang Guo 43747df4e3 Add debug info for KeyRange 2014-07-24 11:23:47 -07:00
Liang Guo 7861b6a3d6 Make VTGate protocol independent (WIP)
So we can avoid unnecessary conversion.
2014-06-20 15:14:34 -07:00
Alain Jobart 8471386db7 Also send connection errors to vtdb_logger.vtclient_exception. 2014-06-18 16:27:48 -07:00
Liang Guo c05d142529 Merge branch 'master' of https://github.com/youtube/vitess 2014-06-03 09:44:33 -07:00
Liang Guo bfeab9bfa3 Update checkpointing api 2014-06-02 16:05:52 -07:00
Liang Guo 215e3e0813 Update checkpoing api 2014-06-02 16:00:50 -07:00
Alain Jobart 05493fbf44 Fixing a threading issue in topo client code. 2014-06-02 15:45:17 -07:00
Liang Guo f5d4955df0 Update StreamingTaskMap 2014-05-30 15:46:12 -07:00
Liang Guo 71bfaa0dbc More logging for zk 2014-05-21 16:32:09 -07:00
Liang Guo c00cf0b484 Fix integration test: vertical_split_vtgate.py 2014-05-20 19:35:15 -07:00
Liang Guo 192990c2d7 Fix keyspace id format 2014-05-10 00:29:07 -07:00
Alain Jobart 93ea460c25 More details on vtdb_logger.vtclient_exception. 2014-05-08 15:31:30 -07:00
Alain Jobart f2713763e7 Adding vtdb_logger.vtclient_exception() 2014-05-08 09:44:44 -07:00
Alain Jobart 4d371dcd06 Adding vtgatev2_exception to vtdb_logger. 2014-05-08 09:28:53 -07:00
Alain Jobart d8d3d74ab5 Adding vtdb_logger object to python code.
It can be used to report stats in any other way than logging
(logging is the default behavior of the class).
2014-05-07 14:21:48 -07:00
Liang Guo 5fc302d596 Update VTGate V2 2014-05-05 15:39:53 -07:00
Liang Guo c9649acc27 Update VTGate V2 client 2014-04-28 10:38:19 -07:00
Liang Guo c0a97ed27b VTGate V2 update 2014-04-25 14:31:47 -07:00
Liang Guo 679005e818 VTGate V2 update 2014-04-24 15:25:28 -07:00
Liang Guo 62d16f840b VTGate V2 update 2014-04-23 10:37:28 -07:00
Sugu Sougoumarane 14050b920f gorpc: Change ssl timeout to be different from normal
The different error message will help trouble shoot the root
cause of problems better.
Also, fixed some typos.
2014-04-06 21:59:38 -07:00
Sugu Sougoumarane 9c8cab6c91 queryservice: categorize read-only errors as RETRY
When we get a read-only error, it means that the current
server is not the master anymore. Categorize such errors
as RETRY, which will make the clients re-resolve to the
new master.
2014-04-04 11:40:43 -07:00
Liang Guo 748e37061c Convert read-only error to OperationalError 2014-04-01 16:04:21 -07:00
shrutip 34ed57c98e Added function to convert shard_name to keyrange. 2014-03-28 01:03:50 -07:00
shrutip 11503135a2 more cleanup. 2014-03-27 16:03:35 -07:00
shrutip 630b2fef07 Small fixes. 2014-03-27 15:36:52 -07:00
shrutip 8b6d6e03d8 Added additional methods and cleaned up some code. 2014-03-27 14:48:57 -07:00
shrutip ecbfcee944 WIP connection and cursor class for vtgate v2. 2014-03-27 14:48:56 -07:00
Sugu Sougoumarane d91015bfa7 bsongen: tabletserver protos 2014-03-23 00:26:24 -07:00
Sugu Sougoumarane 6a637b8c4d bsongen: mysql/proto & some vtgate/proto 2014-03-21 15:55:49 -07:00
Sugu Sougoumarane 97629075ba bson: Uniformity: encode all nil values as Null 2014-03-20 23:17:52 -07:00
shrutip 1b8bbc1f8b Minor cleanup for readability. 2014-03-17 10:55:11 -07:00
shrutip bd84344952 Cleanup for readability and corresponding changes to tests. 2014-03-17 10:55:10 -07:00
shrutip ef1664eb31 Implemented re-resolve on error for topology and added tests. 2014-03-17 10:55:10 -07:00
shrutip 6e6a766486 Cleaned up some unused code to avoid any confusion. 2014-03-06 23:51:12 -08:00
Alain Jobart edd9d18786 Adding support for unix socket files.
For all of our servers, and bson rpc python client.
Testing it in update_stream because it's simple.
2014-03-05 20:52:58 -08:00
Liang Guo 03f30c0697 Fix vtclient init parameter 2014-02-28 09:46:46 -08:00
shrutip efe519e18c New function in keyspace to return shard_name for keyspace_id. 2014-02-27 15:42:55 -08:00
Liang Guo 52aa5407f3 Merge branch 'master' of github.com:youtube/vitess 2014-02-27 15:00:07 -08:00
Liang Guo 291b349e1a Update to avoid massive test change 2014-02-27 14:55:29 -08:00
Alain Jobart 97ac5c5afd Removing a duplicate test. 2014-02-27 09:07:48 -08:00
Liang Guo f3a9644776 Add SSL support in VTGate 2014-02-26 15:10:29 -08:00
Alain Jobart 2b978f0d37 Fixing format. 2014-02-26 11:08:45 -08:00
Alain Jobart 2f6108bac8 Fixing compilation warning on bad type. 2014-02-26 11:03:26 -08:00
Alain Jobart 0041386a55 Cleaning up test. 2014-02-25 21:43:44 -08:00
Alain Jobart d4a817dc77 Fixing return value and test. 2014-02-25 21:25:47 -08:00
Alain Jobart 406d13b5f6 Fixing two more crashes in cbson. 2014-02-25 21:06:01 -08:00
Alain Jobart dc504e1bac Fixing the test to actually test something. 2014-02-25 10:45:55 -08:00
Alain Jobart 2b3e87fdc0 Importing a fix to a segfault. 2014-02-25 10:13:49 -08:00
shrutip 5f56661fca Added keyspace_test and small fixes to keyspace module. 2014-02-20 13:38:44 -08:00
shrutip b828be4f3d Revamped Keyspace object and prep for re-resolution of topology for resharding. 2014-02-20 13:38:44 -08:00
shrutip 153c69bfc1 Reintroduced StreamExecuteShard and rolled back the client to call that. 2014-02-06 11:05:25 -08:00
shrutip 2de49727e7 Test for SrvKeyspace bson encoding and decoding and small fixes. 2014-02-05 15:41:17 -08:00
shrutip 41f98b2f09 small fix for identation. 2014-02-05 15:41:16 -08:00
shrutip b18aaf8dc8 Implement ServedFrom to enable vertical split for tablet connection. 2014-02-05 15:41:16 -08:00
shrutip 97625ca7a7 Change in api for StreamExecuteKeyRange and vtgate tests. 2014-01-31 01:31:06 -08:00
shrutip 2e5f5516da WIP vtgate integration test and client change to support new streaming api. 2014-01-31 01:29:57 -08:00
shrutip 68b51e9bf2 Support and test for non-sharded db. 2014-01-31 01:29:56 -08:00
shrutip bb28b96967 Added KeyRange class to represent the KeyRanges and modified the test. 2014-01-31 01:03:50 -08:00
Liang Guo 8889f80e76 Refactor vtdb client with connection lookup table 2014-01-22 17:41:47 -08:00
Sugu Sougoumarane 9dd92b0ff8 vtgate.py bug fix: close should rollback. 2014-01-16 14:22:42 -08:00
Sugu Sougoumarane cc43a41f58 Alternate error mechanism
rpcplus can only return a response or an error, not both.
Since we have to return a session for every execute request,
we cannot return errors the traditional way. So, the error is
now returned as part of the response, which will also contain
the updated session info.
2014-01-15 23:49:24 -08:00
Sugu Sougoumarane 3e8b7bc4f2 Merge branch 'master' into vtgate 2014-01-14 15:56:36 -08:00
Alain Jobart d00f427a3d Actually forwarding user and password through vtdb
We haven't been using SALS since 2013/09/19... and vtdb test just
revealed it since we back-ported google3 code.
2014-01-13 13:13:20 -08:00
Sugu Sougoumarane 2558d7783e Sessn -> Session 2014-01-13 11:04:51 -08:00
Sugu Sougoumarane 19a586820e vtgate.py done 2014-01-12 19:47:03 -08:00
shrutip 1ae4d2fc24 Changes to KeyspaceIdType var names to make it consistent with go code. 2014-01-10 17:05:42 -08:00
shrutip 52c1ba2389 Changed the constants for KeyspaceIdType to same as go code. 2014-01-10 17:05:42 -08:00
shrutip 5010f325b3 Modified keyrange code and test to be aware of keyspace_id type. 2014-01-10 17:05:41 -08:00
shrutip 28fdaef641 Module and test to compute the task map and query where clauses for streaming queries. 2014-01-10 17:05:41 -08:00
shrutip 753aa4d55a Deleting these modules as this is unused code and that direction is deprecated. 2014-01-10 17:05:40 -08:00
Liang Guo 794cbfcdd5 fix a typo 2014-01-09 10:55:07 -08:00
Liang Guo d69da69b00 Update python client 2014-01-09 10:44:27 -08:00
Alain Jobart a272a5b993 Group id is now always an int64. 2013-12-18 09:43:13 -08:00
Sugu Sougoumarane 3d3d08f87f Custom bson for updatestream protos. 2013-12-02 21:31:51 -08:00
Liang Guo a4f505b0dc Fix vtgate bsonrpc close call 2013-11-26 20:50:23 -08:00
Sugu Sougoumarane 88fe17a2bc Merge branch 'new-binlog-streamer'
Conflicts:
	go/vt/tabletserver/rowcache_invalidator.go
2013-11-26 18:50:05 -08:00
Sugu Sougoumarane b01386add9 Standardize GroupId type and usage 2013-11-26 10:23:04 -08:00
Liang Guo 6171ab849d Code clean up 2013-11-25 14:53:34 -08:00
Liang Guo 89c9098ad7 Port back vtgate.py with style changes and bug fix. 2013-11-25 14:44:44 -08:00
Alain Jobart 770509e406 Merge branch 'master' into replication 2013-11-18 12:11:38 -08:00
Sugu Sougoumarane 78c880dcad Big leap: update_stream uses binlog_streamer
The update stream API also changes. It accepts a group id
based BinlogPosition as input, and streams events one at a
time. The position is also a separate event at the end of
each transaction.
2013-11-18 00:41:05 -08:00
Alain Jobart 1b0a8d579b Fixing missing import. 2013-11-14 16:43:21 -08:00
Sugu Sougoumarane 8ffe76cc8d ExecuteBatch end to end test 2013-10-28 19:41:43 -07:00
Sugu Sougoumarane 9685d740f6 vttablet protocol changes
Client stops transmitting ConnectionId so we can drop
support for reserved connections (obsolete). Also changed
ExecuteBatch API to separate out session info from query list.
2013-10-23 07:45:43 -07:00
Sugu Sougoumarane 5350f0a4e9 ExecuteBatch WIP vtgate.py 2013-10-17 21:23:04 -07:00
Sugu Sougoumarane 12966797ae Merge branch 'master' into barnacle 2013-10-14 21:57:35 -07:00
Sugu Sougoumarane 42c6dd56eb update stream standardized error handling 2013-10-12 17:07:29 -07:00
Sugu Sougoumarane 972fda1956 Fix queryservice_test.py 2013-10-11 00:38:34 -07:00
shrutip 3da8bc94df Ported the reconnect fixes and added some tests. 2013-10-04 11:02:31 -07:00
shrutip b259796a47 Revamped vtclient api and reconnect on failures. 2013-10-04 11:02:31 -07:00
Sugu Sougoumarane f3a32b69b3 Exec -> ExecShard to clarify they work on shards. 2013-10-04 00:07:12 -07:00
Alain Jobart 2c11d1190c Merge branch 'master' of github.com:youtube/vitess 2013-10-02 17:06:04 -07:00
Alain Jobart 3ca6a266c7 Handling EINTR in gorpc.dial() 2013-10-02 17:05:37 -07:00
Sugu Sougoumarane f9cd49c0e3 vtgate end-to-end test (all functions). 2013-10-02 00:30:54 -07:00
Sugu Sougoumarane c14505417a vtgate end-to-end testing infrastructure. 2013-10-01 23:50:44 -07:00
Alain Jobart 83a12aabc8 Fix in zkocc client with a single server.
In that case, we would never try to reconnect. Now we do.
2013-09-26 11:03:23 -07:00
Sugu Sougoumarane 9fc51ee8dd Merge branch 'master' of github.com:youtube/vitess 2013-09-25 14:51:23 -07:00
Sugu Sougoumarane 01058fab39 Simplified Barnacle protocol.
Because we have per-client sessions, there's no need to use
transaction ids for transactions.
2013-09-25 10:39:00 -07:00
Alain Jobart c94c9e7348 Fixing fake zkocc keyspace encoding. 2013-09-23 14:37:09 -07:00
Alain Jobart 5cd4a83fda Merge commit 'd3d4f2032a66a9fe91ba5b4ceca114b4690330f5' 2013-09-20 16:30:36 -07:00
Alain Jobart 40e55a02ad Merge branch 'master' into resharding 2013-09-20 16:30:21 -07:00
Alain Jobart d3d4f2032a Small changes to match internal version. 2013-09-20 14:49:02 -07:00
Alain Jobart 0c8493c16a Better indentation of that file. 2013-09-20 14:30:10 -07:00
Sugu Sougoumarane 25c24b8a73 Barnacle server & client. 2013-09-20 13:49:30 -07:00
shrutip 81aa7476d5 Renamed tablet3.py and vt_occ2.py, misc other fixes. 2013-08-20 15:16:10 -07:00
shrutip 9dc39528bd Backport of tablet3 changes and its tests. 2013-08-16 14:24:58 -07:00
Alain Jobart 51ebe906a0 Merge branch 'master' into resharding
Conflicts:
	test/update_stream.py
2013-08-14 17:04:38 -07:00
Alain Jobart 3a117d268d Fixing a bug introduced by using new zkocc API. 2013-08-14 13:43:40 -07:00
Ryszard Szopa e2d989c4f0 Make zkocc.py errors include the passed arguments.
Change-Id: Ib2db02010b1b08700d76827886f56b0ad0351b7f
2013-08-13 15:51:04 -07:00
Alain Jobart 01cb28dda4 Starightening the new zkocc API, using it now. 2013-08-12 13:50:01 -07:00
Alain Jobart 5c84f804ac Implementing FakeZkOccConnection new API. 2013-08-12 11:46:59 -07:00
Alain Jobart 35d96ce882 Moving GroupId into ReplicationCoordinates. 2013-08-01 16:30:15 -07:00
Alain Jobart 715699e32b Changing group_id to string in these files. 2013-08-01 13:44:38 -07:00
Alain Jobart a63ff37049 Fixing typo. 2013-07-29 09:36:34 -07:00
Ryszard Szopa 4a450676a9 New version of the Python zkocc API. 2013-07-26 15:16:31 -07:00
Ryszard Szopa 7b2aa701fe TopoReader is now an interface in topo. 2013-07-25 09:54:19 -07:00
Ryszard Szopa efc8095f36 Use a struct as the reply type in Toporeader.GetKeyspaces. 2013-07-24 18:08:07 -07:00
Ryszard Szopa 59804c9003 TopoReader methods: GetSrvKeyspace, GetEndPoints. 2013-07-24 17:58:49 -07:00
Ryszard Szopa ee1f65758b Initial TopoServReader work: GetKeyspaces. 2013-07-24 17:27:43 -07:00
shrutip bf31119e76 Fix for update stream test. 2013-07-19 18:38:13 -07:00
Ric Szopa be36322a29 Fully working MySQL import
* * *
Slightly broken MySQL import.
2013-07-18 17:24:47 -07:00
Alain Jobart b2991bfa92 Reverting this file, didn't mean to check that in. 2013-07-15 11:57:13 -07:00
Alain Jobart 7ac8dd32cc Creating a netutil library, moving some common code there.
LGTM Sugu, Ric.
2013-07-15 11:55:37 -07:00
Shruti Patil 90c2d3e06e Rowcache invalidator and update stream improvements. 2013-07-11 15:09:27 -07:00
Alain Jobart aea835f16d Cosmetic changes. 2013-06-27 11:41:44 -07:00
Alain Jobart 30f1f435f0 Fixing SSLError handling in gorpc.
LGTM Shruti.
2013-06-27 11:34:10 -07:00
Alain Jobart a1ecdfa5aa Integrating encryption stuff, adding tests, fixing bugs.
LGTM Shruti.
2013-06-17 15:15:33 -07:00
Shruti Patil 16db9eeeee Small fix to is_closed 2013-06-13 16:56:10 -07:00
Alain Jobart a1c656114c Adding support for SSL python client -> vttablet connections. Not complete yet.
LGTM Sugu.
2013-06-12 17:24:59 -07:00
Alain Jobart 22cbdf4320 Adding topology.py and some basic test for it.
LGTM Sugu.
2013-06-01 20:36:47 -07:00
Sugu Sougoumarane 551b656fdd Update clients to use new TransactionId protocol 2013-05-31 00:15:09 -07:00
Sugu Sougoumarane 3e2283b549 Commiting Mike's work - tablet3 2013-05-31 00:05:53 -07:00
Alain Jobart d57a1b1236 Porting new python client from google3.
LGTM Mike (and he actually wrote the code!)
2013-05-06 09:38:33 -07:00
Alain Jobart 3899c4fe7c Checker: reading passwords from optional dr-credentials file.
LGTM Ric
2013-04-29 10:28:44 -07:00
Alain Jobart b6d17628fc Fix in checker, better parameters defaults. 2013-04-27 09:38:26 -07:00
Ric Szopa 722d52aaf0 Add an option to the checker not to force using pk indexes. 2013-04-26 13:37:51 -07:00
Ric Szopa 979168c375 The checker accepts --source-column-map and --source-table-name. 2013-04-25 17:55:44 -07:00
Mike Solomon f7d095db37 handy lockfile module 2013-04-24 18:15:07 -07:00
Alain Jobart 1524ce6ffa Fixing a checker issue with the SQL. 2013-04-11 15:51:00 -07:00
Ric Szopa b282ea9281 Further optimizations for the checker. 2013-04-09 18:46:19 -07:00
Ric Szopa 3b9e840b3f checker-improvements 2013-04-09 18:46:15 -07:00
Ric Szopa 0d714c12e7 Do merging and comparing in one thread. 2013-04-09 18:46:11 -07:00
Ric Szopa 04e7e0eb23 The checker uses pickle instead of json for checkpointing. 2013-04-09 18:46:07 -07:00
Ric Szopa 5b85448eb6 The checker doesn't stop after encountering an error. 2013-04-05 17:05:00 -07:00
Ric Szopa df379cb74b Print name of processed table in the checker. 2013-04-03 16:32:57 -07:00
Ric Szopa 90c819b18d Don't use DictCursor. 2013-04-03 13:44:07 -07:00
Ric Szopa c76547293b Parallelize the checker, get rid of the config file. 2013-03-29 15:10:17 -07:00
Alain Jobart 9317a2167e Catching errno.EINTR in python and retrying. 2013-03-25 10:09:14 -07:00
Alain Jobart 02b73fb089 Various sharding fixes.
LGTM Mike.
2013-03-11 15:34:19 -07:00
Alain Jobart b3e7fa6da6 Adding KeyRange to GetSessionId, and enforcing correct values on
the tabletserver side.

LGTM Mike & Sugu.
2013-03-11 11:53:08 -07:00
Ric Szopa 08653046ac Typo in checker. 2013-03-07 18:25:54 -08:00
Ric Szopa 7cdb71ce65 Fix bug in checker. 2013-03-07 17:10:58 -08:00
Ric Szopa a6b093c6c0 Small fixes to checker code and mysqlctl. 2013-03-04 16:10:11 -08:00
Ric Szopa 3337a17354 Checker for restore. 2013-02-27 16:40:00 -08:00
Alain Jobart 3ea86204bb Merging in new changes for this file. 2013-02-21 13:56:39 -08:00
Alain Jobart b87f544a00 Now zkocc.py connects to a random server in its list. 2013-02-13 10:38:42 -08:00
Alain Jobart 59211415ab Adding a fake zkocc connection in python, useful for tests. 2013-01-31 11:58:49 -08:00
Alain Jobart 1201a1d352 More information in this exception.
LGTM Sugu.
2013-01-28 15:44:53 -08:00
Sugu Sougoumarane c8362a63f4 Refactored python client connection code 2013-01-25 15:18:05 -08:00
Alain Jobart d0206a46dd zkocc python client now resolves 'local' cell.
(backport from Shalabh's change).
2013-01-24 13:24:43 -08:00
Sugu Sougoumarane b8b7a57cd3 misc fixes to python client 2013-01-23 13:06:53 -08:00
Ric Szopa 5a10110a98 Backport client changes related to restarting a master. 2013-01-08 13:32:43 -08:00
Ric Szopa 69cadfc618 *Really* fix handling exceptions occurring in dial. 2012-12-13 18:00:11 -08:00
Shruti Patil 8998a6c223 Update Stream improvements, py client, integration test. 2012-12-12 14:33:45 -08:00
Alain Jobart 43ca0b56e9 Adding doc to zkocc.py. It's the simplest way to document
the dicts returned by the RPCs.

LGTM Mike / Sugu.
2012-12-04 15:35:04 -08:00
Ric Szopa 872f68ae86 Handle errors in dial correctly. 2012-11-29 17:52:09 -08:00
Alain Jobart 70b5eaadd1 Cosmetic changes to resolve differences with our repo.
LGTM Mike.
2012-11-28 17:19:53 -08:00
Ric Szopa 303d6b6065 occ_test runs vttablet 2012-11-28 16:41:43 -08:00
Alain Jobart 338758e727 Adding a retry / multiple server zkocc connection layer
for the python client.

LGTM Mike.
2012-11-28 14:44:12 -08:00
Sugu Sougoumarane 1d73d5dd1d change occ_test to use unittest 2012-11-21 12:35:15 -08:00
Sugu Sougoumarane a306a055f8 end to end tests for type system & some bug fixes 2012-11-12 11:53:19 -08:00
Sugu Sougoumarane 169f86c653 enforce strict mode & other misc fixes 2012-11-09 11:54:43 -08:00
Ric Szopa 7b6a3ec04d Redial after a timeout. 2012-11-06 13:48:04 -08:00
Ric Szopa 94e74787bf Refactor connection tests to start their own MySQL, test for timeouts. 2012-11-06 13:48:01 -08:00
Sugu Sougoumarane fb806cf4dc tabletserver: introduce a more formal type system 2012-11-05 14:28:37 -08:00
Alain Jobart 081b3e53e6 Now using mysqlctl to start/stop mysql for occ_test.py
LGTM Mike.
2012-11-02 09:49:07 -07:00
Alain Jobart 314106cf7b Added a test case for UNION, verified it crashed before fix.
LGTM Sugu.
2012-10-30 15:41:28 -07:00
Sugu Sougoumarane a037491508 tx pool: if full, wait for connections instead of failing
disallow queries: accept shutdown reason to return different error categories to clients
2012-10-26 10:54:02 -07:00
Ric Szopa f4024cdfa5 RPC methods take a context argument.
* * *
The context object is passed around.
* * *
the context is passed as interface{}
* * *
Bring back old function signatures.
* * *
Context-taking RPC method can declare their arguments using the real context type.
* * *
Use inteface{} for context in rpcplus.
2012-10-24 12:49:59 -07:00
Alain Jobart 09737a9c79 zkocc py client, and a bug fix in bson encoding.
LGTM Mike.
2012-09-26 12:30:35 -07:00
Ric Szopa b24920ae86 Log SqlQuery events using streamlog. 2012-09-19 12:58:50 -07:00
Ric Szopa 0552f6c588 Revamp table based tests. 2012-09-13 14:31:39 -07:00
Alain Jobart d803a4343c Fixing the streaming cursor to keep returning None after the end of a streaming read.
Also more comments on the streaming cursor states, and adding retries to
the tablet2 connection (same as a non-streaming execute). And an extra unit test.

SGTM Mike.
2012-09-12 16:17:22 -07:00
Sugu Sougoumarane 9ac3572bba strip multiple trailing comments instead of just last one for query uniqueness 2012-09-12 11:33:44 -07:00
Sugu Sougoumarane 64cc603008 cleanup of various configs & tests to use the new VTROOT structure 2012-09-06 16:14:19 -07:00
Alain Jobart 7a92da6eff Adding support in cbson for uint64 decoding, and re-enabling
it in bootstrap, now that it doesn't break the unit test any more.

LGTM Sugu.
2012-09-04 14:32:02 -07:00
Alain Jobart 24f9ff8fef Fixing the return value of decode_next in cbson to be consistent
with the pure python bson decoder (and not return -1 on end of input).

LGTM Mike.
2012-08-31 12:22:27 -07:00
Alain Jobart 0336cf99c6 Changing some coding style for exceptions.
LGTM Mike.
2012-08-30 14:33:02 -07:00
Alain Jobart 65cc5d2703 Pushing a native C implementation of bson encoder / decoder
for python. re-run bootstrap.sh to compile it, and re-source
dev.env to get your PYTHONPATH updated.

LGTM Mike.
2012-08-30 11:46:16 -07:00
Alain Jobart f2bcf481f2 Minor style change.
LGTMike.
2012-08-29 18:00:32 -07:00
Alain Jobart e4aec22b63 Streaming SQL queries now return multiple responses in one RPC response.
So we don't use StreamQueryResult, but just QueryResult (simpler
and faster).

Also fixing a bug if using cbson, where the decode_next method
returns -1 instead of the offset at the end of the decode.

LGTMike.
2012-08-29 17:05:14 -07:00
Alain Jobart 5ce4b4cf28 Using a shorter EndOfStream marker.
LGTMike.
2012-08-28 18:24:12 -07:00
Alain Jobart fdd05e1a5d Reworking the python rpc code, and adding streaming support.
In some situations (large payloads), the python code is up to 20% faster.

LGTM: Mike & Sugu.
2012-08-28 16:45:27 -07:00
Sugu Sougoumarane 2375d1c4c8 fix typo in tablet2.py 2012-08-27 19:59:38 -07:00
Alain Jobart dd251bbab8 Setting the storage engine in the python tests. That way having the
default in mysql server be MyIsam won't cause the tests to fail.
2012-08-27 17:45:24 -07:00
Sugu Sougoumarane f42fac26e6 Protocol changes: Change most rpc APIs to use structs. 2012-08-23 16:05:41 -07:00
Sugu Sougoumarane a18f1ccd22 fix occ_test to use nanoseconds 2012-08-20 17:18:29 -07:00
Ric Szopa 19ff1650f9 merge 2012-08-06 16:55:58 -07:00
Ric Szopa 76cfacfb09 Backport YouTube changes to vtdb. 2012-08-06 16:55:11 -07:00
Ric Szopa 269f272c83 Remove exception class that wasn't used anymore. 2012-08-03 17:38:04 -07:00
Sugu Sougoumarane ca3b52dec2 Make vttablet serve queries and use info from my.cnf 2012-08-02 16:08:50 -07:00
Ric Szopa 79b6d1d3c0 Authentication: allow more than one secret per user on the server side. 2012-08-02 12:44:06 -07:00
Ric Szopa 5107b7aeff Separate authenticated rpc server. 2012-07-31 14:42:18 -07:00
Ric Szopa 538cc2c504 CRAM-MD5 authentication for vtocc. 2012-07-24 19:26:28 -07:00
Sugu Sougoumarane ad9c110c79 flags reorg: moved some flag initializations to their respective packages.
port is now specified in the command line instead of config file.
2012-06-21 16:21:45 -07:00
Ric Szopa 02115e7048 Change the license notice to be shorter and refer to the license file. 2012-06-07 11:55:06 -07:00
Sugu Sougoumarane 7e4a62aa48 bug: add setup.py 2012-06-04 16:22:02 -07:00
Sugu Sougoumarane 15afcc167f Changed bootstrap & dev.env to prep for sharding deployment. 2012-06-03 22:24:54 -07:00
elij 1658c77eef add mysql-5.5 error message as possible response to timeout
This makes the test not fail on mysql 5.5

as per: http://groups.google.com/group/vitess/browse_thread/thread/4bb0edc8a5a62b2a
2012-05-07 21:42:51 -07:00
elij 056b5e972c Fix for exception in test harness due to attribute out of scope/missing.
Traceback (most recent call last):
      File "./occ_test.py", line 233, in <module>
        env.tearDown()
      File "./occ_test.py", line 126, in tearDown
        self.vtstderr.close()
    AttributeError: 'TestEnv' object has no attribute 'vtstderr'
2012-05-07 21:27:46 -07:00
Sugu Sougoumarane 16249b4972 bson marshal: Don't use Reserve for string & bytes data, they may be too long.
resurrected schema reloader. it's still needed.
readable query info error message.
remove ever-changing auto_increment info before hashing table info.
2012-05-02 23:15:49 -07:00