Граф коммитов

611 Коммитов

Автор SHA1 Сообщение Дата
Dean Yasuda abfdbaaa2c Add a comment for future migration of CallerID object. 2015-08-26 08:41:37 -07:00
Alain Jobart eb99e38778 Couple changes to make run_local_database more portable. 2015-08-26 07:56:47 -07:00
Dean Yasuda 4958abb860 Make vtgate_client.CallerID object to provide a common object to pass
to client methods.
2015-08-26 07:36:14 -07:00
Alain Jobart b6727f6bd9 Fix typo. 2015-08-26 07:28:06 -07:00
Alain Jobart 84d886156e Moving port selection to right before they're used. 2015-08-26 07:26:06 -07:00
Alain Jobart 4c12c4c7da Merge branch 'master' into resharding 2015-08-26 07:06:57 -07:00
Ammar Aijazi 01c80f7307 Add an additional error code, and fix the error codes for ACL denied 2015-08-25 18:31:38 -07:00
Ammar Aijazi 7a998a49ba Add vtrpc.ErrorCodes to TabletErrors everywhere 2015-08-25 18:26:13 -07:00
Alain Jobart 543d5f2c72 Adding integration test for vttest. 2015-08-25 16:20:23 -07:00
Alain Jobart 6aedf7b9d9 First pass at a setup for unit tests. 2015-08-25 12:27:24 -07:00
Shengzhe Yao c4ff493b5b stop using hard coded caller id in tablet.py
1. Stop using youtube specific name as caller id.
2. Set caller id as TabletConnection field and use it in the remaining methods.
3. Delete _stream_execute2 in tablet.py since it is now identical to _stream_execute.
2015-08-25 11:40:48 -07:00
Shengzhe Yao 1d7691530a fix gorpc caller id tests
1. Call SqlQuery.Execute*2 in py/vtdb/tablet.py.
2. Add default caller id: youtube-dev-dedicated for each rpc call.
3. Set proper table ACL in test/test_data/table_acl_config.json.
2015-08-24 18:49:50 -07:00
Dean Yasuda 59278ea991 Test that effective_caller_id is passed to VTGate.StreamExecute interfaces.
Send both good and bad effective_caller_ids through the interfaces to make sure
that verification is actually done.
2015-08-23 13:33:47 -07:00
Dean Yasuda 64b9b34f63 Resolve bad merge that removed effective_caller_id from parameters
of VTGateCursor.execute_entity_ids().
2015-08-22 21:00:24 -07:00
Dean Yasuda a23c19f2df Merge branch 'master' into callerid3 2015-08-22 20:58:50 -07:00
Dean Yasuda a5715c19e0 Propagate effective_caller_id parameter from vtgate_cursor to
vtgate_connection to vtgate.
2015-08-22 19:40:51 -07:00
Dean Yasuda 9876592259 Merge branch 'master' of github.com:youtube/vitess. 2015-08-22 16:59:51 -07:00
Dean Yasuda 43d3c440f8 Make more python comment-fixes to address @michael-berlin feedback. 2015-08-22 16:41:07 -07:00
Dean Yasuda f7acc092c4 Add a fix to vtgate_cursor.py to be compatible with upcoming effective_caller_id change. 2015-08-22 16:18:13 -07:00
Dean Yasuda 88edcc204c Merge master changes from youtube/vitess. 2015-08-22 15:57:14 -07:00
Dean Yasuda 1bdfa17596 Fix some typos in previous lint-fixing change. 2015-08-22 00:17:49 -07:00
Dean Yasuda a78bbf14ab Fix some basic lint issues in vitess/py. 2015-08-21 18:51:18 -07:00
Michael Berlin 19f377136c py: More reverts which I forgot in https://github.com/youtube/vitess/pull/1020 2015-08-21 17:33:44 -07:00
Michael Berlin b937dc8a7b Revert recent changes by Dean which were accidentally pushed to the master without review first. 2015-08-21 16:26:20 -07:00
Dean Yasuda 5fa76ff6f5 Merge remote-tracking branch 'upstream/master' 2015-08-20 12:45:05 -07:00
Dean Yasuda c5eeb8d65c Fix a bug where self.session was not read correctly from response.
Remove some stray debugging statements.
2015-08-20 12:32:23 -07:00
Dean Yasuda 232c6a870d Change Makefile to add individual integration test targets.
Hook up effective_caller_id and add a simple test in python_client_test.py.
2015-08-20 11:57:33 -07:00
Michael Berlin 411f518d72 Merge branch 'master' into wait_for_filtered_replication 2015-08-18 14:14:04 -07:00
Michael Berlin b231b69851 proto: Reorder fields in RealTimeStats. 2015-08-18 13:06:52 -07:00
Alain Jobart 4538a917bc New version of protobuf / grpc libraries. 2015-08-18 11:39:43 -07:00
Michael Berlin 66433d9f91 proto: Add "binlog_players_count" field to RealTimeStats. 2015-08-17 18:49:21 -07:00
Michael Berlin 55d0fe9b9a proto: Changed filtered replication lag info from a timestamp to a delay value in query.proto.
We're only interested in the fact that the receiving master has seen a lower delay at some point in time. We don't care about the actual timestamps of the filtered replication statements which were applied.
2015-08-17 13:26:33 -07:00
Dean Yasuda 0b77390fbc Add optional effective_caller_id parameter to vtgate_client.py. 2015-08-16 13:53:35 -07:00
Alain Jobart ad4dcbd726 Replacing all python %u by %d. Apparently it's what we need to do now. 2015-08-07 12:42:36 -07:00
Ammar Aijazi 416747e390 Merge remote-tracking branch 'origin/master' into aaijazi_add_vitess_error_enum 2015-08-05 22:36:37 -07:00
Ammar Aijazi 572decc1f1 More course-grained Vitess errors 2015-08-05 22:34:04 -07:00
Alain Jobart a483c92c37 Removing error in the app-level responses for queryservice / proto3. 2015-08-05 14:49:58 -07:00
Ammar Aijazi 2c82b5979a Resolved conflicts with master and another 2015-08-03 18:33:31 -07:00
Ammar Aijazi 4033a805fe Merge remote-tracking branch 'origin/master' into aaijazi_add_vitess_error_enum 2015-08-03 18:32:25 -07:00
Ammar Aijazi 6f481919a2 Reworked Vitess error codes 2015-08-03 16:11:39 -07:00
Alain Jobart 7d281ea095 Fixing proto3 Shard to have consistent names and types. 2015-08-03 09:08:05 -07:00
Alain Jobart 0c7fcc2e18 Fixing Keyspace.ServedFrom struct name. 2015-08-03 09:01:31 -07:00
Alain Jobart 5a688b126b Renaming ReplicationLink to Node in ShardReplication. 2015-07-31 13:57:48 -07:00
Alain Jobart dd9651562e Merge branch 'master' into resharding 2015-07-29 14:23:19 -07:00
Alain Jobart e60025003f Now using vtgate_client factory in unit tests.
(note we only test a couple methods, so it's not there yet).
2015-07-28 16:58:02 -07:00
Alain Jobart 67e7c406b5 Adding the plumbing for vtgateservice.GetSrvKeyspace in python.
Re-using the keyspace.Keyspace object, as it has what we need,
until we use the proto3 version.
2015-07-28 16:40:07 -07:00
Alain Jobart 766c52b88e Adding GetSrvKeyspace to vtgate API. 2015-07-28 15:55:06 -07:00
Alain Jobart 51d48db41c Fixing a few things wrt topo changes. 2015-07-28 14:08:40 -07:00
Alain Jobart c9d2544fde Replacing portmap with port_map in proto3. 2015-07-28 12:00:30 -07:00
Alain Jobart e1e4a86269 Dropping more support for vts / encrypted port. 2015-07-28 11:39:04 -07:00
dumbunny a0bbdd36ee Merge pull request #904 from dumbunny/feature1
Refactor sql_builder.py
2015-07-27 12:30:23 -07:00
Dean Yasuda 380a1e83ce Fix #2 for db_object.get_max. 2015-07-25 18:08:00 -07:00
Dean Yasuda f57c864f72 Fix usage of vtdb.sql_builder.build_aggregate_query. 2015-07-25 17:19:32 -07:00
Dean Yasuda 7dba3d867c * Add BaseSQLInsertExpr, RawSQLInsertExpr.
* Add update_bind_vars, which detects duplicate bind var keys.
* Add more docstrings, fix lint issues.
* Increase test coverage to 100%.
2015-07-25 16:02:13 -07:00
sougou 380a9f8d17 Merge pull request #924 from youtube/suguwork
vtgate batch api: fix bug caught by linter
2015-07-24 15:30:38 -07:00
Sugu Sougoumarane 728d70dc6d vtgate batchapi: fix bug caught by linter 2015-07-24 12:16:02 -07:00
Dean Yasuda d4ec6220dc Modify sql_builder.py, add test/sql_builder_test.py. 2015-07-24 11:22:05 -07:00
Alain Jobart 63daac2a5d Now using strings in remote RPC communication for replication position.
Much simpler than the big proto file.
2015-07-24 10:29:28 -07:00
sougou 67afeb8670 Merge pull request #903 from youtube/suguwork
vtgate batch API
2015-07-23 21:50:40 -07:00
Alain Jobart 1cdb3522eb Renaming position to transaction_id for binlog events.
They map to a single GTID, not a GTIDSet.
2015-07-23 10:12:20 -07:00
Alain Jobart 691993f486 Changing the returned position from update_stream to be a string too,
in API and in python 9was already changed in grpc).
2015-07-23 09:32:56 -07:00
Alain Jobart fb39348286 Now passing position as string into gorpc binlog service. 2015-07-23 08:57:35 -07:00
Alain Jobart 7d0dc20d7c Changing the proto3 binlog protocol to pass a string as
replication position, not the complicated GTID structure.
Also changing the python client API.
2015-07-23 08:39:32 -07:00
Sugu Sougoumarane 7d37338d12 vtgate batch API: improved python client API
The previous python client API bound the batch cursor
to a single keyspace_id list, which is not practical
for batch commands. This change removes that binding,
and instead lets you specify the keyspace and keyspace_ids
for each query.
2015-07-23 08:09:42 -07:00
Alain Jobart db283f69e2 Renaming gtid to position in binlog streamer results. 2015-07-23 07:46:43 -07:00
Sugu Sougoumarane 80e31020e2 vtgate batch API: python vtgate clients
The python clients and their tests are now functional as before,
but they need to be improved. They still have the inflexibility
where you can specify only one keyspace id list for an entire
batch, rather than one list per query.
2015-07-23 04:14:18 -07:00
Sugu Sougoumarane 0e6a6fe4ae vtgate batch api: tablet client & tests 2015-07-23 02:47:47 -07:00
Alain Jobart b7eac53a03 Adding split_column to vtgate API. 2015-07-20 10:24:31 -07:00
Alain Jobart 7755349b47 First pass at better low level python client. 2015-07-20 08:56:13 -07:00
Alain Jobart e544bfa42e Fixing more linter errors. 2015-07-20 07:35:17 -07:00
Alain Jobart f0ca85ca00 Fixing linter errors in these files. 2015-07-20 07:32:43 -07:00
Alain Jobart ad4f444a75 Fixing case of tablet_type in protos. 2015-07-20 06:54:12 -07:00
Alain Jobart 20c28a24de Fixing various typos and comments. 2015-07-17 14:38:33 -07:00
Alain Jobart c04a3f0a27 Adding rpc updatestream implementation.
It is still flaky, especially with cancellation.
2015-07-17 11:02:00 -07:00
Alain Jobart 0f5c7562bb Moving all python proto-generated files into py/vtproto. 2015-07-16 14:07:11 -07:00
Alain Jobart a48247cd63 Refactoring update_stream python client.
Uses a protocol implementation class now.
2015-07-16 12:51:59 -07:00
Alain Jobart 31f7b88330 Fixing a couple typos. 2015-07-16 11:27:27 -07:00
Alain Jobart 0b17e2f681 Refactoring the python vtctl_client to use a generator,
and a helper method to do the logging.
2015-07-16 09:59:01 -07:00
Alain Jobart 42d9f7fb18 Removing a bunch of unused logging imports. 2015-07-15 14:42:50 -07:00
Alain Jobart 1a4408cbc6 Changing UpdateStream event to use sqltypes. Much cleaner,
and the parsing is already done.
2015-07-10 14:28:11 -07:00
Alain Jobart cdc3a96afb In preparation for converting mysqlctl to gRPC:
- vtgate doesn't listen to socket_file any more.
- removing bsonrpc python client socket_file support.

The plan is to change mysqlctl to gRPC by changing from bsonrpc to
gRPC when listening to socket file.
2015-07-06 14:12:05 -07:00
Alain Jobart 5a11631d7d Updating gRPC to 0.9.1.
Updating protobuf to v3.0.0-alpha-2 (to match gRPC's version)

Now the python vtctl client works as expected (!!!).
Also splitting up go and python vtctl client implementations
(will be used inside google3).
2015-07-06 11:54:04 -07:00
Ammar Aijazi 493bfb15f1 Merge remote-tracking branch 'origin/master' into fix_tablet_clients 2015-06-26 11:59:40 -07:00
Ammar Aijazi 9b5b06c899 Added unit tests for vtdb.tablet 2015-06-25 22:52:09 -07:00
Alain Jobart c50188e6f2 Better library functions for logutil times for proto3. 2015-06-25 08:06:13 -07:00
Alain Jobart 197a06d851 Splitting up time and logger event to logutil proto3. 2015-06-25 07:37:19 -07:00
Alain Jobart eac090cd50 Renaming a few proto files. Turns out the proto we use in google3
cannot have the same <package name>.<data type> as these, or we cannot
load them at the same time. So to fix this:
- renaming the conflicting ones from xxx.proto to xxxdata.proto.
- renaming vtgateservice.VTGate to vtgateservice.Vitess

Note we can still change the names I chose here, just not back to
conflicting ones. If anyone has better ideas, we can implement
in subsequent changes. This is to get the import to google3 unstuck.
2015-06-19 08:20:58 -07:00
Ammar Aijazi 5f43cc76ac Add a StreamResult2 end-point 2015-06-16 15:31:46 -07:00
Ammar Aijazi 820d9dbffd Merge remote-tracking branch 'origin/master' into aaijazi_more_vttablet_rpc_errors 2015-06-11 17:59:00 -07:00
Ammar Aijazi bc15d56086 Fix off-by-one errors in Python client's StreamExecute after app error 2015-06-10 15:58:14 -07:00
Ammar Aijazi 9f536939e5 Fix Python client's StreamExecute for apperrors in the first response 2015-06-10 14:28:57 -07:00
Ammar Aijazi 14e2c0bbfa Handle QueryService.StreamExecute RPC errors in the Python client, with a test 2015-06-10 12:52:17 -07:00
Ammar Aijazi 876c4a658b Add RPCErrors to more QueryService RPC responses 2015-06-10 12:52:15 -07:00
Alain Jobart a81a2cf5cc Fixing gRPC vtctl client. 2015-06-10 10:56:47 -07:00
Alain Jobart 337e97c341 Now splitting vtctl service. 2015-06-10 10:39:23 -07:00
Ammar Aijazi 4da15d6ae2 Slightly safer handling of Err in Python clients 2015-06-09 14:18:35 -07:00
Ammar Aijazi 0e4e887fa4 Fix Python tabletconn client to correctly handle the change from RPCError to *RPCError 2015-06-08 11:00:44 -07:00
Ammar Aijazi fb4c5fb10e queryservice's Execute should return RPCErrors as part of QueryResult 2015-06-03 19:27:21 -07:00
Alain Jobart 3f52b1b058 Newer version of proto generated code. 2015-05-04 10:13:24 -07:00
Alain Jobart b447e9284b Progress in the grpc vtctl python client. Doesn't work yet though. 2015-05-04 09:54:13 -07:00
Shruti Patil 90e6619d82 Pending changes - db_validator, write_db_class_method 2015-04-29 16:31:02 -07:00
sougou eb5f3b7be5 Merge pull request #482 from ynshenoy/master
Fixes to vtgatev3 for PEP 249 compliance
2015-04-28 11:48:42 -07:00
Shruti Patil 2cca1f4b1c Merge branch 'client_lib' of github.com:youtube/vitess into client_lib 2015-04-17 15:19:26 -07:00
Shruti Patil c6344b5663 Example for batch write. 2015-04-17 15:17:00 -07:00
Shruti Patil fe6fd9d785 execute batch wiring and example. 2015-04-17 15:17:00 -07:00
Shruti Patil f7ff4cc45e Small improvement for list types. 2015-04-16 11:25:31 -07:00
Shruti Patil 3b3f6c5147 small cleanup for matching isinstance. 2015-04-16 11:25:30 -07:00
Shruti Patil 7b7866a1eb Changes to support native list types and integration test. 2015-04-16 11:25:30 -07:00
Shruti Patil bfaf80886e execute batch wiring and example. 2015-04-16 11:00:12 -07:00
Liang Guo c9d44e2b59 Allow client speficies if a query should not be in a transaction. 2015-04-15 17:11:15 -07:00
Shruti Patil d00e3daeab Removed the retry on txn pool full. 2015-03-24 16:18:47 -07:00
shrutip 28058c02a2 Merge pull request #504 from youtube/vtgate_exc_cleanup
Cleaned up vtgatev2_exception logging.
2015-03-20 16:20:27 -07:00
Alain Jobart 9722a61d54 Fixing python typo. 2015-03-20 15:56:57 -07:00
Alain Jobart baa18dda15 Merge branch 'master' into resharding 2015-03-20 09:08:08 -07:00
Shruti Patil 81f0fd2a0a Fixes based on review comments. 2015-03-18 16:13:32 -07:00
Shruti Patil c60aa15931 Cleaned up vtgatev2_exception logging. 2015-03-18 15:55:25 -07:00
Alain Jobart 9587099e07 Removing db_types from Keyspace, unused now. 2015-03-16 09:14:36 -07:00
Alain Jobart 25f068fa0d Fixing read_topology() to use ShardReferences. 2015-03-16 09:08:33 -07:00
Alain Jobart 16807a416e Now using ShardReferences fields in a few places instead of
Shards in the Keyspace.Partitions map.
2015-03-16 08:42:25 -07:00
Shruti Patil b5f4ce7c34 removed extraneous log line. 2015-03-13 17:29:35 -07:00
Shruti Patil 0a5d846cf1 fixed some broken tests. 2015-03-13 15:15:03 -07:00
Shruti Patil e27d164786 Aggregations and more test examples. 2015-03-13 15:15:03 -07:00
Shruti Patil 0afe9ccc89 Removed redundant import. 2015-03-13 15:15:03 -07:00
Yogeshwar Shenoy 8788f0d60e Fixes to vtgatev3 for PEP 249 compliance
Exposed the Connection and Cursor objects from the module,
and modified the connect function appropriately. Added
the missing DataError exception.
2015-03-13 09:37:47 +00:00
Alain Jobart 8328ffb884 Reverting protobuf install to 3.0.0-alpha-1 to be compatible
with the one grpc installs. Adding a couple extra libraries
so later on we can switch to using them.
2015-03-11 15:49:33 -07:00
Alain Jobart c9951ea3f3 Fix proto3 python file. 2015-03-11 11:01:06 -07:00
Alain Jobart 015dd56874 Add python side for gRPC. 2015-03-02 09:22:52 -08:00
Alain Jobart 388bdd062b protoc is now compiled by bootstrap.sh.
Still need better python gRPC support.
2015-03-02 08:48:22 -08:00
Anand Henry 28700451d6 ThrottledError should extend DatabaseError 2015-02-04 09:32:33 -08:00
Anand Henry 0dd9321146 Merge branch 'master' into exp-retry 2015-01-30 16:29:11 -08:00
Shruti Patil e56fb625a5 Streaming support in client libraries. 2015-01-28 15:03:18 -08:00
Shruti Patil a44c924550 Removed the dependency of topology from vtgate client. 2015-01-27 11:41:32 -08:00
Liang 73fea18067 Merge pull request #331 from youtube/vtgatelog
Suppress tx_pool_full log.
2015-01-21 21:03:30 -08:00
Liang Guo 5d74b334e3 Scatter streaming queries should send fields info to client only once. 2015-01-21 20:15:16 -08:00
Shengzhe Yao 0e740502e4 rename _vtocc, _vts and _mysql in vitess client 2015-01-20 16:33:37 -08:00
Shruti Patil bbdfd76f60 Some more tests; cleanup; more documentation. 2015-01-18 17:46:59 -08:00
Shruti Patil 92750e48f8 WIP - range sharded more intuitive api. Tests pass. 2015-01-18 17:46:59 -08:00
Shruti Patil 6d870c6de0 WIP classes for range sharded and for creating new entities. 2015-01-18 17:46:59 -08:00
Shruti Patil 1967b4b1f6 WIP Defined test classes for range-sharded. 2015-01-18 17:46:59 -08:00
Shruti Patil 422872af0b WIP Range-sharded, Lookup and EntityRangeSharded base classes. 2015-01-18 17:46:59 -08:00
Sugu Sougoumarane 33819d1afe v3: incoporated enisoc's codereview feedback. 2015-01-15 20:21:49 -08:00
Sugu Sougoumarane f54abf63f3 vtgate v3: cursorv3 2015-01-10 14:58:19 -08:00
Shruti Patil 87f77c10aa Merge branch 'client_lib' of github.com:youtube/vitess into client_lib 2014-12-23 11:57:02 -08:00
Shruti Patil 583937bf54 Fixes from code review, other minor changes. 2014-12-23 11:46:50 -08:00
Shruti Patil ffe354687c Cleaned up some documentation. 2014-12-23 11:46:49 -08:00
Shruti Patil ac11ee2326 Core library and integration test framework. 2014-12-23 11:46:49 -08:00
Shruti Patil e5ee7dc651 Cleaned up some documentation. 2014-12-21 23:31:34 -08:00
Shruti Patil 830a616ac6 Core library and integration test framework. 2014-12-21 11:16:19 -08:00
Sugu Sougoumarane e7f9ff7918 v3 proto: end-to-end test for select & insert 2014-12-05 22:12:47 -08:00
Anthony Yeh 0fb0a0fd00 Merge branch 'typofixes-vlajos-20141204' of github.com:vlajos/vitess into vlajos-typofixes-vlajos-20141204 2014-12-04 14:53:41 -08:00
Veres Lajos 18fb59b104 typofixes - https://github.com/vlajos/misspell_fixer 2014-12-04 22:33:57 +00:00
shrutip 810281bed0 Merge pull request #203 from youtube/vtclient
Improved the cursor creation api and changed vtgatev2 test to use cursor
2014-12-04 10:40:06 -08:00
Shruti Patil b3309a50bc Remove unused vtgate client. 2014-12-03 22:47:40 -08:00
Shruti Patil f80989d9e3 Improved the cursor creation api and changed vtgatev2 test to use cursor
api where possible.
2014-12-03 13:10:20 -08:00
Anand Henry 5984be80b2 Exponential backoff retry in VtGate client 2014-11-26 11:30:22 -08:00
Anand Henry 6aa70b298d Add ThrottledError exception 2014-11-25 19:37:40 -08:00
Shruti Patil d64aafc402 Explicit conversion of exception args to tuple. 2014-11-25 14:53:06 -08:00
Shruti Patil 48c11c0884 Pruned the query out of the integrity error. 2014-11-24 14:22:49 -08:00
Shruti Patil 2f3032b4fb Add a mechanism to log private data from exceptions and use case for bind_variables. 2014-10-29 10:32:46 -07:00
Sugu Sougoumarane ce89746dab tabletserver: list bind vars support complete
You can now specify a new syntax for queries that
have an IN clause:
select * from t where id in ::list
The corresponding bind variable would be:
{"list": field_types.List([1,2,3])}

- List bind vars are only allowed for IN and NOT IN clauses.
- A bind variable can be a list if and only if
  it's referred as ::list.
- A list must contain at least one value.

For the python client, you need to supply lists using the
field_types.List class. This is because of legacy behavior
where lists were previously encoded as strings.
We should soon change this API to use native lists once we
confirm that no one will be affected by this change.
2014-10-24 13:53:25 -07:00
Shruti Patil 9e7097dffa Handle IntegrityError separately, fixed vtgatev2_exception handling. 2014-10-16 14:23:49 -07:00
Shruti Patil 294ff00758 Fixed KeyRange object and associated references. 2014-10-14 14:21:57 -07:00
Liang Guo dc219fa07a Fix vtrouting.py 2014-10-13 14:43:34 -07:00
Shruti Patil 597f882b4a small linter improvements. 2014-10-13 09:42:58 -07:00
Shruti Patil 80b4fb9836 Refactored keyrange.py and added documentation. 2014-10-13 09:42:58 -07:00
Peter Lobsinger 508a51b49a Rename to 'refresh' since 'update' is a semantically loaded term in Python. 2014-10-08 16:17:55 -07:00
Peter Lobsinger cf7fa28e87 Be more flexible with addresses in ZkOccConnection.
Allow the set of zkocc hosts to be updated. Also, limit the number of
dial attempts for any given operation - this is useful when the set of
zkocc hosts gets large.
2014-10-07 22:04:09 -07:00
shrutip 228de94bac Removed v1bson protocol and its usage. 2014-10-01 11:15:44 -07:00
shrutip 7fa963a997 Fixed the BatchCursor to use the correct api for execute. 2014-10-01 11:15:43 -07:00
Liang Guo 42254e8c0b Fix vtgate_cursor with missing func 2014-09-19 12:13:46 -07:00
Liang Guo 7d880ed5b5 Rename VTKeyRange to VTRoutingInfo, and func name. Also fix keyrange_test 2014-09-19 11:56:36 -07:00
Liang Guo 23dd9f3088 Update checkpointing api 2014-09-18 20:32:40 -07:00
Anthony Yeh 5b8415ec87 Use GTIDSet to specify replication position. 2014-09-03 17:45:10 -07:00
Peter Lobsinger 075edda1ee Add new client-side error type to represent request backlog errors.
fixup
2014-08-26 15:49:24 -07:00
Alain Jobart 44451751f0 Better doc and interface definitions for these files. 2014-08-25 11:40:26 -07:00
Alain Jobart e58b5db21a Converting a bunch of tests to vtctl RPCs. 2014-08-22 14:35:26 -07:00
Alain Jobart eb9ea9d73e ixing short timeout. 2014-08-22 10:02:36 -07:00
Alain Jobart 05377a6aa7 Adding test glue to run vtctl commands in various ways.
Also fixing a few things here and there.
2014-08-22 09:27:06 -07:00
Alain Jobart 3a90117fab Adding vtctl python gorpc client, and tests. 2014-08-20 22:50:34 -07:00
Liang Guo 5bc828ee1d Update keyspace.py to use Name field from shard 2014-08-13 10:41:57 -07:00
Liang Guo 6e74b3c806 Update keyspace.py so not depending on shard order 2014-08-12 20:19:52 -07:00
Liang Guo 5fdfe92545 Fix topology.py bug 2014-08-08 20:56:38 -07:00
Liang Guo b906aad2db Do not use obsolete SrvKeyspace.Shards 2014-08-08 12:16:19 -07:00
Liang Guo 8bb9accbbd Add an integration test for VTGate V2 2014-08-06 15:32:30 -07:00
Anthony Yeh 8206436dee Merge branch 'master' into gtid 2014-07-28 14:46:14 -07:00
Anthony Yeh 150d8da3c3 Update integration tests for GTID refactor. 2014-07-28 14:08:17 -07:00
Anthony Yeh c89f3252a3 Update test/update_stream.py for GTID refactor. 2014-07-25 15:43:22 -07:00
Liang Guo 43747df4e3 Add debug info for KeyRange 2014-07-24 11:23:47 -07:00
Liang Guo 7861b6a3d6 Make VTGate protocol independent (WIP)
So we can avoid unnecessary conversion.
2014-06-20 15:14:34 -07:00
Alain Jobart 8471386db7 Also send connection errors to vtdb_logger.vtclient_exception. 2014-06-18 16:27:48 -07:00
Liang Guo c05d142529 Merge branch 'master' of https://github.com/youtube/vitess 2014-06-03 09:44:33 -07:00
Liang Guo bfeab9bfa3 Update checkpointing api 2014-06-02 16:05:52 -07:00
Liang Guo 215e3e0813 Update checkpoing api 2014-06-02 16:00:50 -07:00
Alain Jobart 05493fbf44 Fixing a threading issue in topo client code. 2014-06-02 15:45:17 -07:00
Liang Guo f5d4955df0 Update StreamingTaskMap 2014-05-30 15:46:12 -07:00
Liang Guo 71bfaa0dbc More logging for zk 2014-05-21 16:32:09 -07:00
Liang Guo c00cf0b484 Fix integration test: vertical_split_vtgate.py 2014-05-20 19:35:15 -07:00
Liang Guo 192990c2d7 Fix keyspace id format 2014-05-10 00:29:07 -07:00
Alain Jobart 93ea460c25 More details on vtdb_logger.vtclient_exception. 2014-05-08 15:31:30 -07:00
Alain Jobart f2713763e7 Adding vtdb_logger.vtclient_exception() 2014-05-08 09:44:44 -07:00
Alain Jobart 4d371dcd06 Adding vtgatev2_exception to vtdb_logger. 2014-05-08 09:28:53 -07:00
Alain Jobart d8d3d74ab5 Adding vtdb_logger object to python code.
It can be used to report stats in any other way than logging
(logging is the default behavior of the class).
2014-05-07 14:21:48 -07:00
Liang Guo 5fc302d596 Update VTGate V2 2014-05-05 15:39:53 -07:00
Liang Guo c9649acc27 Update VTGate V2 client 2014-04-28 10:38:19 -07:00
Liang Guo c0a97ed27b VTGate V2 update 2014-04-25 14:31:47 -07:00
Liang Guo 679005e818 VTGate V2 update 2014-04-24 15:25:28 -07:00
Liang Guo 62d16f840b VTGate V2 update 2014-04-23 10:37:28 -07:00
Sugu Sougoumarane 14050b920f gorpc: Change ssl timeout to be different from normal
The different error message will help trouble shoot the root
cause of problems better.
Also, fixed some typos.
2014-04-06 21:59:38 -07:00
Sugu Sougoumarane 9c8cab6c91 queryservice: categorize read-only errors as RETRY
When we get a read-only error, it means that the current
server is not the master anymore. Categorize such errors
as RETRY, which will make the clients re-resolve to the
new master.
2014-04-04 11:40:43 -07:00
Liang Guo 748e37061c Convert read-only error to OperationalError 2014-04-01 16:04:21 -07:00
shrutip 34ed57c98e Added function to convert shard_name to keyrange. 2014-03-28 01:03:50 -07:00
shrutip 11503135a2 more cleanup. 2014-03-27 16:03:35 -07:00
shrutip 630b2fef07 Small fixes. 2014-03-27 15:36:52 -07:00
shrutip 8b6d6e03d8 Added additional methods and cleaned up some code. 2014-03-27 14:48:57 -07:00
shrutip ecbfcee944 WIP connection and cursor class for vtgate v2. 2014-03-27 14:48:56 -07:00
Sugu Sougoumarane d91015bfa7 bsongen: tabletserver protos 2014-03-23 00:26:24 -07:00
Sugu Sougoumarane 6a637b8c4d bsongen: mysql/proto & some vtgate/proto 2014-03-21 15:55:49 -07:00
Sugu Sougoumarane 97629075ba bson: Uniformity: encode all nil values as Null 2014-03-20 23:17:52 -07:00
shrutip 1b8bbc1f8b Minor cleanup for readability. 2014-03-17 10:55:11 -07:00
shrutip bd84344952 Cleanup for readability and corresponding changes to tests. 2014-03-17 10:55:10 -07:00
shrutip ef1664eb31 Implemented re-resolve on error for topology and added tests. 2014-03-17 10:55:10 -07:00
shrutip 6e6a766486 Cleaned up some unused code to avoid any confusion. 2014-03-06 23:51:12 -08:00
Alain Jobart edd9d18786 Adding support for unix socket files.
For all of our servers, and bson rpc python client.
Testing it in update_stream because it's simple.
2014-03-05 20:52:58 -08:00
Liang Guo 03f30c0697 Fix vtclient init parameter 2014-02-28 09:46:46 -08:00
shrutip efe519e18c New function in keyspace to return shard_name for keyspace_id. 2014-02-27 15:42:55 -08:00
Liang Guo 52aa5407f3 Merge branch 'master' of github.com:youtube/vitess 2014-02-27 15:00:07 -08:00
Liang Guo 291b349e1a Update to avoid massive test change 2014-02-27 14:55:29 -08:00
Alain Jobart 97ac5c5afd Removing a duplicate test. 2014-02-27 09:07:48 -08:00
Liang Guo f3a9644776 Add SSL support in VTGate 2014-02-26 15:10:29 -08:00
Alain Jobart 2b978f0d37 Fixing format. 2014-02-26 11:08:45 -08:00
Alain Jobart 2f6108bac8 Fixing compilation warning on bad type. 2014-02-26 11:03:26 -08:00
Alain Jobart 0041386a55 Cleaning up test. 2014-02-25 21:43:44 -08:00
Alain Jobart d4a817dc77 Fixing return value and test. 2014-02-25 21:25:47 -08:00
Alain Jobart 406d13b5f6 Fixing two more crashes in cbson. 2014-02-25 21:06:01 -08:00
Alain Jobart dc504e1bac Fixing the test to actually test something. 2014-02-25 10:45:55 -08:00
Alain Jobart 2b3e87fdc0 Importing a fix to a segfault. 2014-02-25 10:13:49 -08:00
shrutip 5f56661fca Added keyspace_test and small fixes to keyspace module. 2014-02-20 13:38:44 -08:00
shrutip b828be4f3d Revamped Keyspace object and prep for re-resolution of topology for resharding. 2014-02-20 13:38:44 -08:00
shrutip 153c69bfc1 Reintroduced StreamExecuteShard and rolled back the client to call that. 2014-02-06 11:05:25 -08:00
shrutip 2de49727e7 Test for SrvKeyspace bson encoding and decoding and small fixes. 2014-02-05 15:41:17 -08:00
shrutip 41f98b2f09 small fix for identation. 2014-02-05 15:41:16 -08:00
shrutip b18aaf8dc8 Implement ServedFrom to enable vertical split for tablet connection. 2014-02-05 15:41:16 -08:00
shrutip 97625ca7a7 Change in api for StreamExecuteKeyRange and vtgate tests. 2014-01-31 01:31:06 -08:00
shrutip 2e5f5516da WIP vtgate integration test and client change to support new streaming api. 2014-01-31 01:29:57 -08:00
shrutip 68b51e9bf2 Support and test for non-sharded db. 2014-01-31 01:29:56 -08:00
shrutip bb28b96967 Added KeyRange class to represent the KeyRanges and modified the test. 2014-01-31 01:03:50 -08:00
Liang Guo 8889f80e76 Refactor vtdb client with connection lookup table 2014-01-22 17:41:47 -08:00
Sugu Sougoumarane 9dd92b0ff8 vtgate.py bug fix: close should rollback. 2014-01-16 14:22:42 -08:00
Sugu Sougoumarane cc43a41f58 Alternate error mechanism
rpcplus can only return a response or an error, not both.
Since we have to return a session for every execute request,
we cannot return errors the traditional way. So, the error is
now returned as part of the response, which will also contain
the updated session info.
2014-01-15 23:49:24 -08:00
Sugu Sougoumarane 3e8b7bc4f2 Merge branch 'master' into vtgate 2014-01-14 15:56:36 -08:00