Граф коммитов

9422 Коммитов

Автор SHA1 Сообщение Дата
Mike Solomon 5df12637f9 parallelize validate action 2012-08-30 11:54:22 -07:00
Alain Jobart 65cc5d2703 Pushing a native C implementation of bson encoder / decoder
for python. re-run bootstrap.sh to compile it, and re-source
dev.env to get your PYTHONPATH updated.

LGTM Mike.
2012-08-30 11:46:16 -07:00
Alain Jobart 974e3d871e Refactoring some code in client.go so we don't remove and re-add
streaming RPC values. Minor detail.

LGTM Sugu.
2012-08-29 18:15:24 -07:00
Alain Jobart f2bcf481f2 Minor style change.
LGTMike.
2012-08-29 18:00:32 -07:00
Alain Jobart e4aec22b63 Streaming SQL queries now return multiple responses in one RPC response.
So we don't use StreamQueryResult, but just QueryResult (simpler
and faster).

Also fixing a bug if using cbson, where the decode_next method
returns -1 instead of the offset at the end of the decode.

LGTMike.
2012-08-29 17:05:14 -07:00
Mike Solomon ce8ef74f42 Provide new alternate paths based on $VTROOT. 2012-08-28 18:57:05 -07:00
Mike Solomon ed260e2691 change validation to exclude classes of tablets from the replication graph checks. 2012-08-28 18:53:00 -07:00
Mike Solomon 40ce8a2e55 Gracefully stop the agent when the app quits.
This may seem pedantic, but it stop the app log from filling up with warning messages under normal circumstances.
2012-08-28 18:50:37 -07:00
Mike Solomon 386b774092 remove parent relationship when a tablet is scrapped 2012-08-28 18:47:39 -07:00
Alain Jobart 5ce4b4cf28 Using a shorter EndOfStream marker.
LGTMike.
2012-08-28 18:24:12 -07:00
Alain Jobart fdd05e1a5d Reworking the python rpc code, and adding streaming support.
In some situations (large payloads), the python code is up to 20% faster.

LGTM: Mike & Sugu.
2012-08-28 16:45:27 -07:00
Alain Jobart 90e0a63589 Code clean-up: renaming a few 'self' into variable names,
to follow newer code conventions.

LGTM: Sugu
2012-08-28 16:05:34 -07:00
Alain Jobart b87a1e9822 Fixing the indentation in this file. 2012-08-28 16:04:29 -07:00
Dmitry Vyuokv 0bfbb2867e Replace map lookup with array indexing. 2012-08-28 15:00:33 -07:00
Sugu Sougoumarane 2375d1c4c8 fix typo in tablet2.py 2012-08-27 19:59:38 -07:00
Alain Jobart dd251bbab8 Setting the storage engine in the python tests. That way having the
default in mysql server be MyIsam won't cause the tests to fail.
2012-08-27 17:45:24 -07:00
Alain Jobart 1138c656aa Now using rpcplus package everywhere, and adding support for streaming
mysql queries using a streaming RPC API. Only the go client side is
in here, the python client code will be next.

LGTM by Mike and Sugu over the last couple weeks.
2012-08-27 16:26:06 -07:00
Alain Jobart e0a113f69c New version of the streaming RPC code. We simplified the protocol
to use the same message structure, not have a sub-sequence id,
and use an extra message to signal end-of-stream.
2012-08-27 14:06:09 -07:00
Alain Jobart d567446f6a Go-formatting that file. 2012-08-27 14:04:32 -07:00
Sugu Sougoumarane 526a3d7a6b report memcache stats. 2012-08-26 21:33:00 -07:00
Mike Solomon ece32b31fe use zookeeper.IsError consistently 2012-08-25 13:14:12 -07:00
Mike Solomon df55614859 allow transition from idle to scrap
fix CreateTablet for non replicating types
2012-08-25 12:51:42 -07:00
Mike Solomon f1af1cf3aa clarify the transition to "idle" and limit when that can be applied.
change the test cases to reflect the new reality.
set 3306 as the default mysql port when re-reading a my.cnf file.
2012-08-24 15:18:29 -07:00
Sugu Sougoumarane 35edf1e5d4 Added tag weekly for changeset 62afd0103052 2012-08-23 20:36:21 -07:00
Sugu Sougoumarane 7fd27509a2 Added tag weekly.2012-08-23.go.4fdf6aa4f602 for changeset 62afd0103052 2012-08-23 20:36:05 -07:00
Mike Solomon 1e74075bfb resolve the fdqn more reliably
this function is small enough i didn't feel like pulling it into a separate library.
2012-08-23 19:06:48 -07:00
Mike Solomon e8a676228e route most help to stdout 2012-08-23 19:05:23 -07:00
Sugu Sougoumarane f42fac26e6 Protocol changes: Change most rpc APIs to use structs. 2012-08-23 16:05:41 -07:00
Mike Solomon 0f30193c8c improve error handling and path searching for zkctl 2012-08-22 23:36:46 -07:00
Mike Solomon 483fce4940 add new actions for rebuilding keyspace and shard serving data 2012-08-21 13:15:43 -07:00
Sugu Sougoumarane a18f1ccd22 fix occ_test to use nanoseconds 2012-08-20 17:18:29 -07:00
Alain Jobart 03da62013a Adding a generic command-line SQl client.
Removing the script to run al unit tests, replacing it
with a Makefile rule.
And removing an unused methoed in a test.

LGTM by Sugu.
2012-08-20 15:22:23 -07:00
Alain Jobart a623825d9c Fixing vt/client2 to be a real and working database/sql/driver/Driver.
Also adding a script to run all the unit tests that work.

LGTM by Sugu.
2012-08-17 15:32:08 -07:00
Alain Jobart dc08f7958f Fixing tabletserver unit test to pass.
LGTM from Sugu.
2012-08-17 11:23:59 -07:00
Alain Jobart 2c49b0e04b Initial set of changes on rpcplus to add streaming RPC support.
The code was forked because the changes are minimal and seem right,
and because of the backward compatibility.

The protocal is backward compatible on the wire (old clients and servers
will still work with this new library, provided they don't use
the streaming RPC feature).

On the server side, a new interface type is recognized:
func (t *T) method(args T1, sendNonFinalReply func(reply interface{}) error, finalReply *T2) error
so the server implementation can send as many responses as it wants.

On the client side, the implementation uses a channel to read
the responses (and the for : range construct, most likely).
2012-08-16 15:01:35 -07:00
Alain Jobart 7f62e42a4f Initial fork from go/net/rpc. We want to add streaming RPC support to this package.
Note it won't compile as is, as the paths are not correct.
2012-08-16 14:54:07 -07:00
Alain Jobart 986447753c Removing initial rpcplus import.
(we want the history to start wih the original files from go/net/rpc).
2012-08-16 14:51:46 -07:00
Alain Jobart ec1430962e Adding a working version of rpcplus (contains the original go rpc package,
modified to support streaming RPCs).
2012-08-16 11:05:14 -07:00
Sugu Sougoumarane 3ff4f463c3 report all time stats in nanoseconds 2012-08-15 14:10:53 -07:00
Sugu Sougoumarane 07958c1a53 sqlparser: allow straight_join 2012-08-15 12:12:32 -07:00
Mike Solomon a44215e8db make sure hooks are set up for gofmt 2012-08-13 14:41:28 -07:00
Mike Solomon cf9a0b0433 add gofmt hook 2012-08-12 00:17:47 -07:00
Mike Solomon 1a217afde1 gofmt 2012-08-11 18:57:32 -07:00
Mike Solomon cb78052041 Automated merge with https://code.google.com/p/vitess/ 2012-08-09 15:34:19 -07:00
Mike Solomon f607939c37 add more assurance that assumptions made when forcing a repartenting are guaranteed.
fix a number of race conditions related to waiting for a particular replication position.
fix a concurrency bug when issuing a number of parallel rpcs to check the replicaiton positions across all slaves.
use reflection to clean up debug logs.
2012-08-09 15:34:15 -07:00
Mike Solomon 80a82cd6f8 fix vtaction logging - looks like a merge casualty 2012-08-09 14:46:21 -07:00
Sugu Sougoumarane 349788df04 mv dbcredentials dbconfigs 2012-08-09 09:23:23 -07:00
Mike Solomon 2ccb58b246 Automated merge with https://code.google.com/p/vitess/ 2012-08-08 18:06:21 -07:00
Mike Solomon b643659309 add basic verification for range based shard names 2012-08-08 18:06:04 -07:00
Sugu Sougoumarane e448f50dcf config revamp: convert dbconfig maps to actual structs 2012-08-08 16:11:15 -07:00