Граф коммитов

32086 Коммитов

Автор SHA1 Сообщение Дата
Sugu Sougoumarane 64cc603008 cleanup of various configs & tests to use the new VTROOT structure 2012-09-06 16:14:19 -07:00
Alain Jobart 6ea812b5c1 bson marshaling: now use the custom marshalers even for
embedded structures. Reworking the code a bit. And unit tests.

LGTM Sugu.
2012-09-06 13:09:40 -07:00
Sugu Sougoumarane 24c5e1edf4 mysqlctl: init can now create symlinks so data & logs can live on different drives. 2012-09-06 11:46:32 -07:00
Alain Jobart fb70af1311 Renaming a few more 'self' to more meaningfull names.
LGTM Sugu.
2012-09-04 16:58:16 -07:00
Alain Jobart 7a92da6eff Adding support in cbson for uint64 decoding, and re-enabling
it in bootstrap, now that it doesn't break the unit test any more.

LGTM Sugu.
2012-09-04 14:32:02 -07:00
Sugu Sougoumarane f05f6684f3 Add missing hook to ensure linear tree. 2012-09-04 14:27:00 -07:00
Sugu Sougoumarane f96eef27c1 env & config changes: Move all program dependencies to use VTROOT & symlink magic. 2012-09-04 14:20:28 -07:00
Mike Solomon 32897c231c automatically purge actions when Scrap transition is forced. 2012-09-03 22:16:50 -07:00
Mike Solomon 6639d8931c improved validation of the replication graph. pull data out of mysql directly to validate against zookeeper. 2012-09-01 23:39:28 -07:00
Alain Jobart 00f740bfa7 Using a different connection pool for streaming SQL queries.
And making the streaming response size a config variable while
I'm at it.

LGTM Sugu.
2012-08-31 15:27:42 -07:00
Alain Jobart 24f9ff8fef Fixing the return value of decode_next in cbson to be consistent
with the pure python bson decoder (and not return -1 on end of input).

LGTM Mike.
2012-08-31 12:22:27 -07:00
Mike Solomon 0e4ad2ad4c ammend default db config and propagate it properly to mysqld 2012-08-31 11:56:52 -07:00
Mike Solomon 0248893c08 ignore files left by OS X 2012-08-31 11:56:01 -07:00
Alain Jobart 0336cf99c6 Changing some coding style for exceptions.
LGTM Mike.
2012-08-30 14:33:02 -07:00
Mike Solomon 5df12637f9 parallelize validate action 2012-08-30 11:54:22 -07:00
Alain Jobart 65cc5d2703 Pushing a native C implementation of bson encoder / decoder
for python. re-run bootstrap.sh to compile it, and re-source
dev.env to get your PYTHONPATH updated.

LGTM Mike.
2012-08-30 11:46:16 -07:00
Alain Jobart 974e3d871e Refactoring some code in client.go so we don't remove and re-add
streaming RPC values. Minor detail.

LGTM Sugu.
2012-08-29 18:15:24 -07:00
Alain Jobart f2bcf481f2 Minor style change.
LGTMike.
2012-08-29 18:00:32 -07:00
Alain Jobart e4aec22b63 Streaming SQL queries now return multiple responses in one RPC response.
So we don't use StreamQueryResult, but just QueryResult (simpler
and faster).

Also fixing a bug if using cbson, where the decode_next method
returns -1 instead of the offset at the end of the decode.

LGTMike.
2012-08-29 17:05:14 -07:00
Mike Solomon ce8ef74f42 Provide new alternate paths based on $VTROOT. 2012-08-28 18:57:05 -07:00
Mike Solomon ed260e2691 change validation to exclude classes of tablets from the replication graph checks. 2012-08-28 18:53:00 -07:00
Mike Solomon 40ce8a2e55 Gracefully stop the agent when the app quits.
This may seem pedantic, but it stop the app log from filling up with warning messages under normal circumstances.
2012-08-28 18:50:37 -07:00
Mike Solomon 386b774092 remove parent relationship when a tablet is scrapped 2012-08-28 18:47:39 -07:00
Alain Jobart 5ce4b4cf28 Using a shorter EndOfStream marker.
LGTMike.
2012-08-28 18:24:12 -07:00
Alain Jobart fdd05e1a5d Reworking the python rpc code, and adding streaming support.
In some situations (large payloads), the python code is up to 20% faster.

LGTM: Mike & Sugu.
2012-08-28 16:45:27 -07:00
Alain Jobart 90e0a63589 Code clean-up: renaming a few 'self' into variable names,
to follow newer code conventions.

LGTM: Sugu
2012-08-28 16:05:34 -07:00
Alain Jobart b87a1e9822 Fixing the indentation in this file. 2012-08-28 16:04:29 -07:00
Dmitry Vyuokv 0bfbb2867e Replace map lookup with array indexing. 2012-08-28 15:00:33 -07:00
Sugu Sougoumarane 2375d1c4c8 fix typo in tablet2.py 2012-08-27 19:59:38 -07:00
Alain Jobart dd251bbab8 Setting the storage engine in the python tests. That way having the
default in mysql server be MyIsam won't cause the tests to fail.
2012-08-27 17:45:24 -07:00
Alain Jobart 1138c656aa Now using rpcplus package everywhere, and adding support for streaming
mysql queries using a streaming RPC API. Only the go client side is
in here, the python client code will be next.

LGTM by Mike and Sugu over the last couple weeks.
2012-08-27 16:26:06 -07:00
Alain Jobart e0a113f69c New version of the streaming RPC code. We simplified the protocol
to use the same message structure, not have a sub-sequence id,
and use an extra message to signal end-of-stream.
2012-08-27 14:06:09 -07:00
Alain Jobart d567446f6a Go-formatting that file. 2012-08-27 14:04:32 -07:00
Sugu Sougoumarane 526a3d7a6b report memcache stats. 2012-08-26 21:33:00 -07:00
Mike Solomon ece32b31fe use zookeeper.IsError consistently 2012-08-25 13:14:12 -07:00
Mike Solomon df55614859 allow transition from idle to scrap
fix CreateTablet for non replicating types
2012-08-25 12:51:42 -07:00
Mike Solomon f1af1cf3aa clarify the transition to "idle" and limit when that can be applied.
change the test cases to reflect the new reality.
set 3306 as the default mysql port when re-reading a my.cnf file.
2012-08-24 15:18:29 -07:00
Sugu Sougoumarane 35edf1e5d4 Added tag weekly for changeset 62afd0103052 2012-08-23 20:36:21 -07:00
Sugu Sougoumarane 7fd27509a2 Added tag weekly.2012-08-23.go.4fdf6aa4f602 for changeset 62afd0103052 2012-08-23 20:36:05 -07:00
Mike Solomon 1e74075bfb resolve the fdqn more reliably
this function is small enough i didn't feel like pulling it into a separate library.
2012-08-23 19:06:48 -07:00
Mike Solomon e8a676228e route most help to stdout 2012-08-23 19:05:23 -07:00
Sugu Sougoumarane f42fac26e6 Protocol changes: Change most rpc APIs to use structs. 2012-08-23 16:05:41 -07:00
Mike Solomon 0f30193c8c improve error handling and path searching for zkctl 2012-08-22 23:36:46 -07:00
Mike Solomon 483fce4940 add new actions for rebuilding keyspace and shard serving data 2012-08-21 13:15:43 -07:00
Sugu Sougoumarane a18f1ccd22 fix occ_test to use nanoseconds 2012-08-20 17:18:29 -07:00
Alain Jobart 03da62013a Adding a generic command-line SQl client.
Removing the script to run al unit tests, replacing it
with a Makefile rule.
And removing an unused methoed in a test.

LGTM by Sugu.
2012-08-20 15:22:23 -07:00
Alain Jobart a623825d9c Fixing vt/client2 to be a real and working database/sql/driver/Driver.
Also adding a script to run all the unit tests that work.

LGTM by Sugu.
2012-08-17 15:32:08 -07:00
Alain Jobart dc08f7958f Fixing tabletserver unit test to pass.
LGTM from Sugu.
2012-08-17 11:23:59 -07:00
Alain Jobart 2c49b0e04b Initial set of changes on rpcplus to add streaming RPC support.
The code was forked because the changes are minimal and seem right,
and because of the backward compatibility.

The protocal is backward compatible on the wire (old clients and servers
will still work with this new library, provided they don't use
the streaming RPC feature).

On the server side, a new interface type is recognized:
func (t *T) method(args T1, sendNonFinalReply func(reply interface{}) error, finalReply *T2) error
so the server implementation can send as many responses as it wants.

On the client side, the implementation uses a channel to read
the responses (and the for : range construct, most likely).
2012-08-16 15:01:35 -07:00
Alain Jobart 7f62e42a4f Initial fork from go/net/rpc. We want to add streaming RPC support to this package.
Note it won't compile as is, as the paths are not correct.
2012-08-16 14:54:07 -07:00