github
/
vitess-gh
зеркало из https://github.com/github/vitess-gh.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
18 276 коммитов 101 ветка 22 Теги 482 MiB
Граф коммитов

308 Коммитов

Автор SHA1 Сообщение Дата
Michael Berlin 99998ccc10 vtworker: Add vtworkerclient binary which is an RPC client for vtworker. 
Add support for it to Python integration tests.
 2015-06-30 15:05:05 +02:00
Alain Jobart 78af5ef2b8 Various fixes and test changes to get grpc to work for tabletmanager. 2015-06-26 15:17:35 -07:00
Alain Jobart b69ed8e6ed Splitting out service map to protocol_flavors. That way non-default 
protocols can be enabled more easily.
 2015-06-19 14:01:03 -07:00
Alain Jobart 4e803c6ec1 Adding grpc go plugins for queryservice. 
Unit tests fixes to support gRPC query service.
 2015-06-18 08:14:01 -07:00
Shengzhe Yao abdcfb94ca use underscores for vtctld command line params 2015-06-05 10:53:10 -07:00
Alain Jobart a56aff043f Now using the VtGate object in all tests. 2015-06-04 08:37:20 -07:00
Alain Jobart ee54d8280d Creating a simpler test VtGate object, using it in 2 tests for now. 2015-06-04 07:43:43 -07:00
Alain Jobart 81667cc406 Adding SplitQuery to vtctl, and a way to call it from tests. 2015-06-02 14:01:42 -07:00
Alain Jobart cab2a70ec0 Using right protocol for vtctl/vtctld vtgate clients. 2015-06-01 09:23:04 -07:00
Alain Jobart 5a7a9e58ff Adding 'vtctl VtGateExecuteShard' command. 
Using it in new custom_sharding.py test.
 2015-06-01 09:14:16 -07:00
Alain Jobart 8133e6a36f Adding 'vtctl VtGateExecute' command, and integration test. 2015-06-01 08:28:10 -07:00
Alain Jobart fabda37434 Transforming vtclient2 into vtclient, a pure go sql client. 
It links in the vitess driver. Adding an integration test in vtgatev3.
 2015-05-28 13:00:25 -07:00
Alain Jobart f5c971f384 Removing vtclient2 specific tests in integration tests. 2015-05-27 16:55:11 -07:00
Shengzhe Yao 742db23f23 add LocalController to apply schema changes in local file system. 
1. A LocalController monitors a given directory, it first finds a
   schema change sql in the directory and then applies to its keyspace.
2. If a schema change is applied successfully, it moves the original
   sql file to a "complete" dir and coressponding execution log to
   a "log" dir. If it fails, the original sql file will be moved to
   a "error" dir.
3. Add a test case to test/schema.py so it creates a sql file in the
   schema change dir and this change will be picked up by vtctld.
 2015-05-26 17:35:18 -07:00
Ammar Aijazi b575f2f89f Make test/worker.py do batch insert at setup, so that worker copy and initial insert take similiar amounts of time 2015-05-21 19:19:59 -07:00
Ammar Aijazi 383e2c52e4 Added worker.py to cover worker integration tests 2015-05-18 16:29:47 -07:00
Alain Jobart d6d2619133 Merge branch 'master' into log 2015-05-05 07:04:38 -07:00
Alain Jobart 987c5c565f Anti-flakyness fixes. 2015-05-04 15:04:55 -07:00
Alain Jobart b447e9284b Progress in the grpc vtctl python client. Doesn't work yet though. 2015-05-04 09:54:13 -07:00
Alain Jobart 16807a416e Now using ShardReferences fields in a few places instead of 
Shards in the Keyspace.Partitions map.
 2015-03-16 08:42:25 -07:00
Liang Guo f784cd890b Add separate parameter for per connection timeout 2015-03-03 22:51:30 -08:00
Alain Jobart ed9a25393d Adding integration test support for grpc. 
Only supported for vtctl client protocol for now.
 2015-02-27 14:24:04 -08:00
Liang 64329fdfb7 Merge pull request #411 from youtube/shardconn 
Rework of VTGate retry and timeout
 2015-02-18 12:07:54 -08:00
Shengzhe Yao 5b0fdb260c Move schema editor to templates 2015-02-17 14:16:57 -08:00
脑残果粉 db29641f99 Merge pull request #378 from yaoshengzhe/fix_move_schema_editor_to_vtctld 
Move schema_editor to go/cmd/vtctld
 2015-02-17 13:00:39 -08:00
Liang Guo c7dfbf7b37 Rework of VTGate retry and timeout 2015-02-16 16:51:47 -08:00
Liang Guo d97b94c37e Add flag and enable rpc timeout for gorpctabletconn 2015-02-12 10:26:28 -08:00
Liang Guo 66edf57d68 Change default flag values, and remove a timeout check 2015-02-11 22:20:13 -08:00
Shengzhe Yao a21ec42d70 Move schema_editor to go/cmd/vtctld 2015-02-02 20:09:23 -08:00
Anthony Yeh 0474326674 Split main() in tests into two parts. 
So that one part can be replaced on import.
 2015-01-29 23:40:33 -08:00
Sugu Sougoumarane 0283251d04 Merge branch 'master' into vtgate 2015-01-19 00:31:36 -08:00
Ammar Aijazi f31f0e7139 Deflake TestUpdateStream.test_set_insert_id to fix #136 2015-01-18 01:08:59 -08:00
Sugu Sougoumarane 65b688e12d test cleanup 
I've consolidated the action of bringing up (and down)
a keyspace into keyspace_util. I think many tests can
be simplified if we used this. For now, I've only rewritten
vtgatev3_test to use it.
 2015-01-17 21:29:44 -08:00
Liang Guo 75cdab2bb4 Merge branch 'master' into vtgate 2015-01-15 15:57:23 -08:00
Ammar Aijazi 8f6376a9a8 Added a couple of query service related test helpers 2015-01-13 20:37:12 -08:00
Ammar Aijazi 882533ed74 Disable queryservice on destination tablets after `MigrateServedTypes -reverse` 2015-01-13 18:54:36 -08:00
Sugu Sougoumarane 59666e704d vtgate v3: Change test to apply schema using vtctl 2015-01-10 15:05:56 -08:00
Anthony Yeh 80fe5a6653 Merge pull request #286 from youtube/cname 
Resolve CNAME in Python ZkTopoServer to match Go's net.LookupCNAME().
 2015-01-05 22:55:55 -05:00
Anthony Yeh 9f88ff3e30 Make utils.hostname use CNAME too, not just ZkTopoServer. 
Other Python tests such as reparent.py also need the hostname
to match the one seen by Vitess.
 2015-01-05 15:54:00 -08:00
Sugu Sougoumarane b80eaa5a43 schema editor: integrate with vtctld 2015-01-02 00:40:57 -08:00
Anand Henry 593534912d Travis: Fix flaky tests 
Make min rdonly instances configurable for vtworker tasks
Remove unnecessary tablets wherever possible
Use lower buffer pool size in MySQL to save memory
Track performance using New Relic
 2014-12-22 14:39:01 -08:00
Alain Jobart 5bf39ba6bc Removing more zkocc tests. 2014-12-16 17:47:23 -08:00
Anand Henry d15af9ce82 Merge branch 'master' into travis-ci 2014-12-15 18:27:06 -08:00
Anthony Yeh 00c7a8d015 Set a default topo server flavor for integration tests. 
There are two flavors now, so the default can't be inferred.
 2014-12-13 15:25:34 -08:00
Anand Henry cdfa764d7f Travis and Coveralls integration 
Add travis configuration and dependencies script
Split integration test make targets to allow parallel execution in Travis
Add go packages required for coverage upload to Coveralls
Add coveralls and travis badges to README

Travis: Retry make targets to address flaky targets
 2014-12-12 17:44:12 -08:00
Anthony Yeh 9145994e53 Implement etcd flavor for TopoServer. 2014-12-12 17:03:13 -08:00
Sugu Sougoumarane e7f9ff7918 v3 proto: end-to-end test for select & insert 2014-12-05 22:12:47 -08:00
Anthony Yeh 689825f16f Centralize common test options in one place. 
There are now three different main() functions in our test suite.
Let's have them all get common options from one place, so we don't
have to remember to add new options everywhere.
 2014-11-14 22:19:33 -08:00
Anthony Yeh d2ccbb772c Remove extra copy of zk_setup(). 2014-11-14 16:52:26 -08:00
Anthony Yeh 3ee8a59cf1 Make topo server flavor pluggable in integration tests. 2014-11-14 16:37:05 -08:00
Alain Jobart 1c61f4da56 Making the test protocols easier to select with a command line parameter. 
(based on mysql_flavor stuff).
 2014-11-13 08:42:16 -08:00
Anthony Yeh 96fc67ba2c Add --keep-logs option to integration tests. 2014-10-06 15:03:33 -07:00
Anthony Yeh f5b4ada790 Use #!/usr/bin/env python for integration tests. 2014-10-01 16:38:59 -07:00
Alain Jobart fbf0a48662 Various test fixes. 2014-09-26 15:14:57 -07:00
Alain Jobart 1a52f6eb0f Increasing vtctl command timeout, some slow environments out there. 2014-09-15 23:00:38 -07:00
Anthony Yeh 795c7fddef Add --mysql-flavor flag to integration tests. 2014-09-09 00:28:49 -07:00
Anthony Yeh 8af01ad8ff Use failfast in python tests. 2014-09-08 20:37:10 -07:00
Alain Jobart 284c9a69f7 Now vttablet can start without mysqld running, even in healthcheck mode. 
So the mysql port is completely optional. We still try to backfill it
when we can, but it's never fatal.
 2014-09-05 12:59:23 -07:00
Alain Jobart dc8edef723 Couple small fixes to these tests. 2014-08-26 13:26:46 -07:00
Alain Jobart e58b5db21a Converting a bunch of tests to vtctl RPCs. 2014-08-22 14:35:26 -07:00
Alain Jobart 05377a6aa7 Adding test glue to run vtctl commands in various ways. 
Also fixing a few things here and there.
 2014-08-22 09:27:06 -07:00
Alain Jobart 3a90117fab Adding vtctl python gorpc client, and tests. 2014-08-20 22:50:34 -07:00
Alain Jobart 9a2be8be4b Adding test for vtctlclient. 2014-08-20 21:11:13 -07:00
Alain Jobart 8db3031863 Moving test Vtctld class. 2014-08-20 16:56:16 -07:00
Anthony Yeh 99ffb19891 Handle the case where extra_env=None (e.g. with MariaDB). 2014-08-16 10:30:22 -07:00
Alain Jobart 2e0048b690 Only passing and logging extra env, not all of env, in tests. 2014-08-11 15:28:07 -07:00
Anthony Yeh 150d8da3c3 Update integration tests for GTID refactor. 2014-07-28 14:08:17 -07:00
Alain Jobart 24abe07c4c Adding profiling support to servenv, zkclient2. 
And the test now collects pprof info.
Just run:
./zkocc_test.py -v TestZkocc.test_vtgate_qps --skip-teardown
Then run:
go tool pprof $VTROOT/bin/vtgate $VTDATAROOT/tmp/vtgate.pprof
(or with zkclient2 for the client side)
and for instance type 'web' in the prompt.
 2014-07-11 11:57:27 -07:00
Anthony Yeh 88feb393ec Global flag injection for integration tests 2014-07-07 12:46:20 -07:00
Alain Jobart e621cbca96 Adding vtworker worker return status. 
And returning it in vtworker. That way we would have realized
vtworker in actually failing in google3 all the time.
Fixing the underlying reason, topo args were not set properly.
 2014-07-01 15:56:02 -07:00
Alain Jobart 995c9d5bc5 Finishing up clone worker. 2014-06-30 13:10:55 -07:00
Alain Jobart c4bcd0b5cc Adding and checking vtgate->vtctld links. 2014-05-14 13:30:23 -07:00
Mike Solomon 65674504b7 Keep normal output quiet, but make failures more verbose to aid debugging. 
Codify some assumptions on external environment variables.
 2014-04-17 10:33:33 -07:00
Ryszard Szopa 384bb56549 Simplify queryservice tests. 2014-04-03 18:13:03 -07:00
Alain Jobart 97b951e9f9 Adding a helper to retry an action until a timeout. 
Usefull to write tests that wait for something.
I wish there were better closures in python...
 2014-03-21 11:47:57 -07:00
Alain Jobart d032b508ae Merge branch 'master' into replication 2014-03-13 12:42:09 -07:00
Ryszard Szopa 5dccdd82d1 Simplify janitor's API. 2014-03-13 10:04:07 -07:00
Alain Jobart 731dcf50fd Fixing typo from Ric's submit. 2014-03-13 09:44:09 -07:00
Ryszard Szopa be88d3618f Add integration tests for /debug/status. 2014-03-11 18:07:00 -07:00
Alain Jobart 180976201f Fixing unused parameter names. 2014-03-06 13:28:13 -08:00
Alain Jobart edd9d18786 Adding support for unix socket files. 
For all of our servers, and bson rpc python client.
Testing it in update_stream because it's simple.
 2014-03-05 20:52:58 -08:00
Liang Guo 291b349e1a Update to avoid massive test change 2014-02-27 14:55:29 -08:00
Liang Guo f3a9644776 Add SSL support in VTGate 2014-02-26 15:10:29 -08:00
Alain Jobart c23d0e4917 Moving test flags to utils. 
So we can have tests run with other flags if needed.
 2014-02-24 10:41:09 -08:00
Liang Guo 183ee58a30 Adding timeout support in VTGate 2014-02-18 23:40:21 -08:00
Liang Guo 7b9546a5e5 Fix VTGate logging and tests 2014-02-12 20:26:17 -08:00
shrutip d38b48be8a Test for ServedFrom in the client and fixes to bson encoding of SrvKeyspace. 2014-02-05 15:41:17 -08:00
shrutip 97625ca7a7 Change in api for StreamExecuteKeyRange and vtgate tests. 2014-01-31 01:31:06 -08:00
shrutip d8bf40aaa6 Small fix to util functions. 2014-01-31 01:29:57 -08:00
Alain Jobart f738d5ffc0 Now the client2 library uses tabletconn. 
Same as vtgate. Code re-use, woohoo!
 2014-01-28 17:14:09 -08:00
Alain Jobart d6df975c90 Refactoring sharded.py test. 
Changing the client2 library to register more consistent
topo servers, and use the default topo server.
 2014-01-28 14:21:34 -08:00
Alain Jobart 3f3afd5b50 Fixing vtclient2 logging in tests. 2014-01-28 13:16:55 -08:00
Alain Jobart 01b3471c7e Fixing this test after my logging change. 2014-01-28 10:13:58 -08:00
Alain Jobart f4327166a6 Refactoring zkocc_test.py. 2014-01-16 14:49:19 -08:00
Alain Jobart e824e22fb6 Using dynamic port for vtworker instead of 8085. 2014-01-13 10:09:57 -08:00
Alain Jobart 43d50c42f0 Configure vtgate -> vttablet protocol in env. 2014-01-09 19:56:56 -08:00
Alain Jobart 360ded3c07 Use a separate variable for logs in tests. 2014-01-07 21:09:43 -08:00
Alain Jobart 62ff3b6b50 Test fixes. 2014-01-07 11:45:18 -08:00
Alain Jobart 8f60899482 More test cleanup. 2014-01-06 16:22:45 -08:00
Alain Jobart 7558cd0fd9 Small fixes to tests. 2014-01-02 13:22:39 -08:00
Alain Jobart 2266113980 Moving generic topo server to environment. 2014-01-02 11:31:36 -08:00
Alain Jobart 85791a2740 Adding first version of environment.py for tests. 2014-01-02 10:17:38 -08:00
Alain Jobart 13047a4dbd Calling vtworker in SplitDiff mode in test. 2013-12-27 14:53:22 -08:00
Sugu Sougoumarane 6615bcd90b Clean up build system 
Switch to using go install. Leads to faster and cleaner builds.
go install directly installs the binaries into $VTROOT/bin directly
because $GOPATH==$VTROOT. It also intalls intermediate libraries under
pkg, which results in reuse.
There is also no more clutter in the source dirs: cleaner .gitignore.
 2013-12-24 14:28:19 -08:00
Sugu Sougoumarane 89c1781849 remove custom vt_mysqlbinlog from mysql 2013-11-27 11:16:02 -08:00
Sugu Sougoumarane d25a430ebc Fix tests after state var name change. 
Submitting ric's change.
 2013-11-26 21:45:32 -08:00
Alain Jobart 1bef92b5ee Balancer dialer now uses EndPoint. 
So we don't need to pass down the port, and it's more flexible.
 2013-11-18 17:31:43 -08:00
Alain Jobart 66574d5ca9 Adding encryption for vtgate -> vttablet. 2013-11-15 15:02:36 -08:00
Alain Jobart ebadb25f9f Adding an extra check to SlaveWasPromoted. 
To make sure the new master is indeed a master.
 2013-11-08 09:58:30 -08:00
Sugu Sougoumarane 63a2778846 Merge branch 'master' of github.com:youtube/vitess 2013-10-29 16:43:49 -07:00
shrutip 6eb4fd8ad4 Improved zkocc_test to compare vtgate zk, zkocc implementation. Pruned vttopo everywhere. 2013-10-29 12:34:54 -07:00
shrutip 929fc5058c Topo integration with vtgate. Also added mechanism to use topo with zkocc. 2013-10-29 12:34:53 -07:00
Sugu Sougoumarane 8ffe76cc8d ExecuteBatch end to end test 2013-10-28 19:41:43 -07:00
Sugu Sougoumarane c14505417a vtgate end-to-end testing infrastructure. 2013-10-01 23:50:44 -07:00
Alain Jobart 8c809302ef Specifying log_dir for a bunch of commands. 2013-09-11 09:51:07 -07:00
Alain Jobart 385905d893 Renaming toporeader into vttopo. 2013-09-05 13:49:42 -07:00
Alain Jobart 5bc00fa547 Adding a toporeader binary. 
This is a non-caching topo.TopoReader proxy.
 2013-09-05 10:36:51 -07:00
Alain Jobart 5b04914519 Less logging when expecting failure. 2013-09-03 21:56:36 -07:00
Alain Jobart 7cdb92c2c8 Using logging to output test info. 2013-08-26 14:55:38 -07:00
Alain Jobart 497fd23f92 tests: exiting with error code when tests fail. 2013-08-22 17:03:39 -07:00
Alain Jobart 4461905f7c Removinng unused function. 2013-08-15 14:14:10 -07:00
Alain Jobart daa7868f53 Converting half the tests to a new main. 2013-08-15 13:31:27 -07:00
Alain Jobart 985860248d Fixing more tests. 2013-08-14 16:52:03 -07:00
Alain Jobart 8e7842c56e Making loggin levels consistent in tests. 2013-08-12 18:07:02 -07:00
Ryszard Szopa 97c42e7095 Fix logspam. 2013-08-12 14:47:09 -07:00
Ryszard Szopa f597eecc39 utils.setup(). 2013-08-12 09:58:08 -07:00
Ryszard Szopa f2b79a8eec Fix tests to work with glog. 2013-08-06 14:58:36 -07:00
Alain Jobart 9cc49c8c13 Only adding bad zk servers in tabletmanager.py. 
No need to spam in other tests.
 2013-08-06 12:40:00 -07:00
Alain Jobart 00ee097e74 Implementing overlapping serving graphs. 2013-07-30 18:03:13 -07:00
Alain Jobart db9003ce55 Making tests more reliable. 2013-07-30 10:25:22 -07:00
Alain Jobart 73077f6bbb Now resolving zk hosts before sending them to zk. 
That way we can skip the ones that don't resolve, instead
of having the library fail for them.
 2013-07-29 13:02:01 -07:00
Alain Jobart 18d8b68a06 Another round of conersions to TopologServer. Almost done now. 2013-07-16 10:38:45 -07:00
Alain Jobart 9bc6321972 Exporting master serving addresses in all cells, adding comments to rebuilding code. 
LGTM Sugu.
 2013-06-26 13:24:59 -07:00
Alain Jobart f53891c53e Implementing ShardExternallyReparented, with test. 
LGM Sugu.
 2013-06-25 12:54:15 -07:00
Alain Jobart 97b78a40bf Removing last uses of GetSessionId by dbname. 
LGTM Mike.
 2013-05-08 15:15:55 -07:00
Mike Solomon b5dbc052f5 add a measure of safety for recursive delete 2013-04-24 18:12:53 -07:00
Alain Jobart 219fe644c0 Now allocating ports from a port base for zk / zkocc, more to come. 2013-04-12 12:21:52 -07:00
Sugu Sougoumarane 0f8c973c25 Revamp go client to comply to a new API. Add keyspace_id validation to vttablet. 2013-04-10 13:15:30 -07:00
Alain Jobart 62d8171e53 Replacing: 
not 'aa' in var
with:
'aa' not in var
in tests.
 2013-03-22 11:34:09 -07:00
Alain Jobart 85d8260811 Running Validate before Reparent, and other fixes in reparent. 
LGTM Mike.
 2013-01-17 11:02:52 -08:00
Alain Jobart a8813cd52e Validation: making use of WaitGroup more consistent. 
Tests: fixing them after Mike's change.

LGTM Mike.
 2013-01-16 12:26:18 -08:00
Mike Solomon 4321521a33 adding a new hook for my.cnf creation 2013-01-08 01:47:57 -08:00
Alain Jobart 7e58a199ab Factoring parameter parsing in utils.py for tests. 
LGTM Ric.
 2013-01-04 13:14:07 -08:00
Alain Jobart f2aaf768b7 Small changes to get Sponge script working. 
LGTM Ric.
 2012-12-28 13:47:47 -08:00
Ric Szopa 51d4b10937 Make tests use VTDATAROOT. 2012-12-27 13:58:39 -08:00
Alain Jobart 6c2b371f75 Test script clean up. 
LGTM Mike.
 2012-12-07 12:29:47 -08:00
Alain Jobart 882598740f Making zkocc process management and logging better in tests. 
LGTM Mike.
 2012-12-06 11:31:48 -08:00
Alain Jobart 3d57d98fb4 Tests now wait for tablets to be serving when required. 
(and various test fixes).

LGTM Mike.
 2012-12-03 12:25:19 -08:00
Ric Szopa 0bc605a269 Cleaned up the code according to PyFlakes suggestions. 2012-11-28 17:23:47 -08:00
Alain Jobart 571a208104 Better parameter and commands handling for vtctl. 
LGTM Ric.
 2012-11-21 11:14:42 -08:00
Alain Jobart e1282bd4d9 Using flag sets for sub-parameters in some operations. 
LGTM Ric.
 2012-11-20 11:59:40 -08:00
Mike Solomon 5726b783d9 test new lag slave handling 2012-11-07 00:28:55 -08:00
Alain Jobart 724b920f19 Adding support for streaming queries in the sharded client. 
LGTM Mike.
 2012-10-11 12:57:37 -07:00
Alain Jobart ab981f541e Supporting multiple zkocc servers in conn_cache.go, with test. 
Also refactoring Dial from ZkoccConn to behave like zookeeper.Dial.

LGTM Mike.
 2012-10-10 14:36:26 -07:00
Alain Jobart 6f72f7ccd9 Various fixes and improvements to the sharded client. 
LGTM Mike.
 2012-10-10 09:40:00 -07:00
Alain Jobart ac47c6ec2e New sharded test, and some test refactoring. The sharded test needs 
some other code to pass, will be in a different commit.

LGTM Ric.
 2012-10-02 16:53:12 -07:00
Alain Jobart c94437f155 Changing vtclient2 to accept a driver name (streaming flag then becomes obsolete). 
Also moving the dml detection to vtclient2.
Refactoring tests to move vttablet_write_query to utils.vttablet_query.

LGMT: Ric.
 2012-10-01 15:36:39 -07:00
Alain Jobart ed6b383af3 Moving zkocc test to a new toplevel test directory, and splitting 
up some utils functions.

LGTM Ric.
 2012-09-28 16:07:05 -07:00