Граф коммитов

17407 Коммитов

Автор SHA1 Сообщение Дата
Sugu Sougoumarane b824be8546 migrater: table migrate should not shard migrate
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-16 15:50:57 -07:00
Sugu Sougoumarane 74ca3b19cd
Merge pull request #5194 from planetscale/ss-vrepl-reshard-migrate
vreplication: migrate source streams to target shards on MigrateWrites
2019-10-16 15:42:45 -07:00
Andres Taylor 0806bf15d0 Allow vtbackup to run as a daemon
Signed-off-by: Andres Taylor <antaylor@squareup.com>
2019-10-16 17:50:22 -04:00
Deepthi Sigireddi 8cdd456a6c
Merge pull request #5312 from planetscale/ds-rebalance-travis
split unit and unit_race between different shards, reduce load on shard 0
2019-10-16 11:34:18 -07:00
deepthi ee45f28a04 split unit and unit_race between different shards, reduce load on shard 0
Signed-off-by: deepthi <deepthi@planetscale.com>
2019-10-16 10:16:40 -07:00
yuxiaobo 3256c81fb2 add License in /py folder
Signed-off-by: yuxiaobo <yuxiaobogo@163.com>
2019-10-16 19:51:52 +08:00
Sugu Sougoumarane a715872079
Merge pull request #5297 from tanjunchen/update-lisence-header-java-directory
update the license header in java/ tools/ travis/ tests.go files
2019-10-15 20:54:24 -07:00
Sugu Sougoumarane e68bf30680
Merge pull request #5301 from planetscale/sa-drop-check
Added support for CHECK in Parser Grammar
2019-10-15 16:11:07 -07:00
Anthony Yeh 1bab089903
Make SetMaster idempotent. (#5300)
Signed-off-by: Anthony Yeh <enisoc@planetscale.com>
2019-10-15 16:07:41 -07:00
Deepthi Sigireddi 6abaa03499
Merge pull request #5296 from planetscale/ds-shard-watch-tests
unit tests for shard watch
2019-10-15 13:40:46 -07:00
dleibovic c0aa781e4c Correct transaction pool timeouts
When grabbing a connection from the transaction pool, we should use the queryserver-config-txpool-timeout.

BEGIN statements should not use the queryserver-config-txpool-timeout when executing the BEGIN query.

Signed-off-by: dleibovic <dleibovic@etsy.com>
2019-10-15 15:01:41 -04:00
deepthi 0e78d81ea6 Merge branch 'master' into reparent-refactor
Signed-off-by: deepthi <deepthi@planetscale.com>
2019-10-15 09:14:32 -07:00
Deepthi Sigireddi ee9f1ce160
Merge pull request #5299 from systay/less-mvn-output
Less output from Maven
2019-10-15 08:04:32 -07:00
Andres Taylor edd5d18ebd
Merge pull request #5304 from planetscale/ds-split-tests
Split tests into unit and endtoend
2019-10-15 10:06:08 -04:00
Andres Taylor 810a919a32 Less output from Maven
Signed-off-by: Andres Taylor <antaylor@squareup.com>
2019-10-15 03:21:50 -04:00
deepthi 2491da0f0f Split tests into unit and endtoend(e2e). Speed up backup test
Signed-off-by: deepthi <deepthi@planetscale.com>
2019-10-14 22:06:04 -07:00
Deepthi Sigireddi b43e6f5fb0
Merge pull request #5292 from planetscale/ds-ter-tests
Unit tests for wrangler version of TabletExternallyReparented
2019-10-14 20:15:45 -07:00
Saif Alharthi aca1024e12 Added support for CHECK in Parser
Signed-off-by: Saif Alharthi <saif@saifalharthi.me>
2019-10-14 16:16:02 -07:00
Anthony Yeh 75f547126e Merge branch 'master' into reparent-refactor
Signed-off-by: Anthony Yeh <enisoc@planetscale.com>
2019-10-14 11:32:50 -07:00
deepthi 352d31dff4 fix doc comment
Signed-off-by: deepthi <deepthi@planetscale.com>
2019-10-14 10:50:19 -07:00
wh 27b5aae3f9 treat the route of sql with pseudo table as SelectReference
Signed-off-by: wh <wanghao.seed@gmail.com>
2019-10-14 22:37:02 +08:00
tanjunchen a205ed390f update license header in java/ tools/ travis/ test.go files
Signed-off-by: tanjunchen <2799194073@qq.com>
2019-10-12 15:55:55 +08:00
deepthi 214d7ea99f use mutex properly to control access to _shardSyncChan and _shardSyncCancel
Signed-off-by: deepthi <deepthi@planetscale.com>
2019-10-11 21:36:04 -07:00
deepthi 639f1e3e69 unit tests for shard watch
Signed-off-by: deepthi <deepthi@planetscale.com>
2019-10-11 21:23:31 -07:00
Anthony Yeh 7918d1bbce
Make DemoteMaster idempotent. (#5293)
* Remove obsolete comments.

These are talking about the serving graph, which no longer exists.
Instead of storing serving state of each tablet in topo, we now have
vtgate directly query serving state of every tablet.

Signed-off-by: Anthony Yeh <enisoc@planetscale.com>

* Make DemoteMaster idempotent.

Signed-off-by: Anthony Yeh <enisoc@planetscale.com>
2019-10-11 20:21:11 -07:00
Sugu Sougoumarane 0f10b1aed0 stream_migrater: address review comments
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 95456a22d0 stream_migrater: rest of the tests added
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 7dba0118c0 stream_migrater: tests for non-error flows
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane f51a02a626 migrater: tweaks to code and tests
Make stream validation more robust. It wasn't catching all mismatches.
Clean up target streams before migration in case some were left
over during previous failed cutover.

Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 1e82f7053c migrater: improved tests
The fake db client framework now allows for queries to return different
results based on each call. This is required for future tests.

Also added more logging in a few places for improved troubleshooting.

Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 381c193a33 stream_migrater: initial test
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane f3396bf19f migrater: make the test framework generic
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 1208a1656f migrater: make table migration mimic prod
We assume m*n streams for table migrations for m sources and
n targets

Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 896ccee631 stream_migrater: make migrater tests pass
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 01b6c7a067 stream_migrater: integrate with migrater
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 470c2aaca1 stream_migrater: high level functions
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 966e6790a2 migrater: use bulk vreplication DML features
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane b359fabc8f stream_migrater: initial cut
Signed-off-by: Sugu Sougoumarane <ssougou@gmail.com>
2019-10-11 19:34:14 -07:00
Sugu Sougoumarane 123c076b5c
Merge pull request #5285 from tanjunchen/add-License-.java-file
add License in *.java files in java directory
2019-10-11 18:52:45 -07:00
deepthi 2b6599e87c reads and writes to _shardSyncChan and _shardSyncCancel need to be protected by mutex
Signed-off-by: deepthi <deepthi@planetscale.com>
2019-10-11 15:43:14 -07:00
Sugu Sougoumarane 00c757dbb1
Merge pull request #5277 from mc0/addSupportForInsertDefault
add support for DEFAULT in insert statements for sequences to the query planner
2019-10-11 15:31:09 -07:00
Mark Caudill 53949d3da7 add support for DEFAULT in insert statements for sequences to the query planner
This will treat DEFAULT as "null" for the purposes of sequences when
running insert statements. This matches with MySQL's documented
behavior and observed resulted.

See for more information:
https://dev.mysql.com/doc/refman/8.0/en/data-type-defaults.html

Signed-off-by: Mark Caudill <mark@sharpspring.com>
2019-10-11 16:46:22 -04:00
Sugu Sougoumarane 23efa4145a
Merge pull request #5271 from dasl-/schema-time
Fix invocation of deferred function for loading schema.
2019-10-11 12:49:09 -07:00
Sugu Sougoumarane 06ae28d89c
Merge pull request #5276 from xichengliudui/fix404
fix 404 page not found
2019-10-11 12:47:43 -07:00
Sugu Sougoumarane 32f80f8860
Merge pull request #5287 from tanjunchen/add-License-go-filse
add License in /go files
2019-10-11 12:47:11 -07:00
Sugu Sougoumarane 8d92f75bbd
Merge pull request #5282 from tanjunchen/fix-up-reasonbale-goimports
fix unreasonable-goimports way
2019-10-11 12:46:53 -07:00
deepthi f38351213b Unit tests for wrangler version of TabletExternallyReparented.
Duplicated relevant RPC tests for wrangler.
Moved unrelated tests to a different file, fixed RPC tests to not error
out during SetMaster

Signed-off-by: deepthi <deepthi@planetscale.com>
2019-10-11 11:13:14 -07:00
tanjunchen da620bf6dc add License in *.java files in java directory
Signed-off-by: tanjunchen <2799194073@qq.com>
2019-10-12 01:02:36 +08:00
tanjunchen 63c969ca7d add License in /go files
Signed-off-by: tanjunchen <2799194073@qq.com>
2019-10-12 00:31:28 +08:00
Sugu Sougoumarane c81647138e
Merge pull request #5283 from xichengliudui/update-MD-file-spec
Update mark down file hyperlink format
2019-10-11 09:16:07 -07:00