* CI: remove pitrtls test
Signed-off-by: deepthi <deepthi@planetscale.com>
* feat: update onclose timeout to 10 seconds
Signed-off-by: Manan Gupta <manan@planetscale.com>
Signed-off-by: deepthi <deepthi@planetscale.com>
* test: fix unit test
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: fix flaky test by not checking for an error
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: handle the case of empty hostname in tablet initialization
Signed-off-by: Manan Gupta <manan@planetscale.com>
* CI: don't run backup_transform tests during upgrade/downgrade because it has been removed in v16
Signed-off-by: deepthi <deepthi@planetscale.com>
* flaky test fix - use new flag in v15
Signed-off-by: deepthi <deepthi@planetscale.com>
Signed-off-by: deepthi <deepthi@planetscale.com>
Signed-off-by: Manan Gupta <manan@planetscale.com>
Co-authored-by: Manan Gupta <manan@planetscale.com>
* test go.sum modification
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* test filter with different go.mod and go.sum rules
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* use different filters for go.mod and go.sum everywhere
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* clean up go.sum
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Remove launchable in release-15.0
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Addition of a CI tool to detect dead links in test/config.json (#11668) (#11712)
* Addition of a CI tool to detect dead links in test/config.json (#11668)
* Addition of a tool to detect unrequireed CI clusters in test/config.json
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* move mysql80 derived to queries/derived in config.json
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* test: clean the user table as well
Signed-off-by: Andres Taylor <andres@planetscale.com>
* Fix flakyness in TestDerivedTableWithHaving
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Skip TestDerivedAggregationOnRHS
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Go mod tidy
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Andres Taylor <andres@planetscale.com>
Co-authored-by: Andres Taylor <andres@planetscale.com>
* apply go mod tidy
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Andres Taylor <andres@planetscale.com>
Co-authored-by: Andres Taylor <andres@planetscale.com>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Andres Taylor <andres@planetscale.com>
Co-authored-by: Andres Taylor <andres@planetscale.com>
* Addition of a CI tool to detect dead links in test/config.json (#11668)
* Addition of a tool to detect unrequireed CI clusters in test/config.json
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* move mysql80 derived to queries/derived in config.json
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* test: clean the user table as well
Signed-off-by: Andres Taylor <andres@planetscale.com>
* Fix flakyness in TestDerivedTableWithHaving
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Skip TestDerivedAggregationOnRHS
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Go mod tidy
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Andres Taylor <andres@planetscale.com>
Co-authored-by: Andres Taylor <andres@planetscale.com>
* apply go mod tidy
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Andres Taylor <andres@planetscale.com>
Co-authored-by: Andres Taylor <andres@planetscale.com>
* test: added failing e2e test
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* log txID and reserveID in stream execute
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* fix: maintain list of qd per key on the map and check for current connection id while removing
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* added additional comments
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* Move towards MySQL 8.0 as the default template generation
This upgrades the remaining things to Ubuntu 20.04 and makes MySQL 8.0
the default we run tests against. We still have tests for MySQL 5.7 but
those are now explicitly opted into.
This should finish up the Ubuntu 20.04 upgrade and also makes things
easier for the future when we need to upgrade again.
Signed-off-by: Dirkjan Bussink <d.bussink@gmail.com>
* CI: rename shard vtorc_8.0 to vtorc_5.7, change expected test output for 8.0
Signed-off-by: deepthi <deepthi@planetscale.com>
* CI: increase timeout for 8.0 tests on the actual test step from 30 to 45 mins
Signed-off-by: deepthi <deepthi@planetscale.com>
* CI: increase timeout to 45 minutes for mysql57 tests too. We really only need this for vtorc, but I've made the change to the template so all tests get it.
Signed-off-by: deepthi <deepthi@planetscale.com>
* CI: fix vtorc test to work with both 5.7 and 8.0
Signed-off-by: deepthi <deepthi@planetscale.com>
* CI: missed docker flag in mysql57 template, one more fix to vtorc test
Signed-off-by: deepthi <deepthi@planetscale.com>
* removing spaces from pb file
Signed-off-by: Rameez Sajwani <rameezwazirali@hotmail.com>
* removing spaces in pb file part 2
Signed-off-by: Rameez Sajwani <rameezwazirali@hotmail.com>
Signed-off-by: Dirkjan Bussink <d.bussink@gmail.com>
Signed-off-by: deepthi <deepthi@planetscale.com>
Signed-off-by: Rameez Sajwani <rameezwazirali@hotmail.com>
Co-authored-by: deepthi <deepthi@planetscale.com>
Co-authored-by: Rameez Sajwani <rameezwazirali@hotmail.com>
* Don't block on vschema channel in case of heavy vschema changes and vstream load
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Prevent VStreamer engine deadlocks during state transitions
The VStreamer engine is somewhat unusual in two ways:
1. It is open and running on replica tablets rather than only
running on primary tablets.
2. It has no controllers so the main engine mutex is widely shared.
Because of this, when a tablet has open vstreams (direct binary log
streams) performing work and a state transition starts, it can
deadlock with the tabletmanager's state lock when checking if
the engine is open or not.
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Address review comments
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Signed-off-by: Matt Lord <mattalord@gmail.com>
Co-authored-by: Matt Lord <mattalord@gmail.com>
* feat: remove cli code which isn't used in vtorc
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: port over the /api/problems endpoint to the http server of VTOrc
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: added comments to api/problems/ endpoint explaining the future scope
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove api endpoints registered in old VTOrc ui
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove gracefulTakeover tests since the api is removed and add tests for the api/problems API
Signed-off-by: Manan Gupta <manan@planetscale.com>
* refactor: fix license year and imports
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add apis for disabling and enabling global recoveries
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add api for reading replication-analysis
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add health api as well
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: add tests for the api's ported over
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: add liveness endpoint to tests too
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: return an internal server error when VTOrc isn't healthy
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: reduce flakiness in api tests
Signed-off-by: Manan Gupta <manan@planetscale.com>
Signed-off-by: Manan Gupta <manan@planetscale.com>
* Rotate binary log before for snapshot connections
Rotate the binary logs to limit the GTID auto positioning overhead.
This is needed as the currently open binary log (which can be up to 1G in size
by default) will need to be scanned and empty GTID events will be streamed for
those GTIDs in the log that we are skipping. In total, this can add a lot of
overhead on both the mysqld instance and the tablet.
Rotating the log ensures that we are processing a fresh binary log that will
be minimal in size and GTID events.
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Don't cause VStream failure if we can't rotate the binary log
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Limit binlog flushes and add e2e test
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Minor changes after self review
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Add flag and Get/Set methods for the rotation threshold
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Use dashes for new flags
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Minor changes after self review
Signed-off-by: Matt Lord <mattalord@gmail.com>
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Setup 2 healthy replicas, confirm semi-sync and repl state
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Cleanup after self review
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Reduce backup job time so that transform at least gets a chance to run
Signed-off-by: Matt Lord <mattalord@gmail.com>
* More reliably clear out tablet data
Signed-off-by: Matt Lord <mattalord@gmail.com>
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Initial Implementation of partial movetables. Implement cross-shard queries that obey shard routing rules.
Refactor rss updation with routed shard and add to multi col resolution. Run vtgate and reservedconn tests for both regular and with a partially moved shard.
Add ability to run tests with partial keyspaces by adding to a list in the CI generator. Implement that in test.go and cluster setup. Revert previous iteration of running partial keyspace tests in parallel. One test is failing: TestSetSystemVarAutocommitWithConnError.
Add partial vtgate misc test
Add partial keyspace tests to vtgate transaction
Add vtgate queries partial keyspace tests
Review and fix skipped tests where applicable. Refactor to allow conditional skipping of tests for partial keyspaces only so that other tests work exactly as earlier without specifying the DbName, for example
Add move shards example
Cache routing tables and minor refactor. Move move_shards example
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Add lookup index to move shards example. Comment error logs while trying to delete from missing _vt.vdiff table
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Remove move shards demo example
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Add vtgate flag to enable shard routing. Update tests to get vtparams based on partial keyspace setting, so that global routing continues to be tested as earlier without DbName being specified
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
To create subsequent partial movetables workflows we should ignore previous partial movetables (now frozen)
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Remove vdiff2 deletes since they were failing unit tests etc
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Use vtgate flag to enable shard routing rules
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Fix incorrect test setup
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Expect modified frozen query
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
set vtgate param --enable_shard_routing in partial movetables test
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Fix failing tests
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Fix flags test
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Use VTParams helper for partial keyspace tests
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Specify vtParams.DBName for partial keyspace queries
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Self-review. Remove bypass caching.
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Report partial SwitchTraffic results
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Try to address most of the upstream PR review comments
From: https://github.com/vitessio/vitess/pull/9987
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Enforce proper routing for partial migrations
Signed-off-by: Matt Lord <mattalord@gmail.com>
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Minor changes after self review
Signed-off-by: Matt Lord <mattalord@gmail.com>
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Account for local timezone in check for vdiff progress
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Update go version in workflows. Fix gofmt issue
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Fix failing CI tests
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Comment failing test for partial keyspaces
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Fix TestVtGateVtExplain by specifying dbname
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Fix leftover debug code
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Move partial keyspace tests to a single shard. Refactor test.go to use multiple config.json files
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Address review comments
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Address review comments
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Improve test skip comments
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* gofmt
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Fix failing tests
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Address review comments
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Try TestFunctionInDefault for partial keyspaces. Update skip comment.
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Delete temporary log lines
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Signed-off-by: Matt Lord <mattalord@gmail.com>
Co-authored-by: Matt Lord <mattalord@gmail.com>
* feat: add flag to turn off replication manager
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add test for replication manager failing when the primary tablet's port changes
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: path repair replication to also handle the of case of IO error
Signed-off-by: Manan Gupta <manan@planetscale.com>
* ci: add new package to run in cluter 18
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: fix flags test expectation
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: new flags should use hyphens
Signed-off-by: Manan Gupta <manan@planetscale.com>
* docs: fix comments in replication manager
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: rewrite replication manager check conditions to be more readable
Signed-off-by: Manan Gupta <manan@planetscale.com>
Signed-off-by: Manan Gupta <manan@planetscale.com>
* Upgrade go version to 1.18.5
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Update test.go with the proper bootstrap version
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Upgrade CI for unit tests to Ubuntu 20.04
Extracted from https://github.com/vitessio/vitess/pull/11026
Signed-off-by: Dirkjan Bussink <d.bussink@gmail.com>
* Fix MySQL installation
Signed-off-by: Dirkjan Bussink <d.bussink@gmail.com>
Signed-off-by: Dirkjan Bussink <d.bussink@gmail.com>
* feat: added query logging to safe session
Signed-off-by: Andres Taylor <andres@planetscale.com>
* feat: added [explain format=vtexplain] parsing and AST
Signed-off-by: Andres Taylor <andres@planetscale.com>
* feat: add planning of vtexplain queries
Signed-off-by: Andres Taylor <andres@planetscale.com>
* feat: keep the logging even in the precense of autocommits
Signed-off-by: Andres Taylor <andres@planetscale.com>
* feat: use table result instead of warnings, and move the logging to scattercon
Signed-off-by: Andres Taylor <andres@planetscale.com>
* feat: log commit to vtexplain logger and added e2e test
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* feat: vindex query to mark vindexExec in session
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* test: run only for gen4 planner
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* feat: vtexplain logs with bindvars replaces, and begin being counted with the real query
Signed-off-by: Andres Taylor <andres@planetscale.com>
* feat: add ACTUALLY_RUN_QUERIES as a comment directive to vtexplain and block dml queries if not specified
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: make sure we add the actually_runs_queries directive to inserts we want to inspect
Signed-off-by: Andres Taylor <andres@planetscale.com>
* docs: added info to release notes
Signed-off-by: Andres Taylor <andres@planetscale.com>
* typo: fix error message
Signed-off-by: Andres Taylor <andres@planetscale.com>
* feat: ignore cases on comment directives
Signed-off-by: Andres Taylor <andres@planetscale.com>
* fix: CommentDirective now hides internals so that the lower casing of keys can be preserved everywhere
Signed-off-by: Andres Taylor <andres@planetscale.com>
* test: improve assertion
Signed-off-by: Andres Taylor <andres@planetscale.com>
* chore: clean up accidental change
Signed-off-by: Andres Taylor <andres@planetscale.com>
* refactor: clean up so more responsibility for vtexplain ends up in the engine primitive
Signed-off-by: Andres Taylor <andres@planetscale.com>
* fix: no need to Unquote multiple times
Signed-off-by: Andres Taylor <andres@planetscale.com>
* fix: rename comment directive
Signed-off-by: Andres Taylor <andres@planetscale.com>
Co-authored-by: Harshit Gangal <harshit@planetscale.com>
Co-authored-by: Manan Gupta <manan@planetscale.com>
* feat: use the latest operator yaml file
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add initial script for vtop example
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add script to install kubectl and kind and add a github workflow
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add code to verify vtadmin and vtorc are running correctly
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add move tables and reshard part to the example
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove the inserted row in vtorc check so that move tables isn't affected
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: run the ci test outside docker and skip build since it is already done in a previous step
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: source build.env before running the test in ci
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: use custom image names in the test so as to not add image pull policies to the configuration
Signed-off-by: Manan Gupta <manan@planetscale.com>
* ci: remove setup steps that aren't used
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: use the common files instead of creating new ones
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: increase timeout of the ci
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: turned off semi-sync for the test
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: insertion should be retried since VTOrc might take a few seconds to fix it
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove the workflow file since it is too heavy
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add double dashed flags and remove configuration for ci
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: fix readme for cluster example
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: copy init_db.sql file to 101 yaml
Signed-off-by: Manan Gupta <manan@planetscale.com>
* docs: fix comment in helper file
Signed-off-by: Manan Gupta <manan@planetscale.com>
* Initial addition of the skip workflow directive in docker_test_cluster_10
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Changed assertion in skip workflow step
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Use github.event.push.ref to check the event type
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Addition of debug information in the skip ci step
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Addition of debug information in the skip ci step
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Addition of debug information in the skip ci step
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Skip the step based on the skip-workflow step
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Applied the skip-workflow step on all the workflows
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Changed the vtadmin workflows' default directory to root
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Removed unwanted workflow files
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Better bash syntax for regex condition
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Changed skip to use boolean string and use better regex to match the release branch
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
* Add support for MySQL 8.0 in backup tests
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Add 8.0 workflow
Signed-off-by: Matt Lord <mattalord@gmail.com>
* whitespace
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Use vtctldclient SetKeyspaceDurabilityPolicy to manage semi-sync
This needed to be done after the shard was setup in order to satisfy
the semantic assumptions related to semi-sync in the tests.
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Remove extraneous changes
Signed-off-by: Matt Lord <mattalord@gmail.com>
* We need lz4 for TestXtrabackupStreamWithlz4Compression
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Try using Percona Repo for MySQL 8 to align mysqld and xtrabackup versions
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Specify stream type everywhere
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Remove repeated server install
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Moar...
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Move vtctlbackup test to 8.0
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Rename vtbackup test and move to MySQL 8
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Split the xbstream tests so the workflow doesn't time out
Otherwise it was going over the 10min limit and getting
killed.
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Use MySQL 8 compat method for setting passwords
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Test increasing timeout at another level
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Don't use the init passwords file with 8.0
mysqlctl doesn't start...
This is likely due to the change in initialization behavior with
MySQL 8.0 as it goes though two phases and you can't simply
start up mysqld and pass it data, it has to initialize and restart
first.
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Fix incorrect password update statement for vt_repl user
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Bump timeouts for 8.0 backup tests
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Bump it more :(
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Increase backup/restore timeout in backup_utils
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Apply new 8.0 template everywhere
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Fix bugs around how the compression flags were getting passed
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Use 45m timeout for the workflow, 30m for the run.
Signed-off-by: Matt Lord <mattalord@gmail.com>
* These changes were no longer needed so limiting diff.
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Explicitly skip new linter check
Signed-off-by: Matt Lord <mattalord@gmail.com>
Co-authored-by: Rohit Nayak <rohit@planetscale.com>
* feat: add parsing for bitnums
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: add invalid cases to tests
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: normalize bitnums to bit vals too
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add normalization for bit literals
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: parameterize binary value to hex
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* test: added e2e test in vtgate and vttablet
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* fix: fix the type conversion from hexnum and hexval to binary
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* test: refactor test
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* fix: return varbinary and flaghex for hexval and hexnum in eval engine typeOf
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* test: separate expectation for mysql and vitess result
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* test: fix test expectation
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* feat: added bitnum bind variable and test
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* proto: vtadmin side update
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* test: fixed test and added more bitnum bind var test
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* added license header
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
Co-authored-by: Manan Gupta <manan@planetscale.com>
* Increase timeouts for upgrade_downgrade workflows
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Remove errant addition
Signed-off-by: Matt Lord <mattalord@gmail.com>
* test: fix flakiness in TestFloatValueDefault by adding ordering to the query
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove tabletgateway_cellalias config since it points to a directory which doesn't exist
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove redundant test which tries to run test that doesn't exist
Signed-off-by: Manan Gupta <manan@planetscale.com>
* CI: mysql8 test for schemadiff_vrepl
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
* adapt schemadiff_vrepl test for mysql8
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
* Fix bug where update statements were not converting the timezones if source_timezone was specified
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
* Try moving the conversion test to the migrate/vdiff2 workflow.
Signed-off-by: Matt Lord <mattalord@gmail.com>
Co-authored-by: Matt Lord <mattalord@gmail.com>
* Delete all legacy sharding related code
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Move used until functions from initialsharding to cluster
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Remove vtctl commands
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Kill vtworker and SetKeyspaceServedFrom cmd
Signed-off-by: Matt Lord <mattalord@gmail.com>
* WaitForDrain related stragglers
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Legacy local straggler workflow
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Get rid of SetKeyspaceShardingInfo & wait for drain stragglers
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Remove vtworker stragglers
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Update throttlerservice protobuf
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Rename test 24, add hashicorp vault test to it (now mysql_server_vault)
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Remove last mentiones of legacy sharding in vtctl
Signed-off-by: Matt Lord <mattalord@gmail.com>
* remove binlog_use_v3_resharding_mode
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Address review comments
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Address review comments
Signed-off-by: Matt Lord <mattalord@gmail.com>
* Correct vtgate help output
Signed-off-by: Matt Lord <mattalord@gmail.com>
* feat: use the new RPC for resetting replication
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add code to get the full status and use it
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove uptime from instance propoerties in VTOrc
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: add end to end test for checking the output of ReadInstanceBufferable
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove a mysql query for server id, etc and use full status information instead
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: use primary status output instead of mysql query
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove semi-sync available, since it is unused
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: use semi sync enable from full status instead of mysql query
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: use semi sync statuses from full status instead of mysql query
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: check output of more fields in the test
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: remove ReplicationCredentialsAvailable since it is unused
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: use executed, purged gtid set, server uuid, gtid mode and binlog row image from full status instead of mysql query
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: add testing for replication status fields
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: check for nil values to prevent panics when some fields are empty
Signed-off-by: Manan Gupta <manan@planetscale.com>
* feat: use replication status from full status instead of mysql query
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: add license and shorten package name
Signed-off-by: Manan Gupta <manan@planetscale.com>
* test: added failing e2e test
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* feat: proto changes for vindex_only shard session
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* session to ignore multi-db transaction error if shard session is used only for vindex query
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* test: added additional e2e tests that fails
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* feat: claim a vindex only session if other query uses it
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
* refactor: addressed all review comments
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
Shlomi Noach
Florent Poinsard
Deepthi Sigireddi
Dirkjan Bussink
Harshit Gangal
Rameez Sajwani
vitess-bot[bot]
Rohit Nayak
Manan Gupta
Matt Lord
Andres Taylor