Граф коммитов

756 Коммитов

Автор SHA1 Сообщение Дата
Harshit Gangal 1fea7f95d1 fix panic for unrelated tests
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-06-28 19:08:06 +05:30
Harshit Gangal 6f9b870779 rewrite delete query with table reference for single table
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-06-28 16:05:45 +05:30
Andres Taylor 0832a33a19 Merge remote-tracking branch 'upstream/main' into expandStar
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-06-20 16:51:24 +02:00
Harshit Gangal 0f520d5e0a add expanded colnames to semTable, error out when aliased star expr table is not found
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-06-17 16:16:35 +05:30
Shlomi Noach 21b59edca6 working.
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
2021-06-13 17:24:44 +03:00
Shlomi Noach 913a0904a6 merge main, resolve conflict
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
2021-06-13 12:21:28 +03:00
Shlomi Noach f7962766e1 experiment: support online ddl convert from latin1 to utf8
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
2021-06-10 11:10:07 +03:00
GuptaManan100 4213c52322 fixed error messages and reorganized tests wrt schema tracker
Signed-off-by: GuptaManan100 <manan@planetscale.com>
2021-06-10 13:39:16 +05:30
Andres Taylor 18dbd43b77
Merge pull request #8243 from planetscale/st-2
Schema Tracking: Optimize and Bug Fix
2021-06-08 16:30:40 +02:00
Deepthi Sigireddi 34394a2e17
Merge pull request #8251 from planetscale/ds-master-to-primary1
naming: master to primary
2021-06-07 16:32:27 -07:00
deepthi e4703df9be naming: fix comments, more internal variables and funcs
Signed-off-by: deepthi <deepthi@planetscale.com>
2021-06-07 10:36:25 -07:00
Harshit Gangal 97e34650cd use tableschemachanges from the stats sent from tablet to vtgate
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-06-07 17:58:46 +05:30
Rohit Nayak 52004e01b9
Merge pull request #8187 from planetscale/rn-json-data-panic
Binlog JSON Parser: handle inline types correctly for large documents
2021-06-03 21:04:19 +02:00
deepthi e9c7c0df33 naming: rename funcs on mysqld, add new funcs on tabletmanager and deprecate old funcs
Signed-off-by: deepthi <deepthi@planetscale.com>
2021-06-02 23:00:33 -07:00
Rohit Nayak 25e6d58a7f
Update comments
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
2021-06-02 14:11:27 +02:00
Andres Taylor 02dfc252fd
Merge pull request #8217 from planetscale/raw-conn
Expose inner net.Conn to be able to write better unit tests
2021-06-02 07:53:39 +02:00
Harshit Gangal f4b9d275b5 return raw connection net.Conn
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-05-31 19:48:14 +05:30
Andres Taylor d2e84298aa Merge remote-tracking branch 'upstream/master' into schema-tracking-vtgate
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-05-31 14:38:18 +02:00
Florent Poinsard 8033dd1c5b
Addition of dedicated signal schema change reload time flag in vttablet
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
2021-05-28 10:32:40 +02:00
Rohit Nayak 225df50500
Fix bug wrt inline types and large documents. Refactor code. More extensive comments. Add test for reported failure mode and improve other tests
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
2021-05-27 14:51:16 +02:00
GuptaManan100 ff35995626 added fuzzer test case for handleNextCommand
Signed-off-by: GuptaManan100 <manan@planetscale.com>
Co-authored-by: Andres Taylor <andres@planetscale.com>
2021-05-27 14:58:42 +05:30
Andres Taylor 3c11a1cd7b clear and reload the schemacopy whenever a tablet becomes master
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-05-27 07:48:07 +02:00
Florent Poinsard 09481f2880
Addition of a LoadKeyspace method to the schema tracker
Co-authored-by: Andres Taylor <andres@planetscale.com>
Signed-off-by: Florent Poinsard <florent.poinsard@outlook.fr>
2021-05-25 17:52:14 +02:00
Rohit Nayak ddda433ca2
Add defensive guards to avoid panic in json parsing logic and log more detail in binlog parsing to identify errant data
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
2021-05-25 14:36:55 +02:00
Andres Taylor fc48db7ec4 added schema fetch query
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-05-24 10:17:52 +05:30
Andres Taylor 17dd07f081 test that fetch is done
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-05-24 10:17:52 +05:30
Vicent Marti e9935049a6 protobuf: upgrade
Signed-off-by: Vicent Marti <vmg@strn.cat>
2021-05-19 11:13:59 +02:00
Andres Taylor d8aa87a25e dont read over the limits
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-05-12 14:57:21 +02:00
GuptaManan100 8a4b7a6348 ported fuzzer test to use files and added a new fuzzer test
Signed-off-by: GuptaManan100 <manan@planetscale.com>
2021-05-12 14:48:29 +05:30
GuptaManan100 d4b2325b98 caught error where the length of data is zero in the header
Signed-off-by: GuptaManan100 <manan@planetscale.com>
2021-05-12 14:17:13 +05:30
GuptaManan100 6dba84da59 fix server connection in mysql fuzzer
Signed-off-by: GuptaManan100 <manan@planetscale.com>
2021-05-12 14:04:21 +05:30
Andres Taylor 282b226986 how to update the schemacopy with minimal changes to it
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-05-07 10:59:52 +02:00
Andres Taylor 28cf98b928
Merge pull request #8005 from planetscale/schema-fetch
Detect and signal schema changes on vttablets
2021-05-07 10:03:05 +02:00
Andres Taylor d34acd8c32 make sure to create the database for the schemacopy
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-05-05 08:34:00 +02:00
Rohit Nayak 91357c62a4
Pad binary() values in the binlog reader directly so that all consumers see the padded value instead of doing it later in vstreamer or doint it just for keyspace id computation
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
2021-05-03 23:15:51 +02:00
Harshit Gangal d3fda2a1d0 send table names in health stream for changed schema
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-04-30 19:53:11 +05:30
Harshit Gangal 9e1ff351b8 added schema change detection and schema copy to health streamer
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-04-30 19:01:01 +05:30
Andres Taylor 722832042b add queries and tests for detecting schema changes
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-04-30 11:19:23 +02:00
Vicent Marti e7bf329da0 mysql: allow reusing row storage when reading from a stream
Signed-off-by: Vicent Marti <vmg@strn.cat>
2021-04-26 16:31:06 +02:00
Vicent Marti e0b90daebe conn: do not let header escape to the heap
The 4-byte hader slice which we pass to ReadAll is actually being
allocated on the heap because the compiler can't tell through the
io.Reader interface that the slice doesn't escape.

If we move it to our Conn struct, it'll stop being allocated once for
each read. This is a meaningful performance improvement!

Signed-off-by: Vicent Marti <vmg@strn.cat>
2021-04-26 12:30:34 +02:00
AdamKorcz 8ef0b4acf0 Small fixes
Signed-off-by: AdamKorcz <adam@adalogics.com>
2021-04-20 22:52:27 +01:00
Vicent Marti a23c0dd65f sqlparser: do not keep colons in arguments
Signed-off-by: Vicent Marti <vmg@strn.cat>
2021-04-15 10:49:55 +02:00
Harshit Gangal 12230ac76a add some guard rails around listener go routine
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-04-13 12:50:43 +05:30
Andres Taylor 4dc924b978 undo change of error type
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-04-12 14:08:18 +02:00
Andres Taylor 8fb43946d0 Make NewSQLErrorFromError return a struct type and not an interface
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-04-12 10:30:44 +02:00
Andres Taylor 8d4f1600ee use vterror and not mysql.Error
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-04-12 10:30:44 +02:00
GuptaManan100 33980001da improved error messages in tabletserver
Signed-off-by: GuptaManan100 <manan@planetscale.com>
2021-04-12 10:30:44 +02:00
Andres Taylor 17687523b5 Merge remote-tracking branch 'upstream/master' into gen4-thing
Signed-off-by: Andres Taylor <andres@planetscale.com>
2021-04-10 12:19:59 +02:00
Harshit Gangal 7be8932fe6 added table information using vschema in analyzer phase
Signed-off-by: Harshit Gangal <harshit@planetscale.com>
2021-04-09 15:15:15 +05:30
Vicent Marti 91d9627d1f mysql: do not copy streaming packets
The packets from a MySQL conn stream are fully owned by the caller so
they don't need to copied when parsed into rows.

Signed-off-by: Vicent Marti <vmg@strn.cat>
2021-04-07 12:07:49 +02:00