Граф коммитов

10321 Коммитов

Автор SHA1 Сообщение Дата
Joshua Thompson 3fd751467f Move sharding_utils.py to py/vttest 2016-08-09 11:02:46 -07:00
Joshua Thompson 326d401aa6 Move start_vtcombo logic into run_local_database.py. Revert change to vttest_sample_test 2016-08-08 22:35:53 -07:00
thompsonja 3560ab39ca Merge pull request #1911 from thompsonja/vtcombo
Extend vtcombo to add more customization.
2016-08-05 11:39:48 -07:00
Joshua Thompson fc1ff80d1f Extend vtcombo. Addressed review comments. 2016-08-05 11:04:29 -07:00
Michael Berlin 63a31d8597 Merge pull request #1894 from pkulsh/web-HeatmapComponent
web: heatmap component
2016-08-04 16:05:48 -07:00
Michael Berlin 19752f7fd4 Merge pull request #1916 from dsslater/new_ignore
New gitignore to ignore bower components
2016-08-04 16:02:59 -07:00
David Slater 52be2574dc New gitignore to ignore bower components 2016-08-04 16:01:17 -07:00
Priyanka Kulshreshtha d754897771 Removed extra spaces in html 2016-08-04 15:50:29 -07:00
Alain Jobart a34095b3d5 Merge pull request #1915 from alainjobart/gce
Switching to new version of google API.
2016-08-04 15:44:51 -07:00
Priyanka Kulshreshtha c26739a1e5 Changed html table css 2016-08-04 15:34:47 -07:00
Alain Jobart 79cc4c0093 New version of google oauth2 library.
To remove old dependency.
2016-08-04 14:42:43 -07:00
Alain Jobart 51622658be Switching to new version of google API. 2016-08-04 13:54:43 -07:00
Priyanka Kulshreshtha 22644f6fe2 Fixed spacing in html files. 2016-08-04 00:02:41 -07:00
Priyanka Kulshreshtha 784c5dcb16 Addressed style comments by mberlin 2016-08-04 00:01:24 -07:00
Michael Berlin 3dbfb79b42 Merge pull request #1912 from michael-berlin/fix_linter_warning
throttler: Move testing only code to *_test.go file.
2016-08-03 22:34:09 -07:00
Michael Berlin ce9f9075d2 throttler: Move testing only code to *_test.go file. 2016-08-03 17:07:44 -07:00
Alain Jobart e3fba67c52 Merge pull request #1910 from alainjobart/gw
Tightening a bunch of lose ends in gateway.
2016-08-03 16:21:07 -07:00
Alain Jobart b8d63f51c9 Fixing comments. 2016-08-03 16:02:54 -07:00
Alain Jobart 36210dfb8c Re-generating vtctl doc. 2016-08-03 15:13:45 -07:00
Alain Jobart 1980995967 Addressing review comments. 2016-08-03 15:13:11 -07:00
Joshua Thompson b9246e486f Extend vtcombo to allow setting rdonly/replica counts, cells. Update test scripts 2016-08-03 14:42:23 -07:00
Priyanka Kulshreshtha 8f358937de Addressed comments from mberlin 2016-08-03 13:25:08 -07:00
Alain Jobart 3123a1bd6d Optimizing StatsUpdate in tablet_stats_cache.
When an update is trivial, we don't recompute the healthy servers.
This should actually happen most of the time.
2016-08-03 09:57:57 -07:00
Alain Jobart 67c9feba47 Fixing a comment. 2016-08-03 09:38:39 -07:00
Alain Jobart 5781dbad96 Splitting gateway Creator and WaitForTablets.
And adding a command line parameter to set the initial wait timeout.
This is common code, no need for Creator to call Wait, as they are split
in tests anyway.
2016-08-03 09:31:05 -07:00
Alain Jobart c79f5ac834 Using two layers of RWMutex in cache.
The top-level one protects the map, and the per-entry one protects the
individual entries. Differences in steady state:
- a StatsUpdate used to take the toplevel lock RW, now it takes it RO.
  It then takes the entry lock RW.
- a Get{Healthy}TabletStats now takes two RO locks.

So it's a bit more locking in RO mode (which should be fine), but the
big change is the much smaller contention on StatsUpdate: previously, a
single StatsUpdate would lock out all Get calls. Now it only locks out
Get calls on the entry.
2016-08-03 08:25:47 -07:00
Alain Jobart 8d727ebcab Adding Key as a member of TabletStats.
This way there is no need to recompute it multiple times on the query
serving path, and in a few other places. Since it is somewhat expensive
to compute (creates an array of strings with few strings in it, then
joins them), it is a win.
2016-08-03 08:02:11 -07:00
Alain Jobart 00ba62d961 Fixing this test to Fatal early.
Better to t.Fatal than keep going and panic.
2016-08-03 08:01:44 -07:00
Alain Jobart 5924212d99 Fixing WaitForDrain initial timeout.
It needs to be a different parameter than the healthcheck timeout, at
least for tests, otherwise they have a race condition. It's not a bad
idea for this to be configurable anyway.
2016-08-03 07:25:45 -07:00
Alain Jobart 6c0b13b900 Merge pull request #1907 from alainjobart/gateway
Various Healthcheck and discovery / gateway improvements.
2016-08-03 06:48:17 -07:00
Alain Jobart 89965f2f60 Merge pull request #1908 from alainjobart/l2
l2vtgate gateway: re-using connections.
2016-08-02 15:54:37 -07:00
Alain Jobart 0f7ffa3d17 Addressing most review comments. 2016-08-02 15:47:31 -07:00
Alain Jobart ed3fbd91f4 Addressing review comments. 2016-08-02 14:56:14 -07:00
Alain Jobart a79ed59a55 l2vtgate gateway: re-using connections.
The command line parameters may redirect more than one keyspace/shard
pair to a single backend. In that case, re-use the TabletConn.
2016-08-02 13:31:44 -07:00
Priyanka Kulshreshtha ca2ff42133 Addressed comments from mberlin and finished statusComponent. 2016-08-02 11:01:32 -07:00
Alain Jobart b57b2a47aa Fixing resharding tests.
It turns out the resharding code cannot use the pre-computed lists of
healthy tablets, as when the tablets are not serving, they are not
healthy. And we turn Serving off for tablets that should not be serving
during resharding.

Removing GetCurrentMaster method, and fixing RemoveUnhealthyServers to
work, and using it.
2016-08-01 18:01:28 -07:00
Alain Jobart 34dee64b34 Fixing healthcheck.go docs. 2016-08-01 14:59:36 -07:00
Alain Jobart ea0aa690b8 Removing HealthCheck's extra tablet index.
Now that the knowledge is in TabletStatsCache, HealthCheck doesn't need
it any more.
2016-08-01 14:42:03 -07:00
Alain Jobart 6fc21a7b13 Making the wait calls methods of TabletStatsCache. 2016-08-01 14:27:41 -07:00
Alain Jobart 14e1fc0829 Simplifying healthcechk_wait code.
Just using the usual context.Err() values, instead of new ones.
2016-08-01 14:21:06 -07:00
Alain Jobart 04e99c4d09 Moving 'wait for tablets' functionality.
It was on the healthcheck, it should be on the TabletStatsCache, or on
the gateway.
2016-08-01 13:28:07 -07:00
Alain Jobart 1da7d6c252 Removing remaing worker's GetTabletStatsFromTarget. 2016-08-01 09:24:29 -07:00
Alain Jobart 789aaf3fbf Fixing wait_for_drain_test.go. 2016-08-01 09:08:25 -07:00
Alain Jobart 27fbd1ae04 Using TabletStatsCache in worker. 2016-08-01 08:03:02 -07:00
Alain Jobart 2f267fe6ac Using TabletStatsCache in wrangler.waitForDrain. 2016-08-01 07:48:16 -07:00
Alain Jobart 8e594a60da Using TabletStatsCache in binlog player. 2016-08-01 07:42:07 -07:00
Alain Jobart 909621a3d0 And adding the files. 2016-08-01 07:13:44 -07:00
Alain Jobart 9a98b34a4b Addressing review comments.
Main change is the name change and new file for TabletStatsCache, the
class formely known as HealthyStatsListener.
2016-08-01 07:12:32 -07:00
Alain Jobart 18ea44b51b Merge pull request #1906 from alainjobart/execute
Making the use of a pool optional for ExecuteFetch
2016-08-01 06:57:22 -07:00
Alain Jobart 5beb4caa10 Now using the new HealthyStatsListener in gateway.
That way discovery gateway doesn't need to compute the healthy tablets
every time for every query, it's just there.

Since the Listener order now matters, re-ordered a bunch of unit tests
in vtgate to AddtestTablet only after listener is set.
2016-07-29 18:19:16 -07:00