Граф коммитов

279 Коммитов

Автор SHA1 Сообщение Дата
George Hickman fb99e98c4f Bug 1281821 - Split PULSE_DATA_INGESTION_SOURCES into three separate settings 2018-08-07 09:51:40 +01:00
George Hickman 6e7b1efac3 Bug 1281821 - Rename PULSE_URI -> PULSE_URL to match other config vars 2018-08-07 09:51:40 +01:00
George Hickman cc4bfa47f6 Bug 1281821 - Use PULSE_URI instead of PULSE_DATA_INGESTION_CONFIG 2018-08-07 09:51:40 +01:00
George Hickman ca2f8515a3 Bug 1069249 - Explain how to view DB inside a Vagrant VM 2018-08-01 12:30:42 +01:00
Ed Morley eeff0a6fb4 Bug 1466084 - Docs: Convert markup from reST to markdown
Markdown guide for reference:
https://daringfireball.net/projects/markdown/syntax

For the existing Sphinx `.. note::`s, there isn't an exact equivalent
until we switch to mkdocs (which has the `Admonition` extension), so
I've left as reStructuredText and wrapped them with an `eval_rst`
code block for now, rather than switching to HTML. See:
https://recommonmark.readthedocs.io/en/latest/auto_structify.html#embed-restructuredtext
2018-07-30 20:49:01 +02:00
Ed Morley 71c1124784 Bug 1466084 - Docs: Change file extensions from .rst to .md
Renaming as a separate commit since otherwise Git was struggling to
identify the renames, making the diff harder to review.

`index.rst` has been left unchanged, since we still want to use the
`toctree` directive for now.
2018-07-30 20:49:01 +02:00
Ed Morley 33f0464101 Bug 1466084 - Docs: Add Sphinx markdown support
We want to switch from reStructuredText to Markdown, since:
* it's more user-friendly
* it is used in multiple places on GitHub, so people are more familiar
  with it / context switching between the two is annoying
* the disadvantages of markdown typically raised as reasons to prefer
  reST either don't apply to our use-case, or are no longer accurate
  with recent tooling/extensions
* switching means we can also later start using mkdocs (which doesn't
  support reST) instead of Sphinx. That change has been kept separate
  to reduce the size of the PR, and to make the comparison between
  the two more fair.

See:
https://docs.readthedocs.io/en/latest/getting_started.html#in-markdown
https://recommonmark.readthedocs.io/en/latest/index.html
2018-07-30 20:49:01 +02:00
Ed Morley 7f5e7c0643 Bug 1478711 - Docs: Fix SETA typos 2018-07-26 18:24:57 +02:00
Ed Morley bcffd1ce3e Bug 1478711 - Docs: Correct out of date UI testing advice
* The tests can now be run inside the VM.
* There is no longer a coverage report output.
2018-07-26 18:24:57 +02:00
Ed Morley 78c2c57fc9 Bug 1478711 - Docs: Fix navigation links
Previously the mixture of heading types was confusing the RTD theme,
causing the navigation sidebar to display at the top level not just
the page links, but links to subsections within those pages too.
The subsection names taken out of context were pretty confusing,
making it hard to navigate the docs.
2018-07-26 18:24:57 +02:00
Ed Morley 6419d2b61c
Bug 1421327 - Docs: Remove out of date/redundant pages (#3834)
The architecture pages are significantly out of date and so have
been removed until such time as new ones are created (this will be
simpler once Buildbot/REST API support is removed later this year).

In addition, the deployment page duplicated the UI installation page.
2018-07-26 17:43:23 +02:00
George Hickman 1cce79f59b Move docs Makefile up to project root and build docs there 2018-07-23 12:58:04 +01:00
Cameron Dawson 15721f009c
Bug 1450022 - Convert the rest of Details Panel to ReactJS (#3621) 2018-06-13 15:40:38 -07:00
Ed Morley 70e9cdc91d
Bug 1420941 - Docs: Encourage users to run Vagrant provision (#3539)
The `--provision` flag is unnecessary for new instances, since Vagrant
runs `provision` as part of the initial `up` regardless. However by
including `--provision` in the suggested command, it will mean
returning contributors will re-run provision when they re-use the
same steps.

An alternative approach would be to mark the provision block in
`Vagrantfile` as `run: "always"`, however that would slow down the
`vagrant up` of core developers too (by 40s), with no way to opt-out.
2018-05-14 11:04:17 +01:00
Ed Morley 55654a1195
Bug 1363722 - Allow login to work in all development workflows (#3534)
Previously it was not possible to test features that required an
authenticated user when:
* using `yarn start` with Vagrant (bug 1363722), which meant slower
  watch builds
* pointing the UI at the prod/stage API (bug 1317752), which was
  extremely limiting

Now login works in all environments, since the frontend no longer uses a
URL prefix, but instead webpack-dev-server proxies non-webpack URLs to
the chosen `BACKEND_DOMAIN` - avoiding cross-domain issues. Cookies are
rewritten to remove any `secure` directive (which is set on production),
so that they can still be read from HTTP localhost. The `Referer` has to
also be changed to stop Django's CSRF checks from rejecting request.

The slower "build into `dist` and watch" mode is therefore no longer
necessary, so `yarn start:local` instead invokes webpack-dev-server just
like `yarn start` - and the `local-watch.js` workaround has been
removed.

Support for the "publish to GitHub with hardcoded `SERVICE_DOMAIN`"
workflow has been dropped, since it was already rarely used and there is
no way to make it support login.

The API domain environment variable was renamed to `BACKEND_DOMAIN` to
avoid potential confusion given it no longer behaves the same as
`SERVICE_DOMAIN` used to.

NB: For full stack Vagrant workflows users must now connect to port
*5000* on localhost, not 8000.
2018-05-10 17:58:04 +01:00
Cameron Dawson 454cde322d
Bug 1330702 - Improve the Pulse ingestion docs (#3377) 2018-04-03 17:07:07 -07:00
Ed Morley bd870cf8ce
Bug 1441493 - Use rel="noopener" for all target != null links (#3275)
This helps prevent:
https://www.owasp.org/index.php/Reverse_Tabnabbing

We're not also using `noreferrer`, since most browsers now support
`noopener` (https://caniuse.com/#search=noopener) and the link targets
are all Mozilla properties where the referrer may be useful.

The auth.js `window.open()` has not been changed, since the login
callback makes use of `window.opener`.
2018-02-27 19:17:42 +00:00
ionutgoldan bab66d8066 Bug 1428032 - Docs: Grant visibility for new issue_tracker table (#3266) 2018-02-26 11:00:41 +00:00
Ed Morley 0aec43a139
Bug 1357476 - Replace django-rest-swagger with native d-r-f docs (#3230)
Now that django-rest-framework supports interactive docs natively,
we no longer need to use the additional django-rest-swagger package:
http://www.django-rest-framework.org/topics/3.6-announcement/#interactive-api-documentation
http://www.django-rest-framework.org/topics/documenting-your-api/

This significantly reduces the number of static files that have to
be processed, reducing the time taken for `collectstatic` (which is
run on every deployment and takes a while due to Brotli compression)
by 70%.
2018-02-16 10:21:21 +00:00
Jonathan French 7247ea20b7 Bug 1429988 - Minor updates for local pulse ingestion 2018-02-13 09:23:19 -08:00
Ed Morley 0397e82f0e
Bug 1435998 - Fix/enable eslint 'strict' (#3198)
With ES6, the `'use strict'` directives are unnecessary:
https://eslint.org/docs/rules/strict

The directives have been left in the Neutrino configs, since they
are used by node directly, which doesn't yet support ES6 modules.
2018-02-12 16:51:36 +00:00
Ed Morley 9ef378f043
Bug 1433011 - Remove UI for requesting/managing Hawk credentials (#3166)
Since REST API data submission is deprecated in favour of Pulse.
The credentials app now only contains the model and migration.
2018-01-30 23:37:42 +00:00
Ed Morley f74e37f7a9 Bug 1434307 - Docs: Fix `REQUIRE SSL` SQL deprecation warnings
Now that we're using MySQL 5.7, we can specify `REQUIRE SSL` on the
`CREATE USER` statement, rather than having to do so on the individual
GRANTs. Compare:
https://dev.mysql.com/doc/refman/5.6/en/create-user.html
https://dev.mysql.com/doc/refman/5.7/en/create-user.html

Prevents:
```
1 warning(s): 1287 Using GRANT statement to modify existing user's
properties other than privileges is deprecated and will be removed
in future release. Use ALTER USER statement for this operation.
```
2018-01-30 16:49:14 +00:00
Ed Morley 925ea48229 Bug 1434307 - Docs: Update read-only replica GRANTs
Generated using the approach documented at the end of the page:
https://treeherder.readthedocs.io/admin.html#direct-database-access

The changes are required since bug 1373008 added the `group` and
`group_failure_lines` tables and #2532 removed `text_log_summary`
and `text_log_summary_line`.
2018-01-30 16:49:14 +00:00
Ed Morley bc0ca97102
Bug 1419965 - Remove the estimated job time remaining backend (#2990)
The UI has already been removed. This cleans up the data ingestion
and removes the `JobDuration` model, however leaves the `running_eta`
field on the `Job` model for the next time that table is touched (since
the table is large, so altering the schema would likely require
downtime).
2017-12-04 22:09:38 +00:00
Ed Morley 1e2ce7fd23
Bug 1419168 - Add a .gitattributes file to force Linux line endings (#2997)
This prevents `$'\r': command not found` bash errors caused by CRLFs
when Windows hosts have suboptimal global Git configurations, meaning
one less thing that can go wrong / that needs documenting.

See:
https://help.github.com/articles/dealing-with-line-endings/
https://git-scm.com/docs/gitattributes
https://github.com/alexkaratarakis/gitattributes/blob/master/Web.gitattributes
2017-11-28 21:51:59 +00:00
Ed Morley 331a39bff2 Bug 1421241 - Docs: Add livehtml to the Makefile help text 2017-11-28 16:56:45 +00:00
Ed Morley 8b6743456e Bug 1413975 - Docs: Remove redundant configuration from conf.py
Most of the existing config (generated by `sphinx-quickstart`) was
either commented out, identical to the defaults or else for build
modes we do not use - and only end up making the config hard to read.
2017-11-28 16:56:45 +00:00
Ed Morley 644b0d900f Bug 1413975 - Docs: Disable unused Sphinx extensions
This means less to both install and run at build time, hopefully
speeding up the build and reducing the chance of races/locking issues.
2017-11-28 16:56:45 +00:00
Ed Morley f16d33efba Bug 1366043 - Docs: Remove misleading version of 'prototype'
Since otherwise the page titles contain the word 'prototype':
`- Treeherder prototype documentation`
2017-11-28 16:56:45 +00:00
Ed Morley 86e1402369 Bug 1421241 - Docs: Improve error shown when Sphinx not installed 2017-11-28 16:56:45 +00:00
Ed Morley 194e3e3be5 Bug 1421241 - Docs: Improve livehtml mode and recommend it
* Removes the unnecessary initial `make html`, since sphinx-autobuild
performs the initial build itself.
* Enables `--poll` watch mode, since file change detection otherwise
doesn't work in Vagrant.
* Updates the docs to recommend the livereload web server over the
one-off build when working on docs locally.
2017-11-28 16:56:45 +00:00
Ed Morley 607007d7e8 Bug 1421241 - Docs: Reduce nesting of build output directory
Since there is only ever one build type, so the nested directory is
unnecessary and makes it more annoying to find the built assets.
2017-11-28 16:56:45 +00:00
Ed Morley b7e6db1f94 Bug 1421241 - Docs: Remove unused Makefile targets
We don't use any of the other build modes:
http://www.sphinx-doc.org/en/stable/builders.html#builders
2017-11-28 16:56:45 +00:00
Ed Morley c02da51d84 Bug 1420891 - Docs: Fix broken or redirecting links
As found by running `make -C docs linkcheck`.
2017-11-28 16:56:45 +00:00
Ed Morley 7bca4d8e97 Bug 1420891 - Docs: Enable strict & 'nit-picky' mode when building
So that the build fails if there are any warnings:
http://www.sphinx-doc.org/en/stable/invocation.html#invocation-of-sphinx-build
2017-11-28 16:56:45 +00:00
Ed Morley 269bc37aff Bug 1420891 - Docs: Fix strict mode warnings
The build previously contained warnings like:
```
docs/rest_api.rst:144: WARNING: Title underline too short.
docs/admin.rst:18: WARNING: Could not lex literal_block as "sql". Highlighting skipped.
WARNING: html_static_path entry u'.../docs/_static' does not exist
```
2017-11-28 16:56:45 +00:00
Ed Morley f7f38ef4d0
Bug 1257602 - Remove support for revision_hash (#2983)
Now that no submissions are using revision_hash, it can be removed.
This removes everything but the model field, which will be handled
later.

I've removed revision_hash from the Pulse jobs schema without bumping
the version, which wouldn't normally be ok, but no one is still using
it, and I'd rather have explicit failures later than if we left the
schema unchanged.
2017-11-28 00:09:17 +00:00
Ed Morley 626edb59ad
Bug 1419167 - Vagrant: Remove unnecessary MSYS SSH pre-requisite (#2966)
Since recent Vagrant now bundles its own SSH client.
2017-11-20 22:54:18 +00:00
Ed Morley 3f5ef6b352 Bug 1418956 - Set yarn's no-bin-links option via .yarnrc
To save having to pass it each time when using `yarn {install,add}`.
2017-11-20 18:59:26 +00:00
Ed Morley 5d1b99fa79 Bug 1416257 - Docs: Clarify which node/yarn version should be used
Since for people installing node/yarn on their own (outside the
Vagrant environment) it can be confusing to work out which version is
appropriate, given node always has both an LTS and current release.
2017-11-20 18:59:26 +00:00
Ed Morley b472a63176 Bug 1416257 - Docs: Remove unnecessary `yarn install` steps
The vagrant provision runs `yarn install`, so it isn't necessary to
do so again before running `yarn start`.
2017-11-20 18:59:26 +00:00
Dave Hunt 1319f57c55
Rename py.test to pytest #dropthedot 2017-11-09 12:55:25 +00:00
Dave Hunt 9fd3c72241
Bug 1340305 - Allow Selenium tests to be run locally 2017-11-09 12:55:25 +00:00
Jonathan French f0940ec37d Bug 1410230 - Tweak the pinboard testcase wording (#2857) 2017-10-19 22:55:29 +02:00
Kiki 070a94d16b Bug 1407367 - Update doc that ui unit tests are not to be run within a VM 2017-10-13 09:43:40 -07:00
Cameron Dawson a250d1dcb6 Bug 1400069 - Replace term coalesced with superseded in most places
Except where it has to touch the database field, since that will be
vestigial in a later commit and removed in a alter PR.
2017-09-29 17:18:42 -07:00
Cameron Dawson 863f772a8b Bug 1387640 - Remove Exclusion Profiles models/tables
Removes all the models and tables for the ExclusionProfile and
JobExclusion models and related.
2017-09-18 09:28:22 -07:00
Cameron Dawson bde8e20f1f Bug 1387640 - Stop using exclusion profiles
Note: This leaves the models and tables intact so that we can
revert without data loss in case we discover an issue.  A follow-up
commit will remove those tables and models.
2017-09-13 09:05:25 -07:00
Cameron Dawson 83c94d9cae Bug 1398386 - Remove exclusion editor admin panel 2017-09-12 12:25:29 -07:00