Граф коммитов

129 Коммитов

Автор SHA1 Сообщение Дата
Cameron Dawson 358e90f685 Bug 1080760 - Auto-generate bug suggestions asynchronously
This introduces two new ways to generate ``Bug suggestions`` artifacts from
a ``text_log_summary`` artifact
1. POST a ``text_log_summary`` on the ``/artifact`` endpoint
2. POST a ``text_log_summary`` with a job on the ``/jobs`` endpoint.

Both of these cases will schedule an asynchronous task to generate the
``Bug suggestions`` artifact with ``celery``.

Artifact generation scenarios:

JobCollections
^^^^^^^^^^^^^^
Via the ``/jobs`` endpoint:

1. Submit a Log URL with no ``parse_status`` or ``parse_status`` set to "pending"
    * This will generate ``text_log_summary`` and ``Bug suggestions`` artifacts
    * Current *Buildbot* workflow

2. Submit a Log URL with ``parse_status`` set to "parsed" and a ``text_log_summary`` artifact
    * Will generate a ``Bug suggestions`` artifact only
    * Desired future state of *Task Cluster*

3. Submit a Log URL with ``parse_status`` of "parsed", with ``text_log_summary`` and ``Bug suggestions`` artifacts
    * Will generate nothing

ArtifactCollections
^^^^^^^^^^^^^^^^^^^
Via the ``/artifact`` endpoint:

1. Submit a ``text_log_summary`` artifact
    * Will generate a ``Bug suggestions`` artifact if it does not already exist for that job.

2. Submit ``text_log_summary`` and ``Bug suggestions`` artifacts
    * Will generate nothing
    * This is *Treeherder's* current internal log parser workflow
2015-05-20 16:28:32 -07:00
Ed Morley 8507928699 Bug 1166426 - Update readthedocs links to point at the new RTD location
The docs have been moved from treeherder-service.readthedocs.org to
treeherder.readthedocs.org.
2015-05-20 22:06:33 +01:00
Ed Morley 2efb703f16 Bug 1056877 - Update UI path references after directory moves
As part of merging the UI repo into this one, the following directory
moves were performed:
  webapp/app/                   ->  ui/
  webapp/test/                  ->  tests/ui/
  webapp/config/                ->  tests/ui/config/
  webapp/scripts/               ->  tests/ui/scripts/
  webapp/scripts/web-server.js  ->  web-server.js
2015-05-20 16:55:55 +01:00
Ed Morley da294ba761 Bug 1056877 - Stop using/referring to the separate treeherder-ui repo
Since it has now been merged into this one.
2015-05-20 16:55:55 +01:00
Ed Morley de9b1cff02 Bug 1056877 - Add the UI docs pages to the main table of contents
The UI docs are now being built at the same time as the main service
docs. Until we combine them, let's at least make sure the UI parts are
still discoverable, by adding them to the main table of contents.
2015-05-20 16:55:49 +01:00
Ed Morley b4c7023ccc Bug 1056877 - Remove superfluous docs/ui/ Sphinx build files
Since the UI docs will be built by the docs directory Makefile/conf.py.
2015-05-20 12:34:25 +01:00
Ed Morley 347592a10e Merge treeherder-ui into this repo 2015-05-20 12:03:05 +01:00
William Lachance dc084310f6 Bug 1163674 - Update treeherder client to be more generic
* Create a generic TreeherderClient class
* Add a single method called `post_collection` which takes care of all
  details of validation, submitting stuff and raising errors
* Also add a new update_parse_status method, for updating status (replaces
  manual calls to post information on raw TreeherderRequest)
2015-05-19 17:32:22 -04:00
Ed Morley 90e3aa0dea Bug 1165925 - web-server.js should serve index.html at the site root 2015-05-19 15:50:30 +01:00
Mauro Doglio b23775c37c Update list_of_services.rst 2015-05-18 10:24:35 +01:00
Jonathan French 19b71bc4b4 Bug 1164881 - Add MPL2.0 headers to recent treeherder repo files 2015-05-14 11:45:26 -04:00
Jonathan French e471253de4 Bug 1056049 - Add NFS transport protocol troubleshooting to RTD 2015-05-12 15:08:25 -04:00
Ed Morley 6deb641608 Bug 1163591 - run_sql: support specifying the SQL statement via the CLI
Previously the run_sql manage.py command only supported reading the SQL
command from a specified file. It can now also be provided via the CLI.
2015-05-11 16:45:47 +01:00
William Lachance 0e6e61fbbe Bug 1159831 - Make treeherder use in-tree copy of treeherder-client 2015-05-01 13:34:29 -04:00
Jonathan French 0ac651cc69 Bug 1159236 - Add a timeout troubleshooting section to RTD 2015-04-28 16:23:17 -04:00
Jonathan French 2d9629f3ca Bug 1159288 - Add clarity to RTD for vagrant ssh access 2015-04-28 14:20:43 -04:00
Jonathan French bac9e98b35 Bug 1155868 - Update RTD that single ingestion is limited to builds4hr 2015-04-22 14:28:33 -04:00
Jonathan French 02033761cc Bug 1156420 - Update vagrant troubleshooting during installation 2015-04-21 10:55:53 -04:00
Ed Morley 8478629ef4 Bug 1056877 - Update links & puppet/Vagrant config for new repo name
The 'treeherder-service' repo has been renamed to 'treeherder', ready
for when the treeherder-ui repo is imported into it. This means the
Github URL, Travis URL and directory name when cloned changes. The Read
The Docs URL cannot be changed, so for now we will leave as-is, and in
the future (once service and UI docs combined) we will create a new
project on RTD with name "treeherder".

This updates doc links and puppet/Vagrant configs, but leaves the
stage/prod deploy script alone, since renaming the directories on our
infra is non-trivial. The dev instance will need some TLC since unlike
stage/prod, it does use the puppet scripts in the repo.
2015-04-20 22:00:04 +01:00
Ed Morley e8ad64842d Bug 1140850 - Remove gevent celery worker script from the repo
Since it's unused & we're moving away from gevent.
2015-04-13 17:12:44 +01:00
William Lachance 56b3351198 Update grunt steps 2015-03-27 11:15:55 -04:00
Jonathan French d10b7a8f8d Bug 1137164 - Add a shebang to setup.py 2015-03-17 11:51:45 -04:00
Ed Morley 34419d9f35 Bug 1139894 - Docs: Add instructions for how to run flake8 2015-03-16 12:16:18 +00:00
Ed Morley 213eb3a6a3 Bug 1139894 - Docs: Move the "Running the tests" section to common tasks
At some point in the future, we may break the "Running the tests"
section out to its own file, but for now "Common Tasks" seems like a
better home than the installation instructions.
2015-03-16 12:16:17 +00:00
Ed Morley e1631abac8 Bug 1076710 - Remove socketio remnants
We're not currently using socketio - and if we start doing so in the
future we'll likely want to update to a newer version/adjust the
implementation anyway. Removing the dependencies from common.txt speeds
up the pip install on Travis. The old files will still be in version
control should we wish to refer to them :-)
2015-03-13 14:28:08 +00:00
William Lachance 62c9867072 Bug 1142242 - Better help output and docs for run_sql management command 2015-03-12 14:03:24 -04:00
Ed Morley 8718ccc5fd Bug 1059814 - Manual whitespace fixes for pep8 2015-03-03 02:34:38 +00:00
Jonathan French 76c4d64458 Bug 1135117 - Minor tweaks to readthedocs vagrant setup for clarity 2015-02-20 12:04:36 -05:00
Ed Morley d2f06b4e31 Bug 1060312 - Docs: Clean up the treeherder-ui installation instructions 2015-02-18 18:46:24 +00:00
deshraj ee7b795ff0 Bug 1134199: add instructions for installing nfs 2015-02-18 20:24:37 +05:30
Ed Morley f5c0b53e0c Bug 1059814 - Whitespace pep8 fixes
Generated using:
autopep8 --in-place --recursive .

Before:
$ pep8 | wc -l
1686

After:
$ pep8 | wc -l
57

A later autopep8 run will be performed using --aggressive, which makes
non-whitespace changes too.
2015-02-15 14:52:31 +00:00
Ed Morley fc88dcf73d Bug 1125530 - Remove the TREEHERDER_DATABASE_PORT pref
We only pass it in some cases, so setting it to anything other than the
default will break all the places where we don't use it. Django doesn't
require it is set, since it will fall back to the default port for that
engine type anyway.
2015-02-14 21:38:26 +00:00
Ed Morley 766c256c56 Bug 1091750 - Docs: Use correct inline code markup 2015-02-05 01:45:40 +00:00
Ed Morley da6518dd33 Bug 1091750 - Docs: Provide more py.test examples & list useful options 2015-02-05 01:40:40 +00:00
Ed Morley a42a7d09ef Bug 1088216 - docs: make the installation instructions easier to follow
* Separates out the steps required for running the tests, from those for
  setting up a local instance.
* The running ingestion tasks step now explains what they are, that the
  API server must be running already, and how to ingest just a single
  revision for testing.
* The log parser compile step is moved inline, so it's harder to forget.
2015-01-29 14:32:50 +00:00
mdoglio 18bf5bf5fd Bug 1112554 - set thServiceDomain to current host 2014-12-17 16:41:40 +00:00
Jonathan French dbb4d11e09 Bug 1090689 - Add MPL2.0 headers to the repo 2014-11-03 13:06:03 -05:00
Jonathan French c93f507e81 Bug 1090689 - Add MPL2.0 headers to the repo 2014-10-31 14:31:25 -04:00
Ed Morley 3b1a374149 Bug 1088556 - Use correct code-block lexer alias to fix Sphinx warning
This fixes:
docs/deployment.rst:: WARNING: Pygments lexer name u'INI' is not known
2014-10-24 09:36:05 +01:00
mdoglio d60b5ce3cf Bug 1087913 - Update celery instructions on RTD after bug 1016117 2014-10-24 08:39:05 +01:00
Jonathan French 4bb25b38ce Bug 1085455 - Update the docs Title to be consistent with treeherder-ui 2014-10-20 13:00:54 -04:00
AutomatedTester 0ebe134730 Bug 1064498: Update installation document to have subtitles for easier reading 2014-09-08 21:18:09 +01:00
Ed Morley 7a9a1c7010 Bug 1058676 - docs: Remove dependency on unused sphinxcontrib-httpdomain 2014-08-27 12:33:02 +01:00
Ed Morley 0b87b9e55b Bug 1032907 - Update to a newer version of Sphinx, to match treeherder-service 2014-08-26 17:18:30 +01:00
Ed Morley 6b6ee9c5e6 Bug 1058600 - Update sphinx build using output from newer sphinx-quickstart; r=mdoglio 2014-08-26 15:06:02 +01:00
Ed Morley 94c0d9aeb7 Bug 1058600 - Update sphinx build using output from newer sphinx-quickstart; r=mdoglio 2014-08-26 14:57:39 +01:00
Ed Morley ecfe1f6d25 Bug 1045090 - Fix docs to reflect dependency on ui repo in default configuration; r=mdoglio 2014-08-21 16:00:04 +01:00
Ed Morley 6113e32668 Bug 1056830 - docs: Link to Vagrant homepage rather than legacy downloads page 2014-08-21 15:07:31 +01:00
Cameron Dawson 910f3b8e29 use ``cacheResponseAndETAG`` instead of just cache 2014-08-11 11:58:21 -07:00
Mauro Doglio 1c23e0a0cf Update list_of_services.rst 2014-05-15 16:03:25 +02:00
Jonathan Eads 69e7dfaed5 added build instructions 2014-04-25 09:04:06 -07:00
Jonathan Eads 3e46386d05 fixed docs 2014-04-24 18:49:09 -07:00
Jonathan Eads c979d1f19e fixed docs 2014-04-24 18:44:53 -07:00
Jonathan Eads faa00f99cd fixed docs 2014-04-24 18:42:31 -07:00
Jonathan Eads 55e9eb466b fixed docs 2014-04-24 18:39:22 -07:00
Jonathan Eads bbedf98720 updated docs 2014-04-24 18:34:08 -07:00
Mauro Doglio 2eee2613a7 Update deployment.rst 2014-04-19 00:23:38 +01:00
Jonathan Eads 79fecd48be fixed indent 2014-04-18 16:08:50 -07:00
Mauro Doglio 495ebffdc3 Update troubleshooting.rst 2014-03-05 19:26:54 +01:00
mdoglio 5d31e638ef add more docs for common tasks and troubleshooting 2014-03-05 16:05:18 +01:00
mdoglio 5c1978bb90 add docs page for services architecture and troubleshooting 2014-03-04 19:23:03 +01:00
mdoglio 278e5b02af add ui integration to Vagrantifile and docs 2014-02-20 14:50:43 +01:00
Jonathan Eads d8f3ae575f added oauth credential export to installation docs 2014-01-31 18:28:32 -08:00
Jonathan Eads 50b67b86e4 updated manage.py commands 2014-01-10 13:31:08 -08:00
mdoglio 320bdd3be6 add some docuentation for deployment and fix a few bugs in the vagrant
setup
2014-01-07 16:44:24 +00:00
Mauro Doglio 0eda7ea205 Update installation.rst
Adds a couple of installation steps to:
init datasources
modify /etc/hosts
build the c extensions
2013-12-17 14:05:58 +00:00
mdoglio b9eb464176 improve usability of the vagrant dev environment 2013-11-29 13:15:12 +00:00
Cameron Dawson eac294da77 add filter for ``exclude_empty`` for result set list 2013-10-02 15:24:44 -07:00
Cameron Dawson 39ab0d78a7 requirements for building docs 2013-09-18 11:08:18 -07:00
Cameron Dawson 1fce94b343 Plugin architecture working and documented 2013-09-17 14:55:44 -07:00
mdoglio 2d8ca8f6a6 fix bad english in docs 2013-07-25 18:28:11 +01:00
mdoglio 781152195d fix typos in the documentation 2013-07-25 18:10:39 +01:00
mdoglio a3fbd7b405 add some documentation to setup periodic tasks 2013-07-24 15:15:50 +01:00
Ed Morley 44992b68b5 Fix formatting on installation instructions page 2013-07-17 18:38:13 +01:00
Ed Morley 3cab503e2d Bring installation instructions up to date 2013-07-09 17:35:19 +01:00
mdoglio bad6a30d25 fix conflict in docs 2013-07-01 14:56:05 +02:00
Ed Morley 1463651e46 Document the use of django runserver 2013-06-29 14:36:53 +01:00
mdoglio 1f7002df4f add (short) documentation on celery worker 2013-05-13 20:07:24 +02:00
mdoglio fe1c449459 add sphinx docs setup 2013-03-12 13:17:52 +00:00