Граф коммитов

6128 Коммитов

Автор SHA1 Сообщение Дата
William Lachance b2098db6ad Bug 1309294 - Fixes to signature calculation for remove signatures script (#1924) 2016-10-14 13:36:15 -04:00
Ed Morley 12389d02c7 Bug 1310016 - Persist DB connections for 5 mins to improve performance
By default Django doesn't perform any connection pooling, so closes the
DB connection after each request:
https://docs.djangoproject.com/en/1.10/ref/settings/#conn-max-age

Reconnecting takes 20-40ms on production (due to use of TLS), which is
avoided with this change.
2016-10-14 18:16:50 +01:00
Ed Morley 36d11bfe0b Bug 1310016 - Remove read_only DB config
Since we no longer have a master-slave setup, and in all environments
DATABASE_URL is identical to DATABASE_RO_URL.
2016-10-14 18:16:50 +01:00
Ed Morley 2eb265d877 Bug 1288369 - Use TLS when connecting to RDS from Vagrant
Previously if someone set `DATABASE_URL` in their Vagrant environment
to a remote RDS instance, TLS wouldn't have been used. Now, using TLS
depends not on the `IS_HEROKU` environment variable (which we should
stop using anyway, since it goes against the 12-factor methodology), but
the DB hostname itself.

The CA bundle path has been made relative, to allow it to work inside
Vagrant as well as on Heroku.
2016-10-14 18:16:50 +01:00
Ed Morley 980343742c Bug 1310053 - Don't retry tasks on ValueError
Since retries are not going to succeed either.
2016-10-14 17:17:47 +01:00
Kris Rivera 88766c37ab Bug 1157149 - added a secondary count indicating the number of filtered unclassified failures (#1908) 2016-10-13 16:54:56 -07:00
Kris Rivera ddd5512c11 Bug 1234648 - added a new button to toggle duplicate jobs being shown inside of groups (#1918) 2016-10-13 16:46:41 -07:00
William Lachance 0e0375c001 Bug 1309294 - Fix age parameter to cleanup script 2016-10-13 15:00:21 -04:00
William Lachance ee29f26efa Bug 1309294 - Don't use subtests in perf signature calculation (#1915) 2016-10-13 12:31:12 -04:00
Kris Rivera 508c9b5931 Add the .vscode directory to .gitignore (#1921)
https://code.visualstudio.com/Docs/customization/userandworkspace#_settings-file-locations
2016-10-13 12:49:41 +01:00
jgraham 07f55e8085 Bug 1309511 - Add a per-job text_log_error api endpoint (#1917)
This includes all the bug suggestions and is therefore possible to
use directly for classification ui.
2016-10-12 19:31:07 +01:00
William Lachance 7e54cc25be Bug 1309521 - Don't cache empty bug suggestion lists (#1919)
It might be that they'll be updated later
2016-10-12 09:32:59 -04:00
Jonathan French 94b44451ac Bug 1294525 - Break out Tinderbox fields in log parser (#1848) 2016-10-11 14:14:27 -07:00
William Lachance 61d89cd1a1 Bug 1308528 - Serialize ingestion of job data (#1906) 2016-10-11 17:13:42 -04:00
jgraham 32029361c8 Bug 1283859 - Fix quoting of MATCH ... AGAINST in bugscache search (#1914)
It appears that the intent of this code is to to a phrase match of the
search string against the bug summary for relevance matching. However
the code incorrectly tried to quote the string and as a result failed
to handle special characters in the AGAINST clause (e.g. + - ~ >
etc.). This change simply removes any existing quote characters from
the string and places the entire thing in quotes. Per the MySQL
documentations:

 > A phrase that is enclosed within double quote (") characters
   matches only rows that contain the phrase literally, as it was
   typed
2016-10-11 18:27:56 +01:00
William Lachance 3f49c4557b Bug 1306903 - Return project specific id from job-log-url endpoint (#1903) 2016-10-11 10:35:12 -04:00
Casey Williams 8e1c42b041 Bug 1263236 - Indicate jobs are ready in the DOM (#1904)
Adds a .ready class to a hidden span once a resultset has successfully
loaded and displayed its jobs in the DOM
2016-10-10 17:27:05 -07:00
Cameron Dawson c88a9fb3fa Bug 1307782 - Raise the Celery task time_limit for the buildbot ingestion tasks 2016-10-07 13:58:02 -07:00
KWierso aa18d582ad Bug 1308557 - Make sure the reftest analyser works from the logviewer (#1907) 2016-10-07 13:49:42 -04:00
camd 0d4279fdc8 Bug 1308328 - Add Treeherder test cases to docs (#1902)
* Bug 1308328 - Add Treeherder test cases to docs
2016-10-07 09:03:25 -07:00
William Lachance 8fc9754f4e Bug 1281820 - Stop using bug suggestions artifacts
Instead, generate the data when required. We will store the return value
of this in memcache for a day to ensure things are responsive for the sheriffs
when classifying recent failures.
2016-10-07 10:51:41 -04:00
William Lachance 9b9d37e690 Bug 1281820 - Move autoclassify methods into Django ORM class 2016-10-07 10:51:41 -04:00
William Lachance 69bdc2ed15 Bug 1281820 - Clean up autoclassification unit tests
* Remove unused fixtures
* Add test_job, test_job_2 fixtures for testing job data, instead of
  ingesting 11 jobs
* Remove various uses of datasource
2016-10-07 10:51:41 -04:00
camd 927e8ced9a Bug 1307490 - Include project in exception for missing resultset (#1896) 2016-10-06 09:46:11 -07:00
Askeing Yen (fyen) 119cc4cebf Bug 1307695 - Add a performance framework for Hasal (#1897) 2016-10-06 11:19:01 -04:00
Ed Morley b6b9966921 Bug 1307785 - Lower gunicorn --max-requests on Heroku to match SCL3
This works around the apparent pre-existing memory leak until we're able
to fix it.
2016-10-05 14:49:21 +01:00
KWierso f7e2c5cd42 Bug 1205747 - Ensure the retrigger/backfill menu gets styled (#1893) r=camd
The menus in the app header navbar get a subtle grey background on hover.
For some reason, the same is not applying to the retrigger/backfill menu.
This patch just forces the same style change to occur for this menu.
2016-10-04 16:35:29 -07:00
KWierso dddee39708 Bug 1306889 - Help ensure bugfiler doesn't choke on xperf failures (#1890) r=camd
For whatever reasons, xperf failures are logged as "TEST-UNEXPECTED-FAIL :
xperf :" instead of "TEST-UNEXPECTED-FAIL | xperf |", which caused issues
with the bugfiler trying to split the failure line on |s. This patches
over the problem by not letting the summary array be reduced if there's
only one item left in the array.
2016-10-04 10:48:07 -07:00
KWierso 861a9fc959 Bug 1306859 - Enable the bug filer for is_staff users (#1891) r=camd
This makes the button appear for anyone that is logged in and either in
the is_staff group or has '&bugfiler' in the URL.
2016-10-04 10:46:35 -07:00
Sara Di Bartolomeo 1bbf0f585f Bug 1066722 - Support double click for moving an item from a list to the other in the exceptions page (#1894) 2016-10-04 08:50:04 -07:00
glenn124f 86a3f974f1 Bug 1301986 - Standardize action menu_capitalization (#1889) 2016-10-03 17:51:43 -07:00
Casey Williams a4c0b7a3b4 Bug 1066724 - Make ctrl+a select all in focused exclusion lists (#1887)
Adds a keyboard shortcut to make ctrl+a (or command+a) select all items
in reactlist components like the exclusion lists in the admin view. This
is default behavior in chrome/ium, but not FF or IE.
2016-10-03 16:29:39 -07:00
Cameron Dawson f3261ad979 Bug 1306578 - Use retryable_task for pulse job ingestion
Was calling retry manually, but that was causing repeated
retries that were blowing up the celery queue.  This just
uses our normal retryable_task for retries and adds some
extra logging in new relic to help identify the product
of a pulse job that failed.
2016-10-03 16:18:59 -07:00
Cameron Dawson 61d5fe0889 Bug 1306578 - Better handling for unknown project repo
Raises a DatasetNotfoundError if the repo isn't found
2016-10-03 16:18:59 -07:00
camd 7941918450 Bug 1306760 - Import error.js on admin and perfherder (#1888) 2016-09-30 15:30:13 -07:00
Rob Wood d94f7fb137 Bug 1306601 - Fix e10s dashboard filtering (#1886) 2016-09-30 13:49:37 -04:00
jgraham c54c4c2e36 Bug 1292910 - Fix handling of text log summary model load errors in autoclassify panel (#1885) 2016-09-30 16:04:47 +01:00
Ed Morley 7edb2350a2 Bug 1290082 - Use ThModelErrors for classification and persona errors
There are still other API error cases that aren't yet using
`ThModelErrors`, however these two cases are the most important for now,
since otherwise the Heroku migration maintenance messages won't be
displayed in the UI.
2016-09-30 11:24:41 +01:00
Ed Morley cb7ff988ff Bug 1290082 - Make ThModelErrors use HTTP status code if no API message
Previously if the server response wasn't valid json with a `detail`
attribute, only the generic message from the `ThModelErrors.format()`
call (eg "Unable to cancel job") would be displayed.

Now, `format()` will fall back to including the HTTP status code (and
corresponding text description of that code) too.

We intentionally don't display the server response if it's not valid
json, since in this case it's likely several hundreds lines of HTML from
the load balancer. (And users can always inspect the response manually.)
2016-09-30 11:24:41 +01:00
Cameron Dawson 759d2fa3ad Revert "Bug 1305507 - Save whatever's typed into the bug field before seeing if we can save the classification (#1875) r=camd"
This reverts commit 3092f0b3db.
2016-09-29 13:07:26 -07:00
camd 40d84ee95d Bug 1286578 - Retry job task if resultset doesn't exist (#1872)
* Bug 1286578 - Retry job task if resultset doesn't exist

This removes the logic which creates `skeleton resultsets`
when a job is ingested that we don't have a resultset for yet.
The new approach is to fail and wait for the task to retry.

The buildbot job ingestion already skips and retries later if
it encounters a job for which it has no resultset.

This adds a similar check to the Pulse Job ingestion.  If
a job comes in with a revision that doesn't have a resultset
yet, then this will raise a ValueError.  That will invoke the
retryable_task actions which will wait a bit, then retry.  Each
time it will wait a little longer to retry.  After 9 retries it
waits something like 3900 seconds which should be plenty of time
for the resultset ingestion to complete.
2016-09-29 10:13:26 -07:00
Jonathan French 86885b0601 Bug 1306369 - Update common tasks log parser doc example (#1881) 2016-09-29 12:49:37 -04:00
Rob Wood ce16cabce3 Bug 1288007 - Add e10s-trend dashboard (#1863) 2016-09-29 09:56:43 -04:00
KWierso 39921f2e38 Bug 1305585 - Add Win10VM to thPlatformMap and re-adjust all platform values (#1876) r=camd
* Bug 1305585 - Adjust values in thPlatformMap

This patch gives a bit more space for each section of platforms, so we
don't have to adjust the entire stack of platform values for every new
platform we add.

Desktop platforms get 0 - 39.
Android/b2gdroid gets 40 - 79.
B2g/Mulet gets 80 - 99.
Graphene/horizon gets 100 - 119.
Gecko-decision and others gets 120 and up.

* Bug 1305585 - Add Windows 10 x64 VM to thPlatform map
2016-09-28 14:57:59 -07:00
Ed Morley 1e96a44cea Bug 1302689 - Update Django from 1.8.14 to 1.8.15
https://www.djangoproject.com/weblog/2016/sep/26/security-releases/
https://docs.djangoproject.com/en/stable/releases/1.8.15/
https://github.com/django/django/compare/1.8.14...1.8.15
2016-09-28 21:59:59 +01:00
KWierso faf871536b Bug 1305859 - Make sure HTML-encoded characters render correctly in the title (#1877) r=wlach 2016-09-28 09:15:20 -07:00
KWierso 3092f0b3db Bug 1305507 - Save whatever's typed into the bug field before seeing if we can save the classification (#1875) r=camd 2016-09-27 20:07:59 +01:00
William Lachance 72bdd4c67a Bug 1293264 - Show distinctive banner when user tries to cancel all jobs (#1874)
This also reverts the previous behaviour where we'd cancel a single job
if one was selected. This new approach hopefully makes it harder to
accidentally delete all jobs when only intending to cancel one, while
still being intuitive if that's really what you want to do.
2016-09-26 16:34:33 -04:00
Jonathan French f393b57836 Bug 1301081 - Disable various menus when appropriate (#1837) 2016-09-26 14:54:56 -04:00
William Lachance 078a446a2e Bug 1304557 - Allow passing multiple job_id parameters to job log url endpoint (#1873) 2016-09-26 09:43:31 -04:00