Граф коммитов

166 Коммитов

Автор SHA1 Сообщение Дата
Paul McLanahan e7ef68f8ee Remove SECRET_KEY from all .env files
It turns out we don't need them because we have a default value
in settings/base.py. This covers the cases where we need to run
management commands during the build and test phases. Real
SECRET_KEY values are set in all of our running instances of
the site.

Fix #7792
2019-09-26 11:29:14 -05:00
Chris Beaven bf67e8bf34 Django 2.2 (#7196)
* Complete removal of nose test artifacts

* Update base requirements to Django 2.2 and python 3 compatibile packages
2019-07-03 02:24:42 -05:00
Chris Beaven 5c7518d3cf Abstract a lockable management command, removing django-crontab 2019-05-02 10:32:03 -04:00
Josh Mize 25db44497b
Set stage CONTENT_CARDS_BRANCH to master-processed (#7114) 2019-04-25 16:15:26 -05:00
Josh Mize 93015f45a4 Remove smoke marker from tests (#7030) 2019-04-11 10:06:34 +01:00
Paul McLanahan 17af0b5cc1 Pull proper content cards during docker build (#6743)
Also pull proper database during build for staging.
2019-01-23 09:50:13 -06:00
Paul McLanahan 14ca66ea78 Use external data for home page content cards
This switches the current English home page to display
content cards from data in the mozmeao/www-admin repo.

Fix #6124
2019-01-22 18:40:02 +00:00
Alex Gibson 2538f13e0b Switch sanity tests to run against IE9 (#6696) 2019-01-10 10:46:27 -06:00
Paul McLanahan 04df1d6a80 Use :latest docker tags for builds from "master"
Add :prod-latest tags for production images.
2018-08-23 15:43:15 -04:00
Paul McLanahan 202fe774e2 Upload static media to s3 on deploy (#5932) 2018-07-18 09:33:59 -05:00
Paul McLanahan a8171c5784 Switch from django-pipeline to gulp tasks for asset processing (#5618)
* Move from django-pipeline to Gulp for static-assets

* Use Gulp tasks to compile less and sass
* Use Gulp tasks to concatinate files into bundles
* Use Gulp tasks to minify files for deployment
* Use Gulp tasks for development to watch for changes
* Use BrowserSync to serve development static files and refresh the
  in-progress page
* Update Docker setup to use multi-stage build
* Update Makefile to build and run the docker setup
* Update docs to recommend Docker-based development
* Update deployment and testing to also use the Makefile

* Add rebuild of SASS bundles when library files change

* Add an intermediate build directory just for LESS and SASS
* Avoid issues with ambiguous imports when .css and .scss in the same
  directory

* Set deployment docker image in git env var script
2018-06-07 10:52:53 -05:00
Paul McLanahan 0cae03499f Remove -e option from "docker login" (#5664)
It was removed in a new version and we've just recently upgraded
2018-05-07 12:32:50 -05:00
Alex Gibson e26031301e Import @mozilla-protocol/core to bedrock (#5605) 2018-05-02 08:24:10 -07:00
Paul McLanahan d14f7b0c6e Fix #5579: Update NodeJS installs in builder image (#5580)
Should help with CI failures due to failed Docker builds.
2018-04-13 13:58:47 -05:00
Paul McLanahan 83a5412a7e Remove us-west from deployment and add oregon-b (#5545)
This also removes deis1 specific things like pushing to
the private docker registry and the deis1 CLI tool.
2018-04-02 09:51:53 -05:00
Paul McLanahan 1f3ca1bf81 Upload and distribute database updates via S3 (#5334)
A.K.A The Sqlitening!

This removes bedrock's depenence on a database server and moves to
downloading pre-built sqlite database files from s3 on a schedule. There
is also a clock process that will update and upload such a database on a
schedule as well. This should mean more stability, speed, and
reliability for bedrock, as well as quicker development due to easy to
download pre-populated databases.
2018-03-29 14:24:22 -05:00
alexgibson b55c514b2a Update functional tests to Selenium 3.5.0 2018-01-23 15:22:05 -05:00
Paul McLanahan ae51a45221 Move to CircleCI 2 for PR testing 2018-01-17 15:39:46 -05:00
Paul McLanahan ad4237afc7 Revert deployment changes (#5387)
* Revert "Fix container names in integration tests (#5386)"

This reverts commit aec7d9ca7b.

* Revert "Use branch name in test container names; avoid conflicts (#5385)"

This reverts commit 24abfb303d.
2018-01-11 16:34:31 -06:00
Paul McLanahan aec7d9ca7b Fix container names in integration tests (#5386) 2018-01-11 16:14:46 -06:00
Paul McLanahan 24abfb303d Use branch name in test container names; avoid conflicts (#5385)
If you try a deployment of two branches with the same commit
(e.g. master and prod) it will often fail due to conflicting
container names when they were just using commit hash. Adding
the branch name should eliminate these failures.
2018-01-11 15:48:27 -06:00
Paul McLanahan 4395f13e7c Move link gathering out of test discovery for download tests
Also stop download tests running by default.
2017-12-21 17:56:32 +00:00
Paul McLanahan fbade031ef Only run download test setup when tests are selected 2017-12-21 15:37:30 +00:00
Paul McLanahan 2b8905f632 Avoid testing all download URLs more than once per deployment 2017-12-20 18:26:44 +00:00
Paul McLanahan 3d09f83ca5 Switch to using official Python base docker image
Re https://github.com/mozmeao/infra/issues/641
2017-11-08 15:55:44 -05:00
Paul McLanahan ebd6a7c438 Move release notes views to rely on database
* No longer rely on release notes JSON files on the file system.
* Switch everything to new update_release_notes_data command
* Move to using django-memoize for releasenotes caching
2017-10-18 11:10:25 -04:00
Paul McLanahan 2da490a065 Pull in latest versions of Nodejs and Yarn
Updates from the upstream repo:

d3ca6d89ae/6.11/slim/Dockerfile
2017-10-13 10:40:46 -04:00
Paul McLanahan b81e99c59c Switch from NPM to Yarn for NodeJS deps
And switch docker base to mozmeao/base:python-2.7.
The official Nodejs image commands are now run in the
bedrock_build dockerfile.
2017-10-04 11:27:37 -04:00
Alex Gibson 44fa0b4ddc [fix bug 1402421] Update functional tests for the new homepage 2017-09-29 15:01:10 +01:00
Alex Gibson 782b354dc1 Run sanity functional tests in IE8 2017-09-29 13:19:29 +01:00
Paul McLanahan f9d55e9fc4 Bug 1388150: Convert release notes to use git repo and JSON
Will allow us to simplify bedrock by not installing RNA.

Remove:

* django-mozilla-rna
* django-restframework
* django-synctool

Do markdown conversion on load of release: Helps with cache and perf.

Add tests for new release models
2017-09-26 22:23:06 -04:00
Alex Gibson b962ff4dd5 Pin SauceLabs to Chrome 60 due to outdated chromedriver 2017-09-15 17:41:54 +01:00
Paul McLanahan 158a45468a Update product-details for local integration tests 2017-08-29 16:32:36 -04:00
Paul McLanahan 80ff3dfe15 Fix locale dir copy in l10n dockerfile
Regression from Sitemap PR
2017-06-23 14:55:09 -04:00
Paul McLanahan 86a765324f Only include default URLs in sitemap.xml
Also exclude more URLs from sitemap
2017-06-21 12:35:24 -04:00
Paul McLanahan 4002e7167a Fix bug 1369738: Add XML sitemap
Add a management command to generate a sitemap and update deployment
to generate and include it in the builds.

Thanks to @kyoshino in PR #1333 for most of the basis of this work.
2017-06-20 16:12:18 -04:00
Paul McLanahan 867040a19a Quiet demo deploy output 2017-06-15 15:35:09 -04:00
Paul McLanahan 20be1cfe20 Include test image in push to dockerhub
This will ensure that the test image is available to the
other jobs that need to tests bedrock instances.
2017-05-25 10:46:54 -04:00
Paul McLanahan d1530078c5 Tag all images as "latest" during prod push
This will allow other jobs (configurator e.g.) to use
the ":latest" images for testing and other things.
2017-05-23 16:33:46 -04:00
Paul McLanahan 4545530a27 Use sync gunicorn worker class for smoke tests
Meinheld (the default) is causing problems at tests startup,
but works better when deployed.
2017-05-23 11:24:47 -04:00
Paul McLanahan f3c79c3531 Switch deployment to use dockerized envcat 2017-05-12 10:35:24 -04:00
Paul McLanahan 914d8007f4 Restructure jenkins deployment. Demos build in main pipeline.
* Fix demo deploy and update docs.
* Make it work with deis1 and deis2
* Enforce max 63 char app names
* Fix SSL redirect for Deis v2 clusters. Allow settings per cluster.
* Improve env file handling and combination for demo deploys
* Use new envcat utility
* Deploy our dev, stage, and prod apps to virginia and tokyo clusters
2017-05-10 17:01:06 -04:00
Paul McLanahan 01088d4549 Switch to UglifyJS and CleanCSS compressors 2017-04-03 15:55:58 -04:00
Paul McLanahan 7bab6434d2 Downgrade Requests to fix LinkChecker
Turns out LinkChecker checks for a good version of python-requests
in a dumb way, so it sees version "2.13.0" as being lower than
"2.2.0". Also the project seems to have been abandoned, so there
isn't a newer release, though it seems this issue has been fixed
in the master branch.

Easiest fix is to just downgrade requests to the latest version
that is < 2.10.0, which is what I've done.
2017-03-15 10:10:56 -04:00
Paul McLanahan 252d599454 Add removal of containers to docker run commands
Also switch to using short git hash from build number for container names.
2017-03-02 13:35:17 -05:00
Paul McLanahan b5e40444e4 Add branch name to deploy image
This means that we can push dev l10n to www-dev and prod
l10n to stage and prod. Currently they all get prod l10n
at deployment then dev updates when cron runs.
2017-03-02 13:20:44 -05:00
Paul McLanahan 4a16758fd7 Add bash utility for setting git environment variables 2017-03-02 13:20:44 -05:00
Paul McLanahan 74c7c63c5d Add more options to jenkins.yml for deployments
* Add ability to toggle smoke tests
* Add ability to toggle deployment
* Add ability to toggle integration tests
* Add ability to toggle pushing docker images to public registry
2017-03-02 13:20:44 -05:00
alexgibson 3647ea0d23 [fix bug 1342036] Remove Firefox OS feed links 2017-02-28 09:43:56 -05:00
Paul McLanahan 8364aa313f Move docker scripts, envfiles, and groovy files 2017-02-22 16:41:19 -05:00