A Mozilla release management tool to send reminders to Firefox developers and improve Bugzilla metadata
Перейти к файлу
Suhaib Mujahid e2b4f8d62f
[duplicate_copy_metadata] Copy WebCompat Priority flag (#1883)
Co-authored-by: Marco Castelluccio <mcastelluccio@mozilla.com>
2023-02-17 08:37:12 -05:00
.github [wiki] Remove the dependencies (#1849) 2023-01-23 08:19:36 -05:00
auto_nag [duplicate_copy_metadata] Copy WebCompat Priority flag (#1883) 2023-02-17 08:37:12 -05:00
db Add a db to store the different actions the bot made (#542) 2019-04-16 11:08:33 +02:00
extra Prettify json files 2022-03-16 11:52:07 +01:00
templates Follow up on expiring variants (#1794) 2022-12-12 14:06:03 -05:00
.coveragerc Better automation of the tests in travis + add code coverage 2015-10-22 10:01:52 +02:00
.flake8 Exclude some directories from flake8 checks, and disable line length rule (#720) 2019-06-11 18:30:15 +02:00
.gitignore Nag managers for components that need triage owner to be assigned (#1342) 2022-03-31 18:00:57 +02:00
.isort.cfg Remove seed-isort-config as it's no longer needed since isort 5 (#1785) 2022-11-24 09:58:55 +01:00
.pre-commit-config.yaml Update `isort` hook to 5.11.5 (#1871) 2023-02-05 15:58:52 -05:00
.taskcluster.yml Prettify yaml files 2022-03-16 11:50:31 +01:00
CODE_OF_CONDUCT.md Prettify markdown files 2022-03-16 11:50:48 +01:00
LICENSE Update of the license file (#700) 2019-06-03 10:23:52 +02:00
README.rst [code_freeze_week] Run the tool every day 2022-08-22 09:37:59 -04:00
alembic.ini Add a db to store the different actions the bot made (#542) 2019-04-16 11:08:33 +02:00
check_tools_on_wiki.py [wiki] Remove the dependencies (#1849) 2023-01-23 08:19:36 -05:00
requirements-dev.txt Bump coverage from 7.0.5 to 7.1.0 (#1858) 2023-02-05 16:57:42 -05:00
requirements-test.txt Bump tox from 4.4.4 to 4.4.5 (#1881) 2023-02-08 18:03:55 -05:00
requirements.txt Bump tenacity from 8.2.0 to 8.2.1 (#1884) 2023-02-15 19:29:27 -05:00
runauto_nag_common.sh Keep running scripts when one fails (#895) 2020-02-18 09:41:45 +01:00
runauto_nag_daily.sh [code_freeze_week] Run the tool every day 2022-08-22 09:37:59 -04:00
runauto_nag_hourly.sh Copy accessibility related fields from duplicate bugs (#1754) 2022-11-18 09:03:17 -05:00
runauto_nag_tuesday.sh Update the docs for the cron jobs (#1569) 2022-07-26 17:57:22 +02:00
runauto_nag_weekdays.sh Follow up on expiring variants (#1794) 2022-12-12 14:06:03 -05:00
tox.ini Remove dependency on `nose` (#1392) 2022-04-06 22:03:35 +02:00
update_people.sh Generate phonebook data using IAM api (#820) 2019-09-09 12:02:28 +02:00

README.rst

.. image:: https://community-tc.services.mozilla.com/api/github/v1/repository/mozilla/relman-auto-nag/master/badge.svg
    :target: https://community-tc.services.mozilla.com/api/github/v1/repository/mozilla/relman-auto-nag/master/latest
.. image:: https://coveralls.io/repos/github/mozilla/relman-auto-nag/badge.svg
    :target: https://coveralls.io/github/mozilla/relman-auto-nag


This tool is used by Mozilla release management to send emails to the Firefox developers. It will query the bugzilla.mozilla.org database and send emails to Mozilla developers and their managers (if Mozilla staff).

The tool will also notify release managers about potential issues in bugzilla and autofix some categories of issues.

The list of checkers is documented on the Mozilla wiki:
https://wiki.mozilla.org/Release_Management/autonag


This package currently uses Mozilla's `Bugzilla REST API <https://wiki.mozilla.org/Bugzilla:REST_API>`_, and optionally the Mozilla IAM `phonebook <https://github.com/mozilla-iam/cis/blob/master/docs/PersonAPI.md>`_ (to access bug assignees' managers & Mozilla email addresses).


Installation
------------

#. Check out the code::

    git clone git://github.com/mozilla/relman-auto-nag.git

#. (optional) Create your virtualenv using virtualenvwrapper::

    virtualenv -p python3 venv
    source venv/bin/activate

#. Install pip::

    easy_install pip

#. Install the dependencies for Python 3 too::

    pip3 install -r requirements.txt


To run it into production, you will need the full list of employees + managers.

Automated Nagging Script
------------------------

Before running:

1. The LDAP + SMTP infos are used to send emails
2. Need to generate an API key from bugzilla admin ( https://bugzilla.mozilla.org/userprefs.cgi?tab=apikey )
3. Should generate an API key from Phabricator ( https://phabricator.services.mozilla.com/settings/user )
4. The IAM secrets are used to generate a dump of phonebook, which is required for some scripts (employees can request them by `filing a bug in the SSO: Requests component <https://bugzilla.mozilla.org/enter_bug.cgi?product=Infrastructure%20%26%20Operations&component=SSO%3A%20Requests>`_ )
5. The private entry contains URLs for private calendar in ICS format:

.. code-block:: json

    # in scripts/configs/config.json
    {
      "ldap_username": "xxx@xxxx.xxx",
      "ldap_password": "xxxxxxxxxxxxxx",
      "smtp_server": "smtp.xxx.xxx",
      "smtp_port": 314,
      "smtp_ssl": true,
      "bz_api_key": "xxxxxxxxxxxxxx",
      "phab_api_key": "xxxxxxxxxxxxxx",
      "iam_client_secret": "xxxxxxxxxxxxxx",
      "iam_client_id": "xxxxxxxxxxxxxx",
      "private":
      {
        "Core::General": "https://..."
      }
    }

Do a dryrun::
    python -m auto_nag.scripts.stalled -d

There is a ton of scripts in auto_nag/scripts/ so you should be able to find some good examples.

Setting up 'Round Robin' triage rotations
-----------------------------------------

One use case for this tool is managing triage of multiple components across a team of multiple people.

To set up a new Round Robin rotation, a manager or team lead should create a Google Calendar with the rotation of triagers.

Then the administrators will need to create a configuration file:

.. code-block:: json

    # in scripts/configs/<name of rotation>_round_robin.json
    {
        "fallback": "<Name of manager or lead>",
        "components":
        {
            "Product::Component": "default",
            "Product::Component": "default",
            …
        },
        "default":
        {
            "calendar": "private://<Name of calendar>"
        }
    }

The person requesting the round robin schedule must provide the URL of the calendar's `.ics` file.

In the calendar, the summary of the events must be the full name (eventually prefixed with text between square brackets) of triage owner as it appears in Phonebook, e.g. `[Gfx Triage] Foo Bar` or just `Foo Bar`.

And then you just have to add an entry in `auto_nag/scripts/config/tools.json <https://github.com/mozilla/relman-auto-nag/blob/333ec164ba5c3ceebf3c39cf84196fa35c667b1b/auto_nag/scripts/configs/tools.json#L2>`_ in the round-robin section.

Once everything is set-up you can make a PR similar too https://github.com/mozilla/relman-auto-nag/pull/858/files

Running on a server
-------------------

This needs to run on a private server because it will have login for smtp and bugzilla key so it can't currently be shared access.

Cronjob::

    CRON_DIR=/path/to/repository
    00 17  * * 2   cd $CRON_DIR ; ./runauto_nag_tuesday.sh  &> /tmp/autonag-tuesday.log
    00 7   * * *   cd $CRON_DIR ; ./update_people.sh        &> /tmp/autonag-people.log
    00 12  * * 1-5 cd $CRON_DIR ; ./runauto_nag_weekdays.sh &> /tmp/autonag-day.log
    00 8   * * *   cd $CRON_DIR ; ./runauto_nag_daily.sh    &> /tmp/autonag-day.log
    30 */1 * * *   cd $CRON_DIR ; ./runauto_nag_hourly.sh   &> /tmp/autonag-hour.log


We run hourly jobs at minute 30 past every hour to avoid overlap with daily jobs.
For the people update script, sometimes it could be slow, thus we run it earlier to avoid overlapping with hourly and daily jobs.