Граф коммитов

78 Коммитов

Автор SHA1 Сообщение Дата
Kaxil Naik 0d76b59c68
Remove redundant section from dev/README.md toc (#10689) 2020-09-02 11:39:38 +01:00
Ry Walker 50c9411cbf
Remove airflow-pr tool (#10675)
* Remove airflow-pr tool

* Add PyGithub back in

* Remove gitpython
2020-09-01 14:50:31 -04:00
Ry Walker 8ac6f2989e
Fix format of install commands (#10676) 2020-09-01 19:20:19 +02:00
Kaxil Naik d760265452
PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) 2020-08-25 09:50:21 +01:00
Jarek Potiuk 92858ccee3
Add instructions to verify the release candidate (#10493) 2020-08-24 17:22:04 +02:00
Jarek Potiuk e92d50eda7
Replace file.io with artifacts (#10137) 2020-08-04 01:26:59 +02:00
Jarek Potiuk 44d4ae809c
Upgrade to latest pre-commit checks (#9686) 2020-07-06 11:37:22 +02:00
Kaxil Naik 87fdbd0708
Use literal syntax instead of function calls to create data structure (#9516)
It is slower to call e.g. dict() than using the empty literal, because the name dict must be looked up in the global scope in case it has been rebound. Same for the other two types like list() and tuple().
2020-06-25 16:35:37 +01:00
Jarek Potiuk 7c12a9d4e0
Improve production image iteration speed (#9162)
For a long time the way how entrypoint worked in ci scripts
was wrong. The way it worked was convoluted and short of black
magic. This did not allow to pass multiple test targets and
required separate execute command scripts in Breeze.

This is all now straightened out and both production and
CI image are always using the right entrypoint by default
and we can simply pass parameters to the image as usual without
escaping strings.

This also allowed to remove some breeze commands and
change names of several flags in Breeze to make them more
meaningful.

Both CI and PROD image have now embedded scripts for log
cleaning.

History of image releases is added for 1.10.10-*
alpha quality images.
2020-06-16 12:36:46 +02:00
James Timmins cef1df4ebe
Add dev script to compare GH issues against merges (#9270)
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
2020-06-14 17:07:35 +01:00
Felix Uellendall 1698db4ac1
Update pre-commit-hooks repo version (#9195)
- use official isort pre-commit-hook
- use official yamllint pre-commit-hook
- run isort pre-commit-hook on all python files instead of files ending with py
2020-06-14 01:37:30 +01:00
Jarek Potiuk 00642a46d0
Fixed name of 20 remaining wrongly named operators. (#8994) 2020-05-26 19:12:21 +02:00
Jarek Potiuk 9764c90b92
Better content of backport packages CHANGELOG and INSTALL files (#9013)
* Better content of backport packages CHANGELOG and INSTALL files

The content of Backport Packages CHANGELOG.txt and INSTALL files
has been updated to reflect that those are not full Airflow
releases.

1) Source package:
- INSTALL contains only references to preparing backport packages
- CHANGELOG.txt contains combined change log of all the packages

2) Binary packages:
- No INSTALL
- CHANGELOG.txt contains changelog for this package only

3) Whl packages

No change

* Update backport_packages/INSTALL
2020-05-26 13:54:58 +02:00
Jarek Potiuk 375d1ca229
Release candidate 2 for backport packages 2020.05.20 (#8898)
Release candidate 2 for backport packages 2020.05.20
2020-05-19 14:17:22 +02:00
Jarek Potiuk 12c5e5d8ae
Prepare release candidate for backport packages (#8891)
After preparing the 2020.5.19 release candidate and
reviewing the packages, some changes turned out to be necessary.

Therefore the date was changed to 2020.5.20 with the folowing
fixes:

* cncf.kubernetes.example_dags were hard-coded and added for all
  packagesa and they were removed
* Version suffix is only used to rename the binary packages not for
  the version itself
* Release process description is updated with the release process
* Package version is consistent - leading 0s are skipped in month
  and day
2020-05-17 20:38:46 +02:00
Jarek Potiuk 92585ca4cb
Added automated release notes generation for backport operators (#8807)
We have now mechanism to keep release notes updated for the
backport operators in an automated way.

It really nicely generates all the necessary information:

* summary of requirements for each backport package
* list of dependencies (including extras to install them) when package
  depends on other providers packages
* table of new hooks/operators/sensors/protocols/secrets
* table of moved hooks/operators/sensors/protocols/secrets with
  information where they were moved from
* changelog of all the changes to the provider package (this will be
  automatically updated with incremental changelog whenever we decide to
  release separate packages.

The system is fully automated - we will be able to produce release notes
automatically (per-package) whenever we decide to release new version of
the package in the future.
2020-05-15 19:00:15 +02:00
Kaxil Naik 4b06fde0f1
Fix Flake8 errors (#8841) 2020-05-12 11:07:29 +01:00
Kaxil Naik aaa3d3286e
Fix minor issues with Announcements Dev Scripts (#8141) 2020-04-04 20:11:34 +01:00
Kaxil Naik e681d3a4f3
[AIRFLOW-6727] Fix minor bugs in Release Management scripts (#7355) 2020-02-04 15:06:42 +05:30
Kaxil Naik 2028a93ae0
[AIRFLOW-6374] Automate sending emails for Release management (#6932) 2019-12-27 20:45:27 +00:00
Ash Berlin-Taylor 2a157e32d0 [AIRFLOW-6272] Switch from npm to yarnpkg for managing front-end dependencies (#6844)
It is:

- quicker to install
- easier to get repeatable results
- Takes up less space (130MB/15k files vs 190MB/23k files)
- nicer to user (has better help)
2019-12-19 22:21:41 +01:00
Kaxil Naik b5d0b9d306 [AIRFLOW-XXX] Bump Jira version to fix issue with async (#6813) 2019-12-13 23:17:49 +01:00
Ash Berlin-Taylor 999d704d64 [AIRFLOW-XXX] Update airflow-jira release management script (#6772) 2019-12-11 14:37:28 +00:00
Jarek Potiuk 10d39eff25
[AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc (#6283)
Co-authored-by: Elena Fedotova <lavel@mail.ru>
Co-Authored-By: Kamil Breguła <mik-laj@users.noreply.github.com>
Co-Authored-By: Kaxil Naik <kaxilnaik@gmail.com>
Co-Authored-By: Ash Berlin-Taylor <ash_github@firemirror.com>
2019-10-13 22:20:31 +02:00
Kevin Yang d719e1fd67 [AIRFLOW-5362] Reorder imports (#5944) 2019-10-02 16:30:03 +01:00
Jarek Potiuk 4780105798 [AIRFLOW-5256] Related pylint changes for common licences in python files (#5786) 2019-09-17 13:16:32 +02:00
Jarek Potiuk e090744787
[AIRFLOW-5206] Common licence in all .md files, TOC + removed TODO.md (#5809) 2019-08-21 23:27:54 -04:00
Jarek Potiuk 64207120fd
[AIRFLOW-5204] Shellcheck + common licences + executable shebangs in shell files (#5807)
* [AIRFLOW-5204] Shellcheck + common licence in shell files
2019-08-20 00:07:39 -04:00
Jarek Potiuk 5cfe9c29a0
[AIRFLOW-5233] Fixed consistency in whitespace (tabs/eols) + common problems (#5835)
* [AIRFLOW-5233] Fixed consistency in whitespace (tabs/eols) + common problems
2019-08-16 10:35:34 -04:00
Bas Harenslak 7f4d09276a [AIRFLOW-4198] Remove all try/import compatibility imports (#5091) 2019-05-05 22:27:26 +02:00
Jiajie Zhong 1e74a94ace [AIRFLOW-4201] Replace unicode strings by normal strings (#5026) 2019-04-30 11:13:33 +02:00
Jiajie Zhong 8b38478313 [AIRFLOW-4199] Remove all sys.version_info[0] == 3 (#5019) 2019-04-22 13:19:28 +01:00
Jiajie Zhong d2a2e2cbff [AIRFLOW-4200] Remove all __future__ imports (#5020) 2019-04-22 11:26:11 +02:00
Ash Berlin-Taylor 8b7ff43f1f
[AIRFLOW-XXX] Improve airflow-jira script to make RelManager's life easier (#4857)
These changes do a number of things:

- Add colours to the output so  I can easily see which issues against a
  release are still open
- Order the Jira issues by update date (so oldest updated are at the
  bottom) - the older issuer will likely cherry-pick better if done in
  the bottom to top order
- Add an `--unmerged` flag to only show un-merged issues in the output
- Attempt to find the PR# and merge commit from master branch for a
  given jira issue. This won't cope with the case where we have multiple
  PRs targeting one issue.
2019-03-08 14:14:24 +00:00
Ryan Yuan 5c170f0594 [AIRFLOW-3933] Fix various typos (#4747)
Fix typos
2019-02-21 11:50:05 +01:00
Tao Feng 67572025cc [AIRFLOW-3612] Remove incubation/incubator mention (#4419) 2019-01-05 14:05:25 +00:00
Ash Berlin-Taylor 9a94f0d4d0 [AIRFLOW-3521] Fetch more than 50 items in `airflow-jira compare` script (#4300) 2018-12-15 11:50:22 +00:00
Ash Berlin-Taylor 55853c3c23 [AIRFLOW-XXX] Don't publish md5 sigs as part of release (#4210)
Apache recommend against publishing MD5 files now as they are relatively
easy to collide and shouldn't be trusted anymore
2018-11-19 10:26:18 -08:00
Ash Berlin-Taylor b9fc03ea1a [AIRFLOW-2779] Add license headers to doc files (#4178)
This adds ASF license headers to all the .rst and .md files with the
exception of the Pull Request template (as that is included verbatim
when opening a Pull Request on Github which would be messy)
2018-11-13 15:01:44 +01:00
Kaxil Naik 5e9c9b54f6
[AIRFLOW-2238] Update PR tool to remove outdated info (#3978) 2018-09-29 11:35:26 +01:00
Ash Berlin-Taylor 47894f28eb [AIRFLOW-XXX] Fix python3 and flake8 errors in dev/airflow-jira
This is a script that checks if the Jira's marked as fixed in a release
are actually merged in - getting this working is helpful to me in
preparing 1.10.1
2018-09-05 10:06:32 -07:00
Kazuhiro Sera b78c7fb851 [AIRFLOW-2889] Fix typos detected by github.com/client9/misspell (#3732) 2018-08-11 21:11:19 -07:00
Kaxil Naik 120f4856cd [AIRFLOW-2867] Refactor Code to conform standards (#3714)
- Dictionary creation should be written by dictionary literal
- Python’s default arguments are evaluated once when the function is defined, not each time the function is called (like it is in say, Ruby). This means that if you use a mutable default argument and mutate it, you will and have mutated that object for all future calls to the function as well.
- Functions calling sets which can be replaced by set literal are now replaced by set literal
- Replace list literals
- Some of the static methods haven't been set static
- Remove redundant parentheses
2018-08-07 16:18:42 -07:00
Ash Berlin-Taylor d843f65af2 [AIRFLOW-2238] Use SSH protocol for pushing to Github (#3680)
Since we have MFA enforced we won't be able to use passwords to push and
will have to use SSH keypairs.
2018-08-02 20:43:13 +01:00
Taylor D. Edmiston 6d31c9e416 [AIRFLOW-2832] Lint and resolve inconsistencies in Markdown files (#3670)
Clean up the Markdown files and make the formatting consistent
2018-08-01 09:50:23 +02:00
Ash Berlin-Taylor d3793c0a50 [AIRFLOW-2238] Update PR tool to push directly to Github 2018-07-30 20:31:39 +02:00
Ash Berlin-Taylor 4484286e49 [AIRFLOW-2238] Flake8 fixes on dev/airflow-pr 2018-07-30 20:31:39 +02:00
Verdan Mahmood 5a7f0b2e53 [AIRFLOW-2691] Manage JS dependencies via npm
Closes #3572 from verdan/AIRFLOW-2691-npm-webpack
2018-07-22 09:24:11 +02:00
Bolke de Bruin a54f74821e [AIRFLOW-XXX] Use .sha512 for signature
As requested by the IPMC
2018-07-13 11:42:41 +02:00
Bolke de Bruin a30f009aeb [AIRFLOW-2287] Update license notices
Closes #3195 from bolkedebruin/AIRFLOW-2287
2018-04-09 00:32:09 -07:00