Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion airflow/providers/airbyte/.latest-doc-only-change.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
1e1b212417e089b43474bc19eec05b654afe98fb
b916b7507921129dc48d6add1bdc4b923b60c9b9
5 changes: 3 additions & 2 deletions airflow/providers/amazon/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -38,9 +38,10 @@ Bug Fixes
* ``AWS DataSync cancel task on exception (#11011) (#16589)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Bump ''sphinxcontrib-spelling'' and minor improvements (#16675)``
* ``Bump sphinxcontrib-spelling and minor improvements (#16675)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/apache/beam/.latest-doc-only-change.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
866a601b76e219b3c043e1dbbc8fb22300866351
b916b7507921129dc48d6add1bdc4b923b60c9b9
Original file line number Diff line number Diff line change
@@ -1 +1 @@
866a601b76e219b3c043e1dbbc8fb22300866351
b916b7507921129dc48d6add1bdc4b923b60c9b9
2 changes: 1 addition & 1 deletion airflow/providers/apache/druid/.latest-doc-only-change.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
866a601b76e219b3c043e1dbbc8fb22300866351
b916b7507921129dc48d6add1bdc4b923b60c9b9
1 change: 1 addition & 0 deletions airflow/providers/apache/hive/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ Features
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/sqoop/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ Bug Fixes
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/cncf/kubernetes/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,7 @@ Bug Fixes
appropriate section above if needed. Do not delete the lines(!):
* ``Updating task dependencies (#16624)``
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/docker/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ using the new parameter to disable mounting the folder.
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/google/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,7 @@ Bug Fixes
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

4.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/jenkins/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ Bug Fixes
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/microsoft/azure/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ Bug Fixes
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

3.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/mysql/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,7 @@ Features
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/postgres/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ Features
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/sftp/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ Features
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Remove redundant logging in SFTP Hook (#16704)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/snowflake/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ Bug Fixes
appropriate section above if needed. Do not delete the lines(!):
* ``Logging and returning info about query execution SnowflakeHook (#15736)``
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/ssh/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ Bug Fixes
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/tableau/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ Features

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):

* ``Prepare documentation for July release of providers. (#17015)``

2.0.0
.....
Expand Down
21 changes: 18 additions & 3 deletions dev/provider_packages/prepare_provider_packages.py
Original file line number Diff line number Diff line change
Expand Up @@ -357,19 +357,34 @@ def get_long_description(provider_package_id: str) -> str:
return long_description


def get_install_requirements(provider_package_id: str) -> List[str]:
def get_install_requirements(provider_package_id: str, version_suffix: str) -> List[str]:
"""
Returns install requirements for the package.

:param provider_package_id: id of the provider package
:param version_suffix: optional version suffix for packages

:return: install requirements of the package
"""
dependencies = PROVIDERS_REQUIREMENTS[provider_package_id]
provider_yaml = get_provider_yaml(provider_package_id)
install_requires = []
if "additional-dependencies" in provider_yaml:
install_requires = provider_yaml['additional-dependencies']
additional_dependencies = provider_yaml['additional-dependencies']
if version_suffix:
# In case we are preparing "rc" or dev0 packages, we should also
# make sure that cross-dependency with Airflow or Airflow Providers will
# contain the version suffix, otherwise we will have conflicting dependencies.
# For example if (in sftp) we have ssh>=2.0.1 and release ssh==2.0.1
# we want to turn this into ssh>=2.0.1.dev0 if we build dev0 version of the packages
# or >=2.0.1rc1 if we build rc1 version of the packages.
for dependency in additional_dependencies:
if dependency.startswith("apache-airflow") and ">=" in dependency:
dependency = dependency + version_suffix
install_requires.append(dependency)
else:
install_requires.extend(additional_dependencies)

install_requires.extend(dependencies)
return install_requires

Expand Down Expand Up @@ -1513,7 +1528,7 @@ def get_provider_jinja_context(
"PROVIDERS_FOLDER": "providers",
"PROVIDER_DESCRIPTION": provider_details.provider_description,
"INSTALL_REQUIREMENTS": get_install_requirements(
provider_package_id=provider_details.provider_package_id
provider_package_id=provider_details.provider_package_id, version_suffix=version_suffix
),
"SETUP_REQUIREMENTS": get_setup_requirements(),
"EXTRAS_REQUIREMENTS": get_package_extras(provider_package_id=provider_details.provider_package_id),
Expand Down
1 change: 1 addition & 0 deletions docs/apache-airflow-providers-amazon/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ Latest change: 2021-07-15
================================================================================================ =========== ===============================================================================
Commit Committed Subject
================================================================================================ =========== ===============================================================================
`b916b7507 <https://github.com/apache/airflow/commit/b916b7507921129dc48d6add1bdc4b923b60c9b9>`_ 2021-07-15 ``Prepare documentation for July release of providers. (#17015)``
`fc0250f1d <https://github.com/apache/airflow/commit/fc0250f1d5c43784f353dbdf4a34089aa96c28e5>`_ 2021-07-15 ``Allow attaching to previously launched task in ECSOperator (#16685)``
`d3f300fba <https://github.com/apache/airflow/commit/d3f300fba8c252cac79a1654fddb91532f44c656>`_ 2021-07-11 ``Fix wrong template_fields_renderers for AWS operators (#16820)``
`f0df184e4 <https://github.com/apache/airflow/commit/f0df184e4db940f7e1b9248b5f5843d494034112>`_ 2021-07-07 ``Update AWS Base hook to use refreshable credentials (#16770) (#16771)``
Expand Down
9 changes: 5 additions & 4 deletions docs/apache-airflow-providers-apache-hive/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,14 +31,15 @@ For high-level changelog, see :doc:`package information including changelog <ind
2.0.1
.....

Latest change: 2021-06-28
Latest change: 2021-07-15

================================================================================================ =========== ==============================================
================================================================================================ =========== =================================================================
Commit Committed Subject
================================================================================================ =========== ==============================================
================================================================================================ =========== =================================================================
`b916b7507 <https://github.com/apache/airflow/commit/b916b7507921129dc48d6add1bdc4b923b60c9b9>`_ 2021-07-15 ``Prepare documentation for July release of providers. (#17015)``
`866a601b7 <https://github.com/apache/airflow/commit/866a601b76e219b3c043e1dbbc8fb22300866351>`_ 2021-06-28 ``Removes pylint from our toolchain (#16682)``
`ce44b6289 <https://github.com/apache/airflow/commit/ce44b628904e4f7480a2c208b5d5e087526408b6>`_ 2021-06-25 ``Add Python 3.9 support (#15515)``
================================================================================================ =========== ==============================================
================================================================================================ =========== =================================================================

2.0.0
.....
Expand Down
9 changes: 5 additions & 4 deletions docs/apache-airflow-providers-apache-sqoop/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,14 +31,15 @@ For high-level changelog, see :doc:`package information including changelog <ind
2.0.1
.....

Latest change: 2021-07-10
Latest change: 2021-07-15

================================================================================================ =========== =============================================================
================================================================================================ =========== =================================================================
Commit Committed Subject
================================================================================================ =========== =============================================================
================================================================================================ =========== =================================================================
`b916b7507 <https://github.com/apache/airflow/commit/b916b7507921129dc48d6add1bdc4b923b60c9b9>`_ 2021-07-15 ``Prepare documentation for July release of providers. (#17015)``
`fc917af8b <https://github.com/apache/airflow/commit/fc917af8b49a914d4404faebbec807679f0626af>`_ 2021-07-10 ``Fix Minor Bugs in Apache Sqoop Hook and Operator (#16350)``
`866a601b7 <https://github.com/apache/airflow/commit/866a601b76e219b3c043e1dbbc8fb22300866351>`_ 2021-06-28 ``Removes pylint from our toolchain (#16682)``
================================================================================================ =========== =============================================================
================================================================================================ =========== =================================================================

2.0.0
.....
Expand Down
3 changes: 2 additions & 1 deletion docs/apache-airflow-providers-cncf-kubernetes/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,11 +31,12 @@ For high-level changelog, see :doc:`package information including changelog <ind
2.0.1
.....

Latest change: 2021-07-11
Latest change: 2021-07-15

================================================================================================ =========== ==========================================================================================
Commit Committed Subject
================================================================================================ =========== ==========================================================================================
`b916b7507 <https://github.com/apache/airflow/commit/b916b7507921129dc48d6add1bdc4b923b60c9b9>`_ 2021-07-15 ``Prepare documentation for July release of providers. (#17015)``
`b2c66e45b <https://github.com/apache/airflow/commit/b2c66e45b7c27d187491ec6a1dd5cc92ac7a1e32>`_ 2021-07-11 ``BugFix: Using 'json' string in template_field causes issue with K8s Operators (#16930)``
`9d6ae609b <https://github.com/apache/airflow/commit/9d6ae609b60449bd274c2f96e72486d73ad2b8f9>`_ 2021-06-28 ``Updating task dependencies (#16624)``
`866a601b7 <https://github.com/apache/airflow/commit/866a601b76e219b3c043e1dbbc8fb22300866351>`_ 2021-06-28 ``Removes pylint from our toolchain (#16682)``
Expand Down
1 change: 1 addition & 0 deletions docs/apache-airflow-providers-docker/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ Latest change: 2021-07-15
================================================================================================ =========== ===============================================================================
Commit Committed Subject
================================================================================================ =========== ===============================================================================
`b916b7507 <https://github.com/apache/airflow/commit/b916b7507921129dc48d6add1bdc4b923b60c9b9>`_ 2021-07-15 ``Prepare documentation for July release of providers. (#17015)``
`bc004151e <https://github.com/apache/airflow/commit/bc004151ed6924ee7bec5d9d047aedb4873806da>`_ 2021-07-15 ``Adds option to disable mounting temporary folder in DockerOperator (#16932)``
`866a601b7 <https://github.com/apache/airflow/commit/866a601b76e219b3c043e1dbbc8fb22300866351>`_ 2021-06-28 ``Removes pylint from our toolchain (#16682)``
================================================================================================ =========== ===============================================================================
Expand Down
9 changes: 5 additions & 4 deletions docs/apache-airflow-providers-google/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -38,15 +38,16 @@ For high-level changelog, see :doc:`package information including changelog <ind
4.1.0
.....

Latest change: 2021-07-13
Latest change: 2021-07-15

================================================================================================ =========== ============================================================
================================================================================================ =========== =================================================================
Commit Committed Subject
================================================================================================ =========== ============================================================
================================================================================================ =========== =================================================================
`b916b7507 <https://github.com/apache/airflow/commit/b916b7507921129dc48d6add1bdc4b923b60c9b9>`_ 2021-07-15 ``Prepare documentation for July release of providers. (#17015)``
`a3f5c9380 <https://github.com/apache/airflow/commit/a3f5c93806258b5ad396a638ba0169eca7f9d065>`_ 2021-07-13 ``Update alias for field_mask in Google Memmcache (#16975)``
`b0f7f91fe <https://github.com/apache/airflow/commit/b0f7f91fe29d1314b71c76de0f11d2dbe81c5c4a>`_ 2021-07-07 ``Standardise dataproc location param to region (#16034)``
`866a601b7 <https://github.com/apache/airflow/commit/866a601b76e219b3c043e1dbbc8fb22300866351>`_ 2021-06-28 ``Removes pylint from our toolchain (#16682)``
================================================================================================ =========== ============================================================
================================================================================================ =========== =================================================================

4.0.0
.....
Expand Down
9 changes: 5 additions & 4 deletions docs/apache-airflow-providers-jenkins/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,14 +31,15 @@ For high-level changelog, see :doc:`package information including changelog <ind
2.0.1
.....

Latest change: 2021-07-13
Latest change: 2021-07-15

================================================================================================ =========== ============================================================
================================================================================================ =========== =================================================================
Commit Committed Subject
================================================================================================ =========== ============================================================
================================================================================================ =========== =================================================================
`b916b7507 <https://github.com/apache/airflow/commit/b916b7507921129dc48d6add1bdc4b923b60c9b9>`_ 2021-07-15 ``Prepare documentation for July release of providers. (#17015)``
`9ff781ad8 <https://github.com/apache/airflow/commit/9ff781ad8fd6b1d8d678227872b642b540b4dc55>`_ 2021-07-13 ``Fixed to check number key from jenkins response (#16963)``
`866a601b7 <https://github.com/apache/airflow/commit/866a601b76e219b3c043e1dbbc8fb22300866351>`_ 2021-06-28 ``Removes pylint from our toolchain (#16682)``
================================================================================================ =========== ============================================================
================================================================================================ =========== =================================================================

2.0.0
.....
Expand Down
3 changes: 2 additions & 1 deletion docs/apache-airflow-providers-microsoft-azure/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,11 +31,12 @@ For high-level changelog, see :doc:`package information including changelog <ind
3.1.0
.....

Latest change: 2021-06-28
Latest change: 2021-07-15

================================================================================================ =========== =============================================================================
Commit Committed Subject
================================================================================================ =========== =============================================================================
`b916b7507 <https://github.com/apache/airflow/commit/b916b7507921129dc48d6add1bdc4b923b60c9b9>`_ 2021-07-15 ``Prepare documentation for July release of providers. (#17015)``
`866a601b7 <https://github.com/apache/airflow/commit/866a601b76e219b3c043e1dbbc8fb22300866351>`_ 2021-06-28 ``Removes pylint from our toolchain (#16682)``
`caf0a8499 <https://github.com/apache/airflow/commit/caf0a8499f6099c943b0dd5054a9480b2e046bf1>`_ 2021-06-25 ``Add support for managed identity in WASB hook (#16628)``
`ffb1fcacf <https://github.com/apache/airflow/commit/ffb1fcacff21c31d7cacfbd843a84208fca38d1e>`_ 2021-06-24 ``Fix multiple issues in Microsoft AzureContainerInstancesOperator (#15634)``
Expand Down
Loading