Skip to content

Replacing non-attribute template_fields for BigQueryToMsSqlOperator#19052

Merged
mik-laj merged 2 commits into
apache:mainfrom
josh-fell:bigquerytomssqloperator-template-fields-update
Oct 22, 2021
Merged

Replacing non-attribute template_fields for BigQueryToMsSqlOperator#19052
mik-laj merged 2 commits into
apache:mainfrom
josh-fell:bigquerytomssqloperator-template-fields-update

Conversation

@josh-fell

@josh-fell josh-fell commented Oct 18, 2021

Copy link
Copy Markdown
Contributor

The BigQueryToMsSqlOperator has template_fields values for attributes that do not exist for the operator: dataset_id and table_id. As a result, the following exception is thrown during task execution as reported in #19047:

AttributeError: 'BigQueryToMsSqlOperator' object has no attribute 'dataset_id'

This PR replaces both dataset_id and table_id for source_project_dataset_table in the operator's template_fields. Additionally the corresponding example DAG, example_bigquery_to_mssql, has been updated such that the source_project_dataset_table arg used is a correct, fully-qualified ID to mitigate DAG failure if run.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@josh-fell
josh-fell requested a review from turbaszek as a code owner October 18, 2021 17:36
@boring-cyborg boring-cyborg Bot added area:providers provider:google Google (including GCP) related issues labels Oct 18, 2021
@josh-fell josh-fell changed the title Replacing non-attribute template_fields for BigQueryToMsSqlOperator + related example DAG update Replacing non-attribute template_fields for BigQueryToMsSqlOperator Oct 18, 2021
@josh-fell

Copy link
Copy Markdown
Contributor Author

CC @dudutch

@github-actions github-actions Bot added the okay to merge It's ok to merge this PR as it does not require more tests label Oct 19, 2021
@github-actions

Copy link
Copy Markdown
Contributor

The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the core of Airflow. If the committers decide that the full tests matrix is needed, they will add the label 'full tests needed'. Then you should rebase to the latest main or amend the last commit of the PR, and push it with --force-with-lease.

@mik-laj
mik-laj merged commit d9192a5 into apache:main Oct 22, 2021
@josh-fell
josh-fell deleted the bigquerytomssqloperator-template-fields-update branch October 22, 2021 18:28
sharon2719 pushed a commit to sharon2719/airflow that referenced this pull request Oct 27, 2021
…pache#19052)

* Replacing non-attribute template_fields for BigQueryToMsSqlOperator

* Updating source_project_dataset_table arg in example DAG
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers okay to merge It's ok to merge this PR as it does not require more tests provider:google Google (including GCP) related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants