Add transfer operator S3 to (generic) SQL#28964

Closed

maggesssss wants to merge 71 commits into

apache:mainfrom

maggesssss:feat_s3_to_sql_transfer

Commits on Dec 25, 2022

added JSON linter to connection edit / add UI for field extra. On connection edit screen, existing extra data will be displayed idented
maggesssss
committed

Commits on Jan 15, 2023

Merge branch 'apache:main' into feat_conn_ui
maggesssss
authored
Released new S3 to SQL Transfer Operator Including Documentation and Tests

root
authored and
root
committed
added missing sql_conn_id parameter to example DAG to make it more clear and explicit

root
authored and
root
committed
fixed non-unique task_ids and operator variable names in S3 to Sql example DAG

root
authored and
root
committed

Commits on Jan 18, 2023

Commits on Jan 19, 2023

Commits on Jan 21, 2023

Skip DockerOperator task when it returns a provided exit code (#28996)

hussein-awala
authored and
maggesssss
committed
Clarify that we are using lowest supported version for static checks (#29024)

potiuk
authored and
maggesssss
committed
Update owner list for release dockerhub image workflow (#29023)

pierrejeambrun
authored and
maggesssss
committed
Update how PythonSensor returns values from python_callable (#28932)

SoxMax
authored and
maggesssss
committed
Update gantt chart UI to display queued state of tasks (#28686)

authored and
maggesssss
committed
Patch MockExecutor in tests instead of "prod" code (#29028)

o-nikolas
authored and
maggesssss
committed
Add log for AWS Glue Job Console URL (#28925)

IAL32
authored and
maggesssss
committed
Add norm to triage group (#29029)

jedcunningham
authored and
maggesssss
committed
Fix `project-name` generation for Providers `test-type` in Breeze (#29030)

josh-fell
authored and
maggesssss
committed
Fix params rendering in AzureSynapseHook Python API docs (#29041)

josh-fell
authored and
maggesssss
committed
Pin ruff to specific version and prevent from "fixing" cli conftest (#29040)

potiuk
authored and
maggesssss
committed
Sanitize url_for arguments before they are passed (#29039)

potiuk
authored and
maggesssss
committed
Add support for write_on_empty in BaseSQLToGCSOperator (#28959)

vchiapaikeo
authored and
maggesssss
committed
AIP-44 Initialize methods map for Internal API RPC endpoint in the method (#28841)

mhenc
authored and
maggesssss
committed
uniformize getting hook through cached property in aws sensors (#29001)

vandonr-amz
authored and
maggesssss
committed
Update provide_bucket_name() decorator to handle new conn_type (#28706)

RachitSharma2001
authored and
maggesssss
committed
nice table at the end of system test execs (#29051)

vandonr-amz
authored and
maggesssss
committed
Move project and license docs down in menu to start with developer-focused docs (#28956)

BasPH
authored and
maggesssss
committed
Annotate and simplify code samples in DAGs doc (#29027)

BasPH
authored and
maggesssss
committed
Fix kerberos authentication for the REST API. (#29054)

authored and
maggesssss
committed
Migrate Helm tests to `pytest` (#29063)

Taragolis
authored and
maggesssss
committed
logging poke info when external dag is not none and task_id and task_ids are none (#28097)

surabathini
authored and
maggesssss
committed
AIP-44: Add CLI command for running standalone Internal API (#28425)

mhenc
authored and
maggesssss
committed
Fix pre-commit warning for exclude in inclusive-language check (#29057)

potiuk
authored and
maggesssss
committed
AIP-44 Migrate DagModel.get_paused_dag_ids to Internal API (#28693)

vincbeck
authored and
maggesssss
committed
Renaming nose compatible methods in flavour of regular pytest naming (#29035)

Taragolis
authored and
maggesssss
committed
Capitalize dag to DAG (#29064)

BasPH
authored and
maggesssss
committed
Fix SFTP operator's template fields processing (#29068)

potiuk
authored and
maggesssss
committed
fixing import error for dataset (#29007)

bharat99k
authored and
maggesssss
committed
Properly test that audit log secrets are masked for connection objects (#29011)

ephraimbuddy
authored and
maggesssss
committed
Minor improvements to serde helpers (#28978)

uranusjr
authored and
maggesssss
committed
Add deferrable mode for Big Query Transfer operator (#27833)

MrGeorgeOwl
authored and
maggesssss
committed
Add deferrable mode to DataFusionStartPipelineOperator (#28690)

VladaZakharova
authored and
maggesssss
committed
Fix minor typo in breeze example command. (#29072)

snjypl
authored and
maggesssss
committed
Emit DataDog statsd metrics with metadata tags (#28961)

hussein-awala
authored and
maggesssss
committed
listener plugin example added (#27905)

Bowrna
authored and
maggesssss
committed
Refactor `TestLocalTaskJob.test_process_sigterm_works_with_retries` (#28990)

Taragolis
authored and
maggesssss
committed
Mark `test_process_sigterm_works_with_retries` quarantined again (#29075)

Taragolis
authored and
maggesssss
committed
FTP operator has logic in __init__ (#29073)

snjypl
authored and
maggesssss
committed
Upgrade bitnami/postgresql helm depenency from 10.5.3 to 12.1.9 (#29071)

authored and
maggesssss
committed
Chart: add doc note about podtemplate images (#29032)

Aakcht
authored and
maggesssss
committed
bump (#28602)

DrFaust92
authored and
maggesssss
committed
Check for run_id url param when linking to graph/gantt views (#29066)

bbovenzi
authored and
maggesssss
committed
emit dagrun failed duration when timeout (#29076)

hussein-awala
authored and
maggesssss
committed
Migrate DagFileProcessorManager.clear_nonexistent_import_errors to Internal API (#28976)

snjypl
authored and
maggesssss
committed
save WIP

root
authored and
maggesssss
committed
removed type-hint from property db_hook.
maggesssss
committed
fixed import sorting
maggesssss
committed
added flush() to
maggesssss
committed
removed unneccessary
maggesssss
committed
Merge branch 'apache:main' into feat_s3_to_sql_transfer
maggesssss
authored