SqlToS3Operator

[JavierLopezT]

Recently, all the Sql-related (mysql, postgres...) operators were merged into one. Applying the same, would be great to have a single SqlToS3Operator, so that you don't have to use MySqlToS3Operator, RedshiftToS3Operator, SnowflakeToS3Operator...

[manesioz]

Recently, all the Sql-related (mysql, postgres...) operators were merged into one

Where is this? When looking for it I still ran into separate MySQL/PostgreSQL/etc db operations/hooks.

[akocukcu]

Recently, all the Sql-related (mysql, postgres...) operators were merged into one

Where is this? When looking for it I still ran into separate MySQL/PostgreSQL/etc db operations/hooks.

Hi @manesioz ,
I think for the sql to sql transfer there is => GenericTransfer

and for the hook there is => DbApiHook

Btw the name GenericTransfer is a little bit general 😊 Maybe GenericSqlTransfer would be more clear.

Anyway, I would like to work on this issue if you think this is still needed @JavierLopezT .

[JavierLopezT]

Recently, all the Sql-related (mysql, postgres...) operators were merged into one

Where is this? When looking for it I still ran into separate MySQL/PostgreSQL/etc db operations/hooks.

Hi @manesioz ,
I think for the sql to sql transfer there is => GenericTransfer

and for the hook there is => DbApiHook

Btw the name GenericTransfer is a little bit general 😊 Maybe GenericSqlTransfer would be more clear.

Anyway, I would like to work on this issue if you think this is still needed @JavierLopezT .

Actually, I was referring to this operator:
https://github.com/apache/airflow/blob/master/airflow/operators/sql.py

And yeah, I think it is totally worth it to have this feature, so it would be great if you start working on it.

PS: sorry @manesioz for not answering you, I didn't realize

[akocukcu]

@JavierLopezT Great :) I can also give the option to select an available file format (such as parquet, json, excel ...)
As I see, right now there is only csv option for MySqlToS3Operator.
I would like to work on this. Sorry to disturb you @mik-laj .But could you assign it to me please 🐱

[eladkal]

@akocukcu assigned to you

[samuelkhtu]

@akocukcu just wondering how's going with the SqlToS3Operator? Let me know if anything I can help with.

[akocukcu]

Hi @samuelkhtu . There were some personal obstacles. But I am working on it again.

[samuelkhtu]

@akocukcu of course. Let me know if anything I can help with. Thanks.