Fail LocalFilesystemToGCSOperator if src does not exist#22772
Conversation
|
Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution Guide (https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst)
|
…ead of ValueError
|
The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the core of Airflow. If the committers decide that the full tests matrix is needed, they will add the label 'full tests needed'. Then you should rebase to the latest main or amend the last commit of the PR, and push it with --force-with-lease. |
|
Awesome work, congrats on your first merged pull request! |
Fix #22705.
Fail LocalFilesystemToGCSOperator if the src file does not exist
srcargument of LocalFilesystemToGCSOperator accept either list of source file path or a single source file path as a string. In the case of a single source file path we are using glob to parse the file path and glob return empty list if file path does not exist. In the next step, we iterate on this list and call hook api to update the file since the list is empty control is not going inside loop and task is succeeding even if the source file is not available.Change
After this change below task will fail if example-text.txt does not exist
@kaxil @phanikumv