Skip to content

Switch to non-interactive mode where stdin is disabled#47568

Merged
jscheffl merged 2 commits into
apache:mainfrom
boschglobal:bugfix/fix-unstable-xcom-upload
Mar 12, 2025
Merged

Switch to non-interactive mode where stdin is disabled#47568
jscheffl merged 2 commits into
apache:mainfrom
boschglobal:bugfix/fix-unstable-xcom-upload

Conversation

@majorosdonat

@majorosdonat majorosdonat commented Mar 10, 2025

Copy link
Copy Markdown
Contributor

Xcom upload is not stable when using kubernetes stream in interactive mode. Looks like its an issue in the kubernetes client library. switched to non-interactive mode where stdin is disabled as suggested in the open issue thread.

Fixes: #39267


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@bugraoz93 bugraoz93 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please check the tests? Seems some mocks now behaving differently.

TypeError: the JSON object must be str, bytes or bytearray, not MagicMock

@jscheffl

Copy link
Copy Markdown
Contributor

Note: failed test also failing on main - AWS failures in CI are un-related to the PR.

@bugraoz93 bugraoz93 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for updating the test! Looks good. Rebase would be amazing!

@potiuk

potiuk commented Mar 12, 2025

Copy link
Copy Markdown
Member

Yep. Rebase would be great.

@jscheffl jscheffl force-pushed the bugfix/fix-unstable-xcom-upload branch from af2d846 to 0ae4676 Compare March 12, 2025 20:53
@jscheffl jscheffl merged commit 6994f1f into apache:main Mar 12, 2025
agupta01 pushed a commit to agupta01/airflow that referenced this pull request Mar 13, 2025
* Switch to non-interactive mode where stdin is disabled

* fix tests

---------

Co-authored-by: Majoros Donat (XC-DX/EET2-Bp) <donat.majoros2@hu.bosch.com>
nailo2c pushed a commit to nailo2c/airflow that referenced this pull request Apr 4, 2025
* Switch to non-interactive mode where stdin is disabled

* fix tests

---------

Co-authored-by: Majoros Donat (XC-DX/EET2-Bp) <donat.majoros2@hu.bosch.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers provider:cncf-kubernetes Kubernetes (k8s) provider related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Intermittent json errors from xcom sidecar

4 participants