Revert airflowctl dependency from airflow-core#68856
Conversation
|
I was actually just reverting #68175. I'm curious why you decided to though @bugraoz93? |
@jedcunningham I have added that replacement as part of core cli towards airflowctl migration/deprecation. Ash raised a concern earlier regarding one of the migration PRs for AIP 94. I added the AIP-94 direction to the last dev meeting to get clarity on core deprecation cycle for 3.3. We discussed the direction and resulted in change in the meeting due to uncertainty about airflowctl adoption. The decision was to keep the warnings only for developers/maintainers to stop developing tagged commands, rather than moving effort to airflowctl the secure way. Closer to v4, we can again discuss layering to user. AIP 94 will be mainly maintainer deprecation and migration tooling. After the meeting notes are released, it will be clearer what was discussed in details. Why were going to revert it? I tested with local breeze hope it wasn't breaking :) |
|
I will resolve the conflicts in the coming hours |
|
Cool. Just for extra context, this is why I was going to revert. We can't just "pick the first" user to attribute calls to - that makes the tracked user in the audit log basically useless. I also have concerns around requiring explicit tokens to be set for non-simple/fab auth manager users. But I never fully formed my argument on that one. Just keep in mind, this change has already been released in FAB. So any redo etc will need to take into account that that helper is in the wild now and really can't be used... |
I should have overlook that part. In my mind we should have create a dummy user and use that with some admin cli tracing. Totally agree, that shouldn't be the case 🤦My bad, thanks Jed for checking in and was going to revert! |
|
cc: @shahar1 @potiuk @vincbeck Edit: Checked and see that we don't even need to create a separate release for Keycloak, as this was the only change for this release. Wanted to get consensus before taking any action |
Restores the previous in-process client for the airflow dags/pools/assets commands, reverting apache#68175 (and removing the auth-manager get_cli_user token support it added). These commands talk to the metadata DB through the local client again, so they no longer require a reachable API server. The maintainer-only deprecated_for_airflowctl marker and its command
2ae57cb to
9fa173b
Compare
Yanking is reserved mostly for catastrophic changes (i.e., provider isn't usable at all, critical security breaches, etc.) - |
Thank a lot Shahar for the comment and help offer! I want to collect your thinking around what we should do about it and raise awareness. These methods arent called from any piece of code neither while only aimed to be used from core 3.3.0. I would be okay with agreed approach. It is not exactly a catastrophic thing for say |
Best way IMO - comment directly on the announcement I sent on users@ and dev@, I think that it should be enough at this point. |
|
My 2c, just don't use |
Many thanks Jed! It will be impossible to make this usable after this in main and, after backporting, in 3-3-test. Unless someone pulls that exact version, overrides their own auth manager calls to use it somehow, and redeploys Airflow with those changes. It won't be usable as an auth manager initialised from the config at deployment time, while calling them outside the running airflow environment doesn't make any sense either |
Backport failed to create: v3-3-test. View the failure log Run detailsNote: As of Merging PRs targeted for Airflow 3.X In matter of doubt please ask in #release-management Slack channel.
You can attempt to backport this manually by running: cherry_picker 6877aea v3-3-testThis should apply the commit to the v3-3-test branch and leave the commit in conflict state marking After you have resolved the conflicts, you can continue the backport process by running: cherry_picker --continueIf you don't have cherry-picker installed, see the installation guide. |
* Not warn user for CLI Deprecations * Update significant to reflect direction * Rename significant to reflect warning changes * Remove not used method docs and remove significant file * Update documentation to explain CLI CTL relation better * Update documentation to explain CLI CTL relation better * Revert routing airflow CLI commands through the airflowctl client Restores the previous in-process client for the airflow dags/pools/assets commands, reverting apache#68175 (and removing the auth-manager get_cli_user token support it added). These commands talk to the metadata DB through the local client again, so they no longer require a reachable API server. The maintainer-only deprecated_for_airflowctl marker and its command * Revert installing airflowctl into airflow core * Add back partition date to test model
cncf.kubernetes (10.18.1) and apache.spark (6.2.0) were excluded from the 2026-06-16 wave after binding -1 votes; their blockers are now resolved, so re-cut the same versions with the fixes folded in. fab and keycloak need corrective patch releases (3.7.1, 0.8.1) after the airflowctl CLI client integration was reverted from core (apache#68856) and a Keycloak access-denied bug fix (apache#68951). celery (3.21.0) adds a Python 3.14 worker start-method config (apache#69015), and google (22.2.1) ships the GKE 401 fix for kubernetes client 36.x (apache#69032).
cncf.kubernetes (10.18.1) and apache.spark (6.2.0) were excluded from the 2026-06-16 wave after binding -1 votes; their blockers are now resolved, so re-cut the same versions with the fixes folded in. fab and keycloak need corrective patch releases (3.7.1, 0.8.1) after the airflowctl CLI client integration was reverted from core (apache#68856) and a Keycloak access-denied bug fix (apache#68951). celery (3.21.0) adds a Python 3.14 worker start-method config (apache#69015), and google (22.2.1) ships the GKE 401 fix for kubernetes client 36.x (apache#69032).
cncf.kubernetes (10.18.1) and apache.spark (6.2.0) were excluded from the 2026-06-16 wave after binding -1 votes; their blockers are now resolved, so re-cut the same versions with the fixes folded in. fab and keycloak need corrective patch releases (3.7.1, 0.8.1) after the airflowctl CLI client integration was reverted from core (#68856) and a Keycloak access-denied bug fix (#68951). celery (3.21.0) adds a Python 3.14 worker start-method config (#69015), and google (22.2.1) ships the GKE 401 fix for kubernetes client 36.x (#69032).
branch-from: #68726, so it should be merged after that. Include those changes. I have created those separately to align.
reverts: #68175 and #64943
Was generative AI tooling used to co-author this PR?
{pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.