Can not deploy bundle, azure cli auth issue

[johnayoub]

Describe the issue

Created a default bundle using the CLI but the deployment doesn't succeed. The files are deployed but it fails to create the job

Configuration

Create basic bundle using the default CLI template.

Steps to reproduce the behavior

1. Run databricks bundle deploy --profile DEFAULT

Expected Behavior

Bundle files and job to be deployed and created

Actual Behavior

Only the files are deployed, job creation fails due to authentication issue

OS and CLI version

Windows 10, cli version 0.209.1

Is this a regression?

Not sure

[andrewnester]

@johnayoub as the error suggests could you try to run az login before running bundle deploy and see if it helps to resolve the issue?

[johnayoub]

@andrewnester Yes, I have logged in successfully many times but it still throws the above error. Interesting enough the files were deployed to the workspace so it must have authenticated but for some reason it fails with the above error.

[andrewnester]

@johnayoub thanks for the update! could you please try and see if this command returns an error for you?

az account get-access-token --output json --resource https://management.azure.com/

[johnayoub]

@andrewnester yes command works. Attached screenshot

[andrewnester]

Thank you! I removed the screenshot as it contains sensitive information, even though sligtly redacted :)
I'll take a closer look why the error might happen.
In the meantime, could you try to rerun databricks bundle deploy command with --log-level DEBUG flag and post the output here?
Thank you!

[johnayoub]

@andrewnester thanks! I redacted where possible. Feel free to delete as well once you download :)
bundle_deploy.txt

[andrewnester]

Thank you @johnayoub for the detailed information. One more thing to help me troubleshoot: could you please share how your DEFAULT profile look like in your ~/.databrickscfg file. I'm just interested in the config attributes (aka config keys) you have there, so please redact any sensitive values from there. Thank you!

[johnayoub]

@andrewnester sure, I tried both with and without the workspace resource id. FYI, I used the python SDK to login to test the default profile and it worked without any issues.

[DEFAULT]
host = [HOST]
azure_workspace_resource_id = [WORKSPACE_ID]

[andrewnester]

@johnayoub a few more questions: if you run databricks bundle deploy --profile DEFAULT does azure_workspace_resource_id in your databricks profile matches the one you see in the error message as on screenshot?

Also, do you use any custom bash terminal to run the command?

[johnayoub]

@andrewnester Yes, the azure_workspace_resource_id matches.

No, I'm just using default powershell core terminal.