Breeze: Add running Helm Install/Upgrade tests to Breeze

[potiuk]

There are pytests tests for helm chart that can be triggered from the new Breeze (the biggest complexity is to enable runinng them in Paralllel running Pools).

[Bowrna]

@potiuk I am new to k8s / helm chart. Do you think I can pick up this task or Do I need to understand more about Helm to pick this task?

[potiuk]

Not too much. It's more about converting bash parallelism to Python one in this case. It's mostly to rewrite what's being currently run in https://github.com/apache/airflow/blob/main/.github/workflows/ci.yml#L1477 - eventually it's just running a sequence of commands and making sure they are "ok" :)

it does have a good deal of parallelism involved - we are running tests in parallel in self-hosted runners so there is chance to learn a bit about that. I have alreeady impleemented some paralellism and it is WAY simpler in Python than it was in Bash (the bash way is almost incomprehensible even for me :D and Python parallelism how I implemented it is smpler - but it still handles adjusting parallelism level to the number of CPUs available etc.).

You can see how i implemented "pull" in parallel.
Start here:

airflow/dev/breeze/src/airflow_breeze/commands/ci_image_tools.py

Line 248 in 673f894

def pull_image(

I decided that everything that we run evenually in CI will have a corresponding breeze command - this makes everyone's live easier, so in this case we need to have a

breeze run-helm-upgrade-tests command with some options that will allow it to run in paralllel.

[potiuk]

I assigned it to you just in case :)

[Bowrna]

yes i will pick this up :) thanks @potiuk

[potiuk]

This is done now with #25678