Skip to content

Check if we need to upgrade deps before rebuilding everything#15033

Merged
ashb merged 1 commit into
apache:masterfrom
astronomer:rebuild-deps-when-setup-files-changed
Mar 26, 2021
Merged

Check if we need to upgrade deps before rebuilding everything#15033
ashb merged 1 commit into
apache:masterfrom
astronomer:rebuild-deps-when-setup-files-changed

Conversation

@ashb

@ashb ashb commented Mar 26, 2021

Copy link
Copy Markdown
Member

Due to the order of checkes in selective_ci_checks.sh, we were never
eagerly upgrading deps on a Pull Reuqest, because we exited before
getting to check_if_setup_files_changed.

Previoulsy the output was this

Get changed files
Check if everything should be run

  Changed files matching the ^.github/workflows/|^Dockerfile|^scripts|^setup.py|^setup.cfg pattern:

  Dockerfile
  Dockerfile.ci
  setup.py

  Important environment files changed. Running everything
  ...
  image-build=true
  upgrade-to-newer-dependencies=false

And then it exited. By simply changing the order we set the right flag
first and then exit.

Due to the order of checkes in selective_ci_checks.sh, we were never
eagerly upgrading deps on a Pull Reuqest, because we exited before
getting to `check_if_setup_files_changed`.

Previoulsy the output was this

```
Get changed files
Check if everything should be run

  Changed files matching the ^.github/workflows/|^Dockerfile|^scripts|^setup.py|^setup.cfg pattern:

  Dockerfile
  Dockerfile.ci
  setup.py

  Important environment files changed. Running everything
  ...
  image-build=true
  upgrade-to-newer-dependencies=false
```

And then it exited. By simply changing the order we set the right flag
_first_ and then exit.
@github-actions

Copy link
Copy Markdown
Contributor

The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk. If they don't merge it quickly - please rebase it to the latest master at your convenience, or amend the last commit of the PR, and push it with --force-with-lease.

@github-actions github-actions Bot added the full tests needed We need to run full set of tests for this PR to merge label Mar 26, 2021
@ashb ashb merged commit c5cc018 into apache:master Mar 26, 2021
@ashb ashb deleted the rebuild-deps-when-setup-files-changed branch March 26, 2021 17:07
@ashb

ashb commented Mar 26, 2021

Copy link
Copy Markdown
Member Author

upgrade-to-newer-dependencies=7ccd99dd62c1c0ef31b80b4f01a78c408573b133

Yup, this is working now https://github.com/apache/airflow/runs/2203798051?check_suite_focus=true

@potiuk

potiuk commented Mar 26, 2021

Copy link
Copy Markdown
Member

Oh yeah 🤦

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants