[Packaging][CentOS] Drop support for CentOS Stream 8

[kou]

Describe the enhancement requested

It will reach EOL on 2024-05-31:

https://www.centos.org/centos-stream/

End-of-life

2024-05-31 (end of RHEL 8 Full Support Phase)

Component(s)

Packaging

[ianmcook]

To minimize disruption to some of our customers, Voltron Data is interested to contribute resources to maintain CentOS Stream 8 in the CI and release verification matrix for the time being. Does this present any practical problems?

Also see the similar comment about CentOS 7 here: #41395 (comment)

[kou]

It seems that mirrors of CentOS Stream 8 are disabled:

https://github.com/ursacomputing/crossbow/actions/runs/9414082872/job/25932189688#step:8:107

#6 [2/2] RUN   quiet=$([ "yes" = "yes" ] || echo "--quiet") &&   dnf install -y ${quiet} epel-release &&   dnf install --enablerepo=powertools -y ${quiet}     bison     boost-devel     brotli-devel     bzip2-devel     c-ares-devel     ccache     clang     cmake     curl-devel     flex     gcc-c++     gflags-devel     git     glog-devel     gobject-introspection-devel     json-devel     libarchive     libzstd-devel     llvm-devel     llvm-static     lz4-devel     make     ncurses-devel     ninja-build     openssl-devel     pkg-config     python39     python39-pip     re2-devel     rapidjson-devel     rpmdevtools     snappy-devel     tar     thrift-devel     vala     which     zlib-devel &&   dnf clean ${quiet} all
#6 0.427 CentOS Stream 8 - AppStream                     445  B/s |  38  B     00:00    
#6 0.432 Error: Failed to download metadata for repo 'appstream': Cannot prepare internal mirrorlist: No URLs in mirrorlist

It seems that we can solve this by using vault.centos.org:

--- /etc/yum.repos.d/CentOS-Stream-AppStream.repo.orig	2024-06-08 21:37:55.259885642 +0000
+++ /etc/yum.repos.d/CentOS-Stream-AppStream.repo	2024-06-08 21:37:49.171850804 +0000
@@ -10,8 +10,7 @@
 
 [appstream]
 name=CentOS Stream $releasever - AppStream
-mirrorlist=http://mirrorlist.centos.org/?release=$stream&arch=$basearch&repo=AppStream&infra=$infra
-#baseurl=http://mirror.centos.org/$contentdir/$stream/AppStream/$basearch/os/
+baseurl=http://vault.centos.org/$contentdir/$stream/AppStream/$basearch/os/
 gpgcheck=1
 enabled=1
 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial

[amoeba]

I'm looking into doing the above over in #42128.

[amoeba]

Now that #42129 is merged, the original task in this issue to drop support for Centos Stream 8 can now be considered on hold for the time being. I think we can and should leave this issue open for visibility though.

[raulcd]

We did drop support for CentOS 8 here:

• [Packaging] Drop support for CentOS Stream 8 #46952

This can be closed, right? @kou

Should we open a different issue to drop support for AlmaLinux 8 too?
https://wiki.almalinux.org/release-notes/#almalinux-os-8

From the AlmaLinux page:

Version 8 will have active support until 31 May 2024, and security support until 31 May 2029.

I am trying to drop support for Python 3.9 and I see that AlmaLinux packages are 3.9, otherwise I'll have to install Python manually and was wondering if we should just remove support.

[kou]

Oh, sorry. I created a duplicated issue...

Let's close this.

Should we open a different issue to drop support for AlmaLinux 8 too?

Ah, yes. Let's discuss this in the different issue.

In my opinion, we can keep AlmaLinux 8 support until it reaches end of security support. But if we find a problem caused by old packages (e.g. C++20 support/C++23 support may cause a problem), we'll drop support for AlmaLinux 8 before end of security support.

I am trying to drop support for Python 3.9 and I see that AlmaLinux packages are 3.9, otherwise I'll have to install Python manually and was wondering if we should just remove support.

We're using Python only for Meson and gi-docgen for Apache Arrow C GLib. AlmaLinux 8 also provides Python 3.11 and Python 3.12. So we can switch to newer Python when it's needed:

diff --git a/dev/tasks/linux-packages/apache-arrow/yum/almalinux-8/Dockerfile b/dev/tasks/linux-packages/apache-arrow/yum/almalinux-8/Dockerfile
index 3198a1641a..acafdcbddf 100644
--- a/dev/tasks/linux-packages/apache-arrow/yum/almalinux-8/Dockerfile
+++ b/dev/tasks/linux-packages/apache-arrow/yum/almalinux-8/Dockerfile
@@ -51,8 +51,8 @@ RUN \
     ninja-build \
     openssl-devel \
     pkg-config \
-    python39 \
-    python39-pip \
+    python3.12 \
+    python3.12-pip \
     re2-devel \
     # rapidjson-devel \
     rpmdevtools \