[SPARK-56535][BUILD] Fix CI & base image build issues#55432

Open

holdenk wants to merge 46 commits into

apache:branch-3.5from

holdenk:SPARK-56535-fix-base-image-build

Commits on Apr 17, 2026

Move the apt-get installs up and more consistnetnly use APT_INSTALL so that we don't get a partial cache fetch error.

sfc-gh-hkarau
and
holdenk
committed

Commits on Apr 20, 2026

Fall back on install failure of poorely cached apt-get update

sfc-gh-hkarau
and
holdenk
committed
Try and fix the PKGS ref not flowing throw to the ohterside of the ||

sfc-gh-hkarau
and
holdenk
committed
Ok focal is dead dead, lets move to jammy

sfc-gh-hkarau
and
holdenk
committed
Use deadsnakes for Python 3.8

sfc-gh-hkarau
and
holdenk
committed
Ok we need gpg-agent for add-apt-repository?

sfc-gh-hkarau
and
holdenk
committed
Use APT_INSTALL so we don't block forver (mybad)

sfc-gh-hkarau
and
holdenk
committed
Fix aptinstall usage

sfc-gh-hkarau
and
holdenk
committed

Commits on Apr 21, 2026

Use 3.8 pip bootstrap, install 3.9 venv and 3.8 venv support, pin back python packages that don't work in 3.9

sfc-gh-hkarau
and
holdenk
committed

Commits on Apr 22, 2026

Pin back some more

sfc-gh-hkarau
and
holdenk
committed

Commits on Apr 28, 2026

Keep python3.8 but not via pypy3.8 since there's no pandas wheel for it and building from src fails

sfc-gh-hkarau
and
holdenk
committed

Commits on May 1, 2026

While fixing it the pypa pip bootstrap switched to 3.10 oldest version.

sfc-gh-hkarau
and
holdenk
committed

Commits on May 2, 2026

ugh apt-get flakes

sfc-gh-hkarau
and
holdenk
committed

Commits on May 5, 2026

Commits on May 9, 2026

Pin back pandas and plotly to probably supported versions
sfc-gh-hkarau
committed

Commits on May 10, 2026

Change version spec in req file
holdenk
authored

Commits on May 11, 2026

Fix roxygen2 compatibility and improve R/Python code robustness (#20)

holdenk
and
claude
authored

Commits on May 12, 2026

Fix primitive function handling in closure processing (#17)

holdenk
and
claude
authored

Commits on May 13, 2026

RAT issue
sfc-gh-hkarau
committed