Python 3.8 deprecation

[jacob-willden]

The installation instructions for MacOS state to install Python 3.8, but Python 3.8 officially reached its end of life on October 7, 2024 and is disabled in Homebrew. Has grab-site been tested with Python 3.9 or newer yet?

[exurd]

google-re2 now requires Python 3.9 (as of a few weeks ago: google/re2#559). This causes grab-site to fail being installed on 3.8. We will have to switch to 3.9 as soon as possible to fix this issue.

[exurd]

We will have to switch to 3.9 as soon as possible to fix this issue.

Actually, scratch that; Python 3.9 is going to be EOL this October... Upgrading this program to use 3.11+ would be the best move here.

[ngie-eign]

The best thing you can do for the time being is probably use python 3.8 from a container, e.g., using https://github.com/Nold360/docker-grab-site .
I'm trying to update to 3.13, but it's turning into a "give a mouse a cookie" / onion-peeling scenario.

[exurd]

While that Docker image does work, it was last updated 5 years ago; it uses grab-site 2.1.18 (and Python 3.7!). It also cannot be built from the Dockerfile (the same re2 issue as above).

[ngie-eign]

Issue opened for updating ludios_wpull: ArchiveTeam/ludios_wpull#36 . Once that change is merged I'll open up the PR to update the software pins (it seems to just work out of the box).

[ngie-eign]

Here's my PR to update the software pins to versions that support python 3.13: #249 . It seems to work so far, but I've been doing mostly happy path testing and haven't looked too deep at the code to make sure that everything is functioning properly.

[mikebdp2]

Using uv tool for a native installation on Artix Linux (Arch without SystemD) I have not encountered any significant "Python 3.8" issues other than this one - #250 (already fixed, see details) . Native installation - if it works - is always better than a containers hassle. By the way, for conveniently "viewing" a captured website, https://github.com/webrecorder/pywb tool could be used - and it also works almost fine, although I had to install https://github.com/StdCarrot/Py3AMF instead of a regular pyamf aimed on a Python 2 😁