Does anyone have experience with tools for locally archiving the web, like Archivebox for example?

Archivebox is great but I wouldn't rely on it, at least not in the current release state.

In its current state, I've had issues with zombie chromium instances stacking up during archive jobs and slowing my server down to an unresponsive halt and requiring me to do a hard restart.

The project's dev, Pirate, is pretty fast and loose with the codebase. Pushing broken and WIP code to the main repo branch instead of creating feature branches as he works on things, so don't try and jump the gun and run :dev to see if a given issue has been fixed. I learned this the hard way. :\

With all of that said, it's a neat system and it's easy to pop up using their docker container. For now though, I would just follow the project on github so you can get emails as Pirate pushes RC releases so you can see how the project is progressing and when the eventual 0.8.4 release goes live. He's been swapping out a lot of the inner workings so a lot of the user grievances should be remedied.

https://github.com/gildas-lormeau/SingleFile

I use SingleFile to occasionally create local copies of web pages I want to save. It's designed to work well even on JavaScript-heavy websites, and captures a copy of the page as you are currently viewing it, from inside the browser. I'm pretty sure it has a setting to automatically archive every page you visit, with additional options for excluding specific domains from automatic capture, and more. I don't use any of that though.

It also has the ability to capture multiple tabs at the same time, which is incredibly useful.

And when I say SingleFile "captures a copy of the page from inside the browser", what I mean is this:

If I go to https://www.reddit.com, I see the same old interface as if I went to https://old.reddit.com, because in my account's settings I have disabled the new UI.

If I were to use ArchiveBox, cURL, or Wget to get a copy of reddit.com, it would by-default return a copy of the frontpage with the new UI and me logged out, because those tools don't pass login information or cookies by-default. SingleFile does. If I save a tab using SingleFile, it saves it exactly like I'm looking at. No futzing around with cookies.

It also has a command-line version.

I don't use it heavily (and probably should use it more), but I run an install of Linkwarden and it's pretty slick.

It's more of a bookmarking app that also takes offline versions of the pages you add. So if you're intending to pull multiple pages from one site, archivebox may be a better fit.

But if this meets your needs, it has an iOS app now, which is useful.

There are some similar selfhosted apps in this space, like Wallabag. Linkwarden is my favorite to date, though.

I'm hosting my own Archivebox instance but it's not really a Archive.org clone I wish it was. It's nice to take snapshots of things I don't wanna lose, but Archive.org is way more advanced in what they do. I still dream of a proper self-hosted Internet Archive.

Sometimes I also crawl and copy some websites with wget, you can try that to see how it goes. Something like this:

wget --wait=2 \
     --level=inf \
	 --limit-rate=20K \
	 --recursive \
	 --page-requisites \
	 --user-agent=Mozilla \
	 --no-parent \
	 --convert-links \
	 --adjust-extension \
	 --no-clobber \
	 -e robots=off \
	 https://example.com

More info here: https://simpleit.rocks/linux/how-to-download-a-website-with-wget-the-right-way/

I can tell you that I tried a whole bunch of things recently after a few years out of the game lol, and it turns out that index.html will not get you very far in 2024; so much of any site's functionality is happening on Someone Else's Computer (thanks The Cloud), so you'll end up with some giant .js blobs that don't do much on their own, typically... if there's another way pls someone tell me what it is!

httrack is really good. its used for making an "offline web."