A few days ago, I posted this and quickly realized that the world of data backups is far richer than just sudo rsync -av --delete --exclude=Videos /home /home_bkup.

So now I'm window shopping the top Linux-supported backup solutions: borg, duplicacy, kopia, restic and--oh look--a core borg dev just dropped his own new-and-improved solution, vykar.

Restic was the first tool I started to research, and I thought I really liked it, got as far as installing, initializing a test repo, creating a couple of snapshots. But restic seems to be, hmm, fussy about the source and destination paths, absolute vs relative paths, etc.

The fact that merely renaming a parent directory (or grandparent, or great-grandparent, etc) causes restic to treat every unchanged byte below that as brand new ... that's a recipe for giant, bloated repos, and it's unacceptable to me ... and hey, lookit that, borg does not do that. So now, restic is out and borg is in.

But what other pros v cons are there, that I haven't even realized need to be considered? What advantages/disadvantages do other apps offer? Which ones can I easily automate with nightly/hourly cron jobs? Which ones have their own even-better automated solutions?

Do I even want encryption? All of my drives/volumes are LUKS encrypted, and anything I would store remotely would also get encrypted before it ever left my LAN ... plus, I'm just a bit nervous about having the backups encrypted, requiring working, functional software to restore/recover data from them....

That may not seem like such a big concern, perhaps, but I am currently working my way thru decrypting a bunch of 10-15 year old TrueCrypt-ed volumes, which requires using an old, outdated version of VeraCrypt and a somewhat "cross-my-fingers" effort to find KeePass repos old enough (also outdated, KeePass 1.0 repos) to still contain the various passwords I used to encrypt those ancient volumes ... but also still use new enough master passwords that I can still get the KeePass repos unlocked.

With rsync, I can literally just go into any backup, find the specific version of the specific file(s) I want to recover, and manually copy it back to my workspace. Is anything like that option available in any of these deduplicated/encrypted solutions, even if they're not encrypted? If (eg) a borg repo is created w/o encryption, the data is still all just borg-specific blobs, right? Or can I navigate into the repo and just manually grab files?

Oh yeah ... for reference, the past 10-ish years, my backup routine has been to create a new, dated, destination folder, starting with a full backup of my /home folder (excluding things like Videos, Music, VMs, other bulky stuff that gets backed up separately/differently), and then running nightly diff backups into the same folder, while also maintaining a "one-day-older" second backup of the whole thing on a 2nd HDD ... then, every 3-6 months, zipping up the current backup folder and starting a new one.

At any rate, there you go; that's the kind of stuff I'm thinking about now, as I overhaul my 20-year-old, 20TB (but could be 2TB) backup system.

Any and all feedback, recommendations, tips are welcome. Danke.

Increasingly I'm looking at my backup solution and I'm not totally happy. My "threat model" I guess is if the house burns down and we only make it out with the shirts on our backs. Alternatively if I get hit by a bus I'd like a backup of passwords and maybe some instructions for my wife.

TL;DR What are decent medium term cold storage options for < 1gb that I can be really sure will be good for several years (maybe 10 or 20 years at the extreme end) and is fairly cheap. I was thinking optical media but I'm kind of lost as to what specifically to get and how to not get conned by buying fake media (m discs). I (somewhat randomly) have an m disc drive in my computer but I don't know if thats overkill or not? My important stuff may even fit on a CD actually...

If you have a flash drive, SSD drive (including NVMe drives), (micro)SD card, or some other popular flash memory media die on you, you might be able to get a free replacement, depending on the manufacturer and the product.

I recently RMA'd a SanDisk microsd card that died unexpectedly. When I looked up their warranty, SanDisk has a lifetime warranty on most of their flash memory products. They even provided a return shipping label. Since they no longer make the card that died, they're sending an upgraded, currently available model.

I've also RMA'd two Kingston NVMe drives. Both of them were getting a bit old, but the RMA was accepted, and in these instances I also received the newer version of the product. I did have to pay for return shipping myself, but it was well worth it.

So if you're about to toss that broken flash media in the trash, double check to see if a warranty applies. It's worth the time and potential shipping cost/hassles in many cases.

EDIT: As one user pointed out, this is not about Apple Music the streaming platform, this is about basically itunes but itunes no longer technically exists as an application.

So a little background: my father just died and a big part of his life was listening to music, for most of his life he's been building themed compilations of songs he liked using whatever medium was available, magnetic reel tapes in the '60s and '70s, then cassette tapes, then CDs, and of course playlists for the last 20 or so years. Now my mother and I would like to back up and save a lot of that work as those compilations have a lot of sentimental value and are pretty unique. There's lots of old obscure rhythm and blues and soul songs that you aren't really going to come across anywhere else. However, it's pretty much all locked into Apple Music, which isn't really a problem in the here and now, because we all have tended to use macs since my mother adopted them in the '80s or '90s. However, we don't really want that data just locked into a private ecosystem that has been getting more and more restricted and where we have less and less control.

So I'm looking for a way to keep those playlists intact and export them out of Apple Music in a playable format and into a less locked in system to then back them up. Most of the music should be DRM free as a lot of it would have been taken off of CDs probably as MP3 files, though a lot of that would've happened 15+ years ago.

Does anyone have any ideas about the best way to do that? I seem to be able to manually export each one into a .txt file but of course it's not really playable sound files. My tech skills are pretty limited, I have about an average amount of knowledge or even slightly more for someone my age (30s) who grew up around computers and the internet but I grew up after it necessary to have basic coding skills to use computers so my experience doing even basic coding or running scripts is pretty much nil. Any ideas would be appreciated.

Edit: it’s version 1.0.6.10

Hey Tilderinos.
I've been looking into buying several flash drives since my largest flash drive is a 32GB sandisk, and I use or interact with all the 3 major OSes, I use Linux on my desktop and on a secondary laptop, I use MacOS on a Macbook and everyone else I know uses Windows(So I'll need an exFAT drive for them).
My recent experience with flash drives though makes me more willing to trust my data to a system's RAM than to a flash drive. At least RAM wouldn't lure me into a false sense of security then spontaneously fail, I know that my data isn't going to last a reboot.
I've got 3 sandisk cruzer blades fail on me, once was an error on my part where I accidentally hit it with my knee while plugged into a device(device unharmed, the drive is dead), one time I upgraded the SSD on my SteamDeck and flashed the steamdeck recovery to an 8GB stick, it worked fine while restoring and it still can be read... it's stuck on read only and, Gparted, Windows formatter, Rufus, Mac's disk utility nor mkfs can make it reusable, I assume it entered read only because it tripped some "whoops I'm dying" thing like some SSDs have(from what I know). The last one is effectively a resistor that connects to a USB port, it heats up, SOMETIMES appears on PC, Linux can open it, copying things into it via Nautilus works albeit very slowly, then when I try to open the root of the flash drive it is stuck perpetually trying to load, when I unplug it and plug it back in again, I can see the folders but entering any of them immediately goes into the permanent loading state, mkdir, cd and ls can work on the drive... intermittently, but I'm treating it as dead.

This leaves me with only 2 other drives, my largest drive, is a 32GB Sandisk Ultra, and my smallest drive which has been more reliable than the Cruzer Blades is a 4GB Sony... USM4GP thing, which I have no idea what year it was from and a quick googling didn't bring up any release date, but it had faster read/write than the cruzer blades, and it's been my main drive for things like installing an OS/burning an image into it yet it lasted all these years.

I'm trying to get a USB-C drive specifically since all my laptops that are in use and my PC have a USB-C port, but all I see in local big retailers are Sandisk, Sandisk and more Sandisk, Amazon however has some that aren't Sandisk.

Does anyone know a USB-C flash drive that is genuinely reliable? Was it specifically Cruzer Blades that is garbage? I've not had a Sandisk SD card fail on me yet, should I just avoid Sandisk for anything but SD cards? Should I just say fuck it and buy a bunch of enclosures and NVMe drives?

I've read that flash drives get bottom of the barrel NAND chips that can't be used on SSDs, too. I know that flash drives aren't meant for long term storage/backup but a drive that old shouldn't be still going on that strongly against new ones.

I've been looking at PNY Elite V3 with USB-C as a connector that I've seen a few listings on Amazon but it's 1TB price is almost the same price as a 1TB NVMe SSD(Though not factoring in the enclosure).

I bought an M2 Macbook Air at the start of this year for uni. I only planned to use it for uni work as I have another 'more powerful' laptop that I use for everything else, but I kinda love the M2 and want to make it my daily driver laptop. Battery lasts for ages, screen is great, it's thin and light, etc. The problem is - as you might guess - I only got the 512GB model and if there's one thing Apple hates, it's people having control over their hardware, so no expandable storage. I can't afford to upgrade the entire laptop, so I need to work with what I have. Here's what I want to use it for:

• Graphic design: Adobe software, high-res images, typefaces, etc.
• Music production: Ableton Live 11 Suite, sample packs, plug-ins, project folders, etc.
• Music library: uncompressed .m4a files because iTunes hates Vorbis 😢, ~80% of my library (I don't have everything downloaded yet) is 25GB.
• Web-browsing: Firefox... this one isn't really relevant but I feel like I should include it for completeness.

Does anyone have any tips to stretch this 512GB as faaaaaar as it can go? I have a 2TB external SSD, but I'm wary of keeping anything important on it because it's small and I don't want to accidentally lose a bunch of stuff. I can spend a bit of money (maybe 30usd) if anyone has a good idea that requires buying something, but I can't spend any ludicrous amounts, I already did that to get the laptop!

I have an external drive (3.5" hdd, SATA) in an enclosure (usb 3) (purchased separately), connected to a thunderbolt dock (OWC) connected alternately to an iMac and a macbook pro. The HDD goes to sleep, and causes problems. Freezes, weird internet access problems, kernel panics.

I have done some research, and can't seem to figure out:

how to know whether it is the drive, enclosure, or computer causing the sleep, although, fiddling with various settings on the mac seemed to have no effect, although it may have increased my battery usage :(

how to adjust settings on the drive, or in the enclosure.

How to determine what the sleep behavior of prospective drives will be.

As a workaround, I tried to write a zsh script to touch the drive ever few seconds. This kinda worked, but was a struggle to figure out appropriate permissions issues and how to make it run automatically.

I welcome all guidance, pointers to resources, clarifications, incantations, well-wishes.

Long story short--I don't want to connect my mac to my iCloud account, but every time I login to my laptop, I get three popups in a row that say "This Mac Can't connect to iCloud because of a problem with [my email] ...".

I can't find a setting that allows me to disable this, and online searches have been fruitless.

Recently, I've been thinking pretty hard about how to archive data. Optical media is out, due to my (possibly irrational?) fear of disc rot. HDDs just break with extended use, SSDs have been known to die with either overuse or just existing for an extended period of time. What's left?

I have heard of tape (of some kind) being used for backup in some bigger operations, but with my experieces with VHS, and to a lesser extent, cassettes, they seem to be very susceptible to mould.

Any suggestions?

I'm talking about this 2 TB LaCie Portable SSD and this Samsung T7 2 TB SSD. They both have the same ~1 GB/s read-write speed, the same 3-year limited warranty, and the same USB 3.2 Gen2 connector. But the LaCie drive is $369, while the Samsung drive is $130.
Am I missing something? Or is it just luxury tax?

I'm looking for mountable remote storage that I can use for my backup solution at home. I'm trying to get set up with backuppc and need to be able to mount a large remote filesystem to store my archives. I've tried renting a 1TB storage box from Hetzner, but my account was rejected (I assume because of a recent legal name change). Can anybody recommend a similar provider of remote storage that I can rent and mount onto my server?

I've got a 2TB Toshiba drive (formatted as NTFS) that has become very slow and I was wondering if anyone here as any ideas what the problem could be and how I could fix it. All the data I'd need off the drive is backed up, but I would at least like a drive to put it back on to!

In short, it became slow after I had to force power-off the system it was connected to (Pop OS installed on another external drive which I unplugged by mistake) and I haven't bothered to try to fix it in the six months since.

I've tested it on Pop and it takes about 10-20 minutes to mount, and 2 minutes to unmount and safely remove. The data itself seems fine but performance is slow, accessing a 20MB image takes several seconds and selecting the drive in GNOME Disks caused it to freeze.

The drive sounded louder than normal, especially after plugging in.

On Windows, the drive was recognised and browsable immediately, but browsing through folders was very slow - opening some folders causes Windows Explorer to freeze for a while. Some of my double-clicks were mis-recognised as click-to-rename, which took several seconds to activate and during which time Task Manager reported the average response time between 5000 and 11000 ms.

Attempting to load an audio file resulted in lots of buffering. Task Manager reports an active time of 100% (even when not loading files or folders) and the activity never exceeded 100 KB/s (and doesn't sustain it for more than a second). Ejecting the drive takes forever - after ejecting it using the tray icon, the tray icon is not removed (even though there are no other drives connected or listed) and the active time is still 100% with the indicator LED blinking non-stop. The system did not enter sleep right away after me asking it to either.

All of that to say, does anyone know what the issue could be, or how I could find and fix it? Thanks!

Edit: fixed and normal functionality restored (at least so I can check the drive a bit easier) using Scan & Repair in Windows (see my comment).

Hi Tildes. Hopefully this thread will be both a good discussion and helpful to some of you, and hopefully me.

As I'm guessing most of you know, data backups are quite important and it is best to have at least one copy locally and another copy somewhere else. At the moment, I store photos on an external hard drive and Google Drive, photos from my phone on Google Photos with copies of important original quality files saved locally, and everything else on drives in my PC and a network drive on my Raspberry Pi. It's far from ideal, I've only got one copy of some files and three or four of some others so I've been looking for something better to keep everything organised, safe and in one place.

I've tried the free trial of Backblaze, which seemed the obvious choice, but it had a few problems. I couldn't backup my Pi's network share, and in general it's a bit clunky and difficult to use. It is marketed as an easy solution to backing up data, but in doing this it just makes everything more difficult, at least for me - I know what I want backed up, and I would prefer to select it manually, but by opting in everything for backup by default you have to spend ages excluding the folders you don't want saved, one-by-one, in a UI that is difficult to use and often unclear. Sometimes the exclusions list just doesn't work - the Program Files folders are meant to be excluded by default and they were listed under exclusions but were backing up anyway. For me it found over 200,000 files, and because they were all so small it barely managed to backup 100MB in three hours. (Not that I know where the files come from because they aren't listed in the Windows app in any vaguely comprehensible way.)

So I need to find something else, and I was hoping someone here would have some recommendations. Personally I need it to:

• Be affordable and easy to setup and use
• Backup external and network drives to the cloud (physically keeping another drive somewhere else isn't an option for me)
• Be trustworthy and have strong commitments to security and privacy
• Work well for my use case: preferably automatic from Windows

Looking forward to any comments or recommendations. Thanks!