This is a recurring post to discuss programming or other technical projects that we've been working on. Tell us about one of your recent projects, either at work or personal projects. What's interesting about it? Are you having trouble with anything?

Edit: I've made some progress if you want to read the edits at the end.

Last year I started slowly planning out a home server setup with help from Tildes. I've gotten a few things up and running, but have been bouncing off a variety of walls trying to get to the next step.

The first goal was-
"Ok i've got Cosmos up and running for local access using self signed certs. I'd like to get it up and running using lets encrypt and a domain so I can eventually start giving a few family and friends proper logins and external access". Of note, ideally,

This led to a second goal of-
"Gosh it sure would be nice if I didn't have to be sitting at the physical server to do testing and could instead be at another computer in my house. I should probably configure ssh locally (working) and get it to forward windows so I can work in other rooms (not working...)"

"The stack":

Server - MS01 running LTS Ubuntu with Cosmos Cloud installed (well it was, but is currently not)

Router - Ubiquiti Dream Machine Pro (of note i've done some minimal guided config of this to try and harden it at a basic level so my cameras and IoT devices are better isolated. Not fully default, but the server is, for now, in the same network/vlan as the rest of my main computers so don't think this should matter.)

Clients - All local windows 10/11 machines for now, although in the off off chance it matters, i'm running nushell in the terminal

Domain Provider - Cloudflare

The SSH Problems:

I have a friend who's set SSH up for themselves with their home server, however they haven't had time to come over and troubleshoot. My rough understanding is "setup VcXsrv, change some configs, then it just works.". Windows these days has ssh built in, and I can SSH to the machine just fine with my key.

ssh -X...less so. I've read some docs, followed some guides, tried copilot, and it all leads to "yeah should work" and it just doesn't. I have configured a ssh config on both machines to allow X11 forwarding, i've started the XLaunch making sure I disable access control, made sure my unbuntu login isn't on wayland and so on. So far, no dice.

If someone has an end to end guide they trust to link, i'll gladly read and start from scratch. I've been cobbling together so many sources at this point i'm very lost. Lots of things jump quickly to "well just use WSL", which yeah ok i probably should test that next, but I was hoping I wouldn't need to (and am unclear if that'll even help).

The HTTPS/Domain Problems:

So..cosmos cloud.

I like the theory behind this software in that it helps enforce best practices so you don't blow your own head off when you screw something up. Maybe it's not the absolute best starting place, but getting it running without a domain was trivial, and more importantly, shockingly well documented. Not perfect, but for what I understand is mostly a one man show it's better than a lot of professional grade stuff i've dealt with.

And so I figured it'd be easy to just do the setup from scratch but choose https and point to my domain. There's been two attempts here, no DNS challenge and DNS challenge

No DNS Challenge Method

Per their docs it seemed easy enough. I'd never touched a DNS screen before but I configured an A record pointing at my WAN IP (eventually...) and disabled the cloudflare proxy.

Well going to that domain took me to my router login. Hmm. After screwing around with port forwarding and router DNS records I never got it to work and felt like I was playing with fire, so undid everything I'd done and decided I'd try the DNS challenge. Of note I could still access the cosmos cloud page from http directly to the IP, where it confirmed it failed to get the TLS cert, but https to the domain wasn't having it.

DNS Challenge Method

This seemed like I was close, and then nothing. I have no idea if i need to do internal routing on the router for this, it just sorta says "Do the DNS challenge, here's a form, you don't need to fill out all of it" which uh...ok.

I filled out what I think I needed to after setting up a token(not an API key) in cloudflare. I'm pretty certain I got that correct as I saw text files with keys created on cloudflare's DNS page and had I screwed that I'm guessing it couldn't have.

However from what I can tell, that's as far as it got. The files nuked themselves 2 minutes later when the TTL expired, and going to the domain locally gave me the cloudflare "our shit's fine, the server is timing out" page. From what I could tell diving into logs, cosmos had the same error, and I couldn't hit cosmos at all, even using the IP and http.

I do however wonder if maybe it did work BUT since I undid the router DNS record before trying this maybe that killed it? dunno.

Any ideas?

That's basically my situation. Figured i'd throw it here and see if anyone has some guidance or troubleshooting they'd recommend. Aforementioned friend who's done some of this before should be free one of these weekends and can probably help, and I haven't tried again since the second attempt. I've thrown some of the questions i've had on the discord and gotten minimal response(although I'm kinda using the thread as a rubber ducking spot as well). Next attempt is probably just DNS challenge again after more research on it and seeing if that works if I put back on the router DNS record, but i feel like logically that shouldn't work.

Oh also if anyone has some general recommended reading so that I can really understand what the hell it is I'm doing I'd love that. There's a ton of networking books/articles/etc, and in general I'd like to learn more about the subject, but I'm curious if there's a go to for people who are techy and trying to dip their toe in all of it the same way I am and setting up a proper home network and server.

Edit:
So after lots of testing, doc reading, and help from the cosmos discord I:

1. Got the DNS challenge to work according to the cosmos logs.
2. narrowed down that the main issue was my UDM pro router policies. Needed a firewall rule and a port forward, and had only done one of those at a time in my various attempts and not realized they were really different.

Now once that was all working and I could hit the site i was getting "likely a false cert" errors, but since i've got all the pieces I'm probably going to try another clean install later and see what we get. Hurrah for troubleshooting, good docs, rubber ducking, and helpful humans.

Pretty much what the title says - I'm building out a smallish compute cluster and hoping to set up some centralised storage that won't be a bottleneck, but I'm very much not a networking specialist. Most of the load will be random reads from compute nodes pulling in the bits of various datasets they need to work on.

Is it plausible to throw a 100GbE ConnectX-5 card and 256GB RAM into a consumer AM5 machine, format everything in ZFS, and set up a network share with KSMBD? My understanding is that I want to ensure everything's using mirroring rather than worrying about RAIDZ parity if I'm optimising for speed, which is fine, and I know that I'll only get full throughput as far as things can be cached in RAM - but is it reasonable to expect ZFS ARC to do that caching for me? Dare I hope that the SMB driver will just work if I drop it in there between the filesystem and the NIC? Or have I crossed the line into enterprisey-enough requirements that it's going to be an uphill battle to get this working anywhere near line speed?

This is a recurring post to discuss programming or other technical projects that we've been working on. Tell us about one of your recent projects, either at work or personal projects. What's interesting about it? Are you having trouble with anything?

The year is 2025. The C programming language is something like 50 years old now - a dinosaur within the fast-moving environment of software development. Dozens of new languages have cropped up through the years, with languages like Rust and Go as prime contenders for systems-level programming. Bootstrapping a project in C these days will often raise eyebrows or encourage people to dismiss you out of hand. Personally, I've barely touched the language since I graduated.

Now, with all that said: I still consider learning and understanding C to be key for having an integrated, in-depth understanding of how computers and programming really works. When I am getting a project up and running, I frequently end up running commands like "sudo apt install libopenssl-dev" without really giving it much thought about what's going on there. I know that it pulls some libraries onto my computer so that another program can use them, but without the requisite experience of building and compiliing a library then it's kind of difficult to understand what it's all about. I know that other languages will introduce this concept, but realistically everything is built to bind to C libraries.

System libraries are only one instance of my argument though. To take a more general view, I would say that learning C helps you better understand computers and programming. It might be a pain to consider stuff like memory allocation and pointers on a regular basis, but I also think that not understanding these subjects can open up avenues for a poorly formed understanding about how computers work. Adding new layers of abstraction does not make the foundation less relevant, and I think that learning C is the best avenue toward an in-depth understanding of how computers actually work. This sort of baseline understanding, even if the language isn't used on a regular basis, goes a long way to improving one's skills as a developer. It also gives people the skills to apply their skills in a wide variety of contexts.

I'm no expert, though: most of the programming I do is very high-level and abstracted from the machine (Python, Haskell, BASH). I'm sure there are plenty of folks here who are better qualified to chime in, so what do you think?

I've never actually put in more fans than what a case comes with, but I have an unraid server that is running hot so I got a pack of 5 fans to put in it.

From what I understand, you want them set up so that there is a solid airflow throughout the case; ie I'm planning to set it up so that the front and bottom fans are intake and the top and back fans are exhaust, so that cool air enters from the front/bottom and exits out the back/top.

However, one of the fans will be going on the side door. I'm assuming this wants to be intake as well (so that the airflow goes through the entire case, as I assume it would disrupt the airflow as exhaust). Or would it be better to not have one on the side and just have an extra fan laying about?

This is how I plan to set it up (shout out to MS Paint): https://ibb.co/KcXx5cgW

Note: The X's are because the installed chassis block being able to put fans there; the bottom one is especially disappointing as it's the HDDs that are mostly getting hot

Just wanted to confirm that that set up looks good and that intake for the side one (where the ? is) is the proper choice

This is a recurring post to discuss programming or other technical projects that we've been working on. Tell us about one of your recent projects, either at work or personal projects. What's interesting about it? Are you having trouble with anything?

This is a recurring post to discuss programming or other technical projects that we've been working on. Tell us about one of your recent projects, either at work or personal projects. What's interesting about it? Are you having trouble with anything?

This is a recurring post to discuss programming or other technical projects that we've been working on. Tell us about one of your recent projects, either at work or personal projects. What's interesting about it? Are you having trouble with anything?

This is a recurring post to discuss programming or other technical projects that we've been working on. Tell us about one of your recent projects, either at work or personal projects. What's interesting about it? Are you having trouble with anything?

So I am attempting to swap phones, but because I am trying to use a pixel 9 xl and it was not previously on my network, I have to wait 40 days to unlock it so I can install GrapheneOS.
I saw on Monday that suddenly there were a lot of photos dated from last Sunday on the phone's default "Photo" app. I have been keeping things to a minimum: I haven't logged into anything Google, and I've only installed F-Droid apps. Also, I had some issues with my desktop and did a clean reinstall 2 weeks ago.

But still disturbingly, my ENTIRE ~/Picture directory (and subdirectories) from my PC were loaded onto my phone.

Now, I'd like to clarify, I do have a few Google accounts, but I have them logged into my desktop with containers on Firefox (particularly, I use one for a current hobby type situation that I have to use, and the other is a 20+ account that I've moved away from, but I still want to monitor).

I want to find out why anything from my PC ended up on this somewhat secluded phone. I have not attached it via USB, and while I have been attempting to limit my connections, I do need to access some of my rl/PC stuff on the phone. But I haven't logged into a google account on it, yet, all my photos showed up on it. I have not plugged it into the computer since I tried putting GrapheneOS on it, which failed due to it not being unlocked (PLEASE CORRECT ME IF I'M WRONG HERE, BECAUSE I STILL HAVE TO WAIT 2 WEEKS!), yet all these pictures that I would have never expected ended up on this phone.

And I just was looking around my ~/ directory, and I saw a directory titled .nuget... I checked pacman (I'm on Arch, so that's my package manager), and it's not installed, but I deleted it because it had a lot of sketch files that ... okay, so I deleted the directory and honestly I don't have it anymore to state what exactly was in it. But I'm really tired and it triggered issues, and I looked and I see that nuget is not installed... so okay, I'm just gonna end this here because I do need to go to bed.

But, would anyone be able to provide any assistance/advice/suggestions on how the heck my phone magically obtained my Linux desktop Picture files?

So I bought my SP3 in '17 as an old-ass student attempting to graduate. It was amazing as I was able to disable most cloudy things (nothing like today with 365 and the general cloud storage), but still use it as a laptop, and finish up my degree. Since then, I've swapped to Linux and wanted to do it too (did it briefly with Ubuntu, but it was still pretty rudimentary back around '19... no touch screen, not even bloaty, was a bit too small of a UI -- can't remember which DM I used, though I know it wasn't xfce which I prefer when I use a DM, though I use i3 on my desktop).
That being said, it seems like there are great options for the Surfaces now, but for newer options. So I wanted to ping y'all and see... have you used Linux on any Surface, and preferably, would like to know for the older version.

I hear Manjaro has gotten a decent option, as I know they have the PinePhone (which I own one but... I haven't had time to mess around with, sadly). I'm not really looking for the touch screen but as it seems the blutooth is dying on the Surface (possibly unrelated or due to the latest Windows update that has borked so much - I have a firewall that prevents/shuts down a lot of Windows "protections" so I may be the culprit but I prefer to think that if I can't do what I want with what I own, the software is the problem), whatever will make it rejuvenate would be appreciated.

Honestly, it's had an awesome battery life (it can be in standby for a week and lose about 1/3 of the battery), and overall, I feel it's the last best thing Windows ever did. That being said... does anyone have a Surface and would you have recommendations (for any Surface)? If so, why, what distro, and what might you want to share?

Thanks in advance!