xk3's recent activity

  1. Comment on What programming/technical projects have you been working on? in ~comp

    xk3
    (edited )
    Link
    I've been reading a lot about LTO archival. So far I've learned that: tape is kind of a pain. Even if you think that you are storing them correctly, if you don't test your backups regularly, you...

    I've been reading a lot about LTO archival. So far I've learned that:

    • tape is kind of a pain. Even if you think that you are storing them correctly, if you don't test your backups regularly, you might find on the day that you need it that the data is unrestorable.
    • random seeks and specific file retrieval likely doesn't scale well because it adds wear to the expensive tape drives. Although there is likely an "island of stability" here where if you have a few dozen tape libraries and mirror >1GB large chunks in some S3-like system it might work pretty well... assuming you have someone on staff that could repair drives as they fail from extended use.
    • one other thing to think about is that, although some LTO tapes have lasted for more than 30 years this is likely abnormal for most home environments if you live somewhere where the humidity levels are not constant. Another thing to consider is, similar to VHS tapes, there are a lot less VHS players nowadays than 30 years ago... it's still pretty easy to find working LTO-2 drives but LTO-1 drives are already pretty rare. Yes, LTO-2 and LTO-3 drives can read LTO-1 tapes but it is still something to think about...
    • one reason why I didn't really seriously consider LTO-4 ... LTO-7 is that the quantity of tapes needed when operating at a scale where this makes financial sense is that it requires a lot of space. 384 GB of LTO-7 is already 64 tapes and that takes up quite a bit of shelf space. LTO-7 is very similar in price to LTO-8 as well.

    I only have a couple hundred TBs and I'm pretty content now--I'm not looking to extend into the >600 TB range right now so my conclusion is that a tape drive probably doesn't make sense for me right now. But if someone wants to pay me to sign up to USENET and just download stuff then I would invest in a tape library first.

    Other than that I've been researching parallel/cluster compute platforms like HTCondor, Nomad, Triton DataCenter, and other tools listed here: https://github.com/dstdev/awesome-hpc. This week I've started writing something lightweight for spinning up systemd services across PCs (a bit like telefork, Outrun, or Exodus) taking into account (simple polling) resource allocations like %iowait, cpu_idle, available memory and excess network capacity.

    2 votes
  2. Comment on Help with Email & Changing Name Servers/Webhost? in ~comp

    xk3
    Link Parent
    I wrote records not record types. You still very much need SPF information but yes, most DNS information is stored as TXT record types. I hadn't heard of the SPF record type before but SPF records...

    records

    I wrote records not record types. You still very much need SPF information but yes, most DNS information is stored as TXT record types. I hadn't heard of the SPF record type before but SPF records are still very important to email systems

    2 votes
  3. Comment on Help with Email & Changing Name Servers/Webhost? in ~comp

    xk3
    (edited )
    Link
    Aside from MX, you'll need to copy the SPF, DKIM, and DMARC records. As long as both nameservers are serving the same content then there will be no downtime when switching to the new nameservers....

    Aside from MX, you'll need to copy the SPF, DKIM, and DMARC records. As long as both nameservers are serving the same content then there will be no downtime when switching to the new nameservers.

    One thing to note: eg. if you are sending mail from a server like self-hosted wordpress, and you are migrating that to a new server you'll want to switch that over in the SPF record. This might show up as an ip4:169.254.0.0 or something like that, if 169.254.0.0 is the old server IP address then replace that with the new IP address.

    2 votes
  4. Comment on What games have you been playing, and what's your opinion on them? in ~games

    xk3
    Link
    I've been playing Lego Horizon Adventures with the wife and it's been okay so far. It definitely feels like a baby's toy. You mostly walk around and point at stuff with your hands. I think this...

    I've been playing Lego Horizon Adventures with the wife and it's been okay so far. It definitely feels like a baby's toy. You mostly walk around and point at stuff with your hands.

    I think this video review is pretty thorough and I share many of the same thoughts: https://youtu.be/x7-Dc8p9u1s

    The game is trying to do too many things at once. It seems like there's less brick-building compared to the Lego Star Wars games I guess because they're trying to preserve a lot of the game mechanics from Horizon Zero Dawn but they don't want to overwhelm the player with too many interaction points. Overall, it's an interesting experience but the lack of open-world really takes away a lot of the mystique...

    2 votes
  5. Comment on Air France flight 736, December 31st 2020 in ~transport

    xk3
    Link Parent
    Oh for sure, I also think Captain Joe and Admiral Cloudberg are a bit better from the technical perspective and I prefer that. Mentour's are likely more approachable for the average person. I...

    Oh for sure, I also think Captain Joe and Admiral Cloudberg are a bit better from the technical perspective and I prefer that. Mentour's are likely more approachable for the average person. I haven't read/seen coverage on this flight from those or other sources and I liked that he focused on the group psychology aspect in this video.

    I'm a big fan of aviation safety culture and wish more industries were as rigorous, preemptive, and holistic in making processes more efficient and safe. It's amazing to me that we have such in-depth and transparent retrospectives on largely "uneventful" accidents (no injuries).

    3 votes
  6. Comment on Daily driving linux (Fedora KDE) - My experiences after a week in ~tech

    xk3
    Link
    ahh yeah... I switch between different monitor setups (and freerdp / NoMachine) throughout the day and I frequently need to restart plasma: function restartplasma bash -c 'kquitapp6 plasmashell ||...

    ahh yeah... I switch between different monitor setups (and freerdp / NoMachine) throughout the day and I frequently need to restart plasma:

    function restartplasma
        bash -c 'kquitapp6 plasmashell || killall plasmashell; systemd-run --user kstart plasmashell'
        systemd-run --user kwin_x11 --replace
    end
    

    A bit annoying but other than that Linux pretty much stays out of the way and lets me be productive~!

    6 votes
  7. Comment on If our worst fears about Donald Trump play out, how will we know when it's time to leave? in ~society

    xk3
    Link Parent
    well... since slavery was abolished, and even to this day, almost all state and federal adult prisons in the United States have some form of work program, "employing" around 800,000 people. But a...

    a very dark opportunity to create labor camps

    well... since slavery was abolished, and even to this day, almost all state and federal adult prisons in the United States have some form of work program, "employing" around 800,000 people. But a lot of those jobs, even though the pay is criminal, is usually related to prison maintenance (cleaning, food services, etc).

    But you are right that most of those jobs aren't industry jobs (goods and services for the world outside the prison) and Trump's private interests make it seem like this would be the kind of thing he might do under the guise of making the market more free...

    Scary thought! But it takes a while to construct more prisons... and I would say the current 1.8 million people incarcerated is already both a problem and stretching the limits of what is feasible for society.

    There are likely many federal and state laws which would make this difficult for Trump to actually do, for instance:

    private-sector companies are legally obligated to pay prisoners “prevailing wages” in order to avoid undercutting non-prison labor
    https://en.wikipedia.org/wiki/Prison%E2%80%93industrial_complex#Prison_labor

    5 votes
  8. Comment on If our worst fears about Donald Trump play out, how will we know when it's time to leave? in ~society

    xk3
    (edited )
    Link
    By the time you know that it is time to leave it will be, logistically speaking, far past the optimal time to emigrate. If you have a high degree of confidence that the worst will happen, I would...

    By the time you know that it is time to leave it will be, logistically speaking, far past the optimal time to emigrate. If you have a high degree of confidence that the worst will happen, I would leave before the new year.

    We are certainly in for interesting times. My wife's visa was finally approved after 16 months and we just came back to the US last Monday (Nov. 4th). I seem to have poor timing... though I arrived in time to vote.

    I feel like some of these fears are irrational. I hope I'm not wrong. I would never vote for Trump and I am sad that he won but I also feel like it's not the end of the world. I would put it at a 6.5 on the BAD-o-meter. Materially speaking, what are the changes that you fear most?

    edit: For me, one Trump with dementia and PTSD isn't a worry. What worries me is if there are enough incompetent loyalists in his cabinet to misjudge a situation and cause a tragedy.

    25 votes
  9. Comment on Best solution to extract PDF data? in ~comp

    xk3
    Link
    pypdf_table_extraction (formerly camelot) sounds exactly like what you need. I put an example Git-scraping repo here:...
    2 votes
  10. Comment on What programming/technical projects have you been working on? in ~comp

    xk3
    Link Parent
    It looks like there are two separate mechanisms that work on all plans (including free). I'm curious if you could have 5 people via 2 tailnets able to access a shared machine on the free plan by...

    The tools for adding multiple people to the same tailnet are for organizations, not for you

    It looks like there are two separate mechanisms that work on all plans (including free). I'm curious if you could have 5 people via 2 tailnets able to access a shared machine on the free plan by combining both strategies:

  11. Comment on What programming/technical projects have you been working on? in ~comp

    xk3
    (edited )
    Link
    I've futzed with WireGuard for a few hours a couple years ago but wasn't able to get it to do what I wanted. I think the main problem was that I didn't have IP forwarding enabled and firewalld was...

    I've futzed with WireGuard for a few hours a couple years ago but wasn't able to get it to do what I wanted. I think the main problem was that I didn't have IP forwarding enabled and firewalld was also blocking me but I didn't know that back then.

    Recently, I tried tailscale and it's been pretty great! Not bad for a free service... their revenue play seems to be similar to CloudFlare so I'm not too worried about relying on it--in the worst case, I could swap out the server with Headscale which is a bit more setup but seems like a good alternative.

    Now that my computers are setup as exit nodes it's very easy to "VPN" via computers that I own (faster and more reliable than OpenVPN, etc). I've started using Fedora IoT which is the atomic version of Fedora Server. It comes with greenboot which will automatically rollback any updates that bring down services (like the tailscale client daemon). Overall, it's been fun to use. I'm pretty impressed with it and I'm more confident in auto-updates now.

    3 votes
  12. Comment on Seeking an Android podcast app without subscription. Impossible? in ~tech

    xk3
    Link Parent
    I got used to using yt-dlp for everything when building on a wrapper for it. And then one day I discovered it could be used for podcasts and other sources too. Because I was already familiar with...

    I got used to using yt-dlp for everything when building on a wrapper for it. And then one day I discovered it could be used for podcasts and other sources too.

    Because I was already familiar with yt-dlp and it was already working for me so I've never really investigated podcast apps specifically. The audio files are available locally on the phone and they auto-resume fine. The only issue I've had is when Google Podcasts closed and I had to swap out a few links with other sources.

  13. Comment on Seeking an Android podcast app without subscription. Impossible? in ~tech

    xk3
    Link
    I know you specifically mentioned a desire for an app but I'll just quickly mention what I do. yt-dlp works with RSS feeds or things that appear like them. The Generic extractor is rather good....

    I know you specifically mentioned a desire for an app but I'll just quickly mention what I do.

    yt-dlp works with RSS feeds or things that appear like them. The Generic extractor is rather good. You can install it in Termux and run a list of URLs on a cron script in your phone via cronie. I guess if you don't use Termux often you'll also need Termux:Boot for cronie to work and download new episodes on a schedule

    7 votes
  14. Comment on Recruiting help for election day posters in ~creative

    xk3
    Link
    I don't think any of those phrases will really help to change people's minds except for maybe the first one. I'm not sure what your sign should say but maybe focus on dispelling the myth of...

    I don't think any of those phrases will really help to change people's minds except for maybe the first one.

    I'm not sure what your sign should say but maybe focus on dispelling the myth of bothsidesism rather than something incendiary

    maybe the sign could say "Obamacare is Medicare" or something like that. I think that's a good entry-point and a common misconception that people have

    7 votes
  15. Comment on What the hell is a Typescript or: Creation ideas above my skill level in ~tech

    xk3
    Link
    All mature programs have incidental complexity which is built up over time as edge cases are discovered and patched around. There is no perfect programming language but some languages make this...

    All mature programs have incidental complexity which is built up over time as edge cases are discovered and patched around.

    There is no perfect programming language but some languages make this incidental complexity more hidden via language implementation, packages, classes or modules; and some languages are very verbose.

    Types can help but really there is a lot of overlap with unit tests. Whether you write your code twice as types or as tests it doesn't really matter that much. But I would say types are more useful in compiled languages because typing is more strict and you are more likely to be forced to write types that fit all of your input specifications.

    But the most important thing when learning something new is to have a comfortable environment with short feedback loops. You can use vitest on backend code--I'm not sure what the best js/ts dev tools are for node but I have found vitest much better than jest

    2 votes
  16. Comment on Billions in election bets are raising the stakes in the US presidential race in ~society

    xk3
    (edited )
    Link Parent
    A lot of Americans don't have strong opinions (30% of the population fails to vote!) and choose people who they think will win so they can feel like they are on the winning team. Makes them feel good

    if their candidate

    A lot of Americans don't have strong opinions (30% of the population fails to vote!) and choose people who they think will win so they can feel like they are on the winning team. Makes them feel good

    1 vote
  17. Comment on The Playstation 2 "Emotion Engine" was worthy of the hype in ~games

    xk3
    (edited )
    Link
    I'm halfway through this series on Architecture of Consoles: https://www.copetti.org/writings/consoles/ It has been really enjoyable! To be honest, I don't play many video games but it is...

    I'm halfway through this series on Architecture of Consoles:

    https://www.copetti.org/writings/consoles/

    It has been really enjoyable! To be honest, I don't play many video games but it is fascinating to see how hardware engineers and system programmers were able to stretch their creativity to the limits of 1980s / 1990s electronic manufacturing capabilities.

    9 votes
  18. Comment on Billions in election bets are raising the stakes in the US presidential race in ~society

    xk3
    (edited )
    Link Parent
    viewed by whom? I have no doubts that the prediction markets of 2010 compared to 2020 are wholly different. The majority of these people are not integrative-thinking super-forecasters but more and...

    viewed as an alternative or complement to traditional polling

    viewed by whom? I have no doubts that the prediction markets of 2010 compared to 2020 are wholly different. The majority of these people are not integrative-thinking super-forecasters but more and more tending toward sports-enthusiast horse-betting crypto-bros who always have a Polymarket browser tab open. Not that these two groups of people are mutually exclusive...

    edit: Also, this is another point to consider: https://www.reuters.com/world/us/large-bets-election-prediction-market-are-overseas-source-says-2024-10-18/ I know at least 3 Hong Kong people who have no real ties with the US but have spent a significant amount of money (>$2K USD) on these markets. Their news sources are mostly wallstreetbets and lihkg

    Polymarket does not allow Americans to make U.S. election bets on the exchange

    Ah wait... so they are all foreign people or at least the "large traders"? If people see these "polls" and it influences their vote, how is it not foreign election interference?

    14 votes
  19. Comment on What programming/technical projects have you been working on? in ~comp

    xk3
    Link
    Taking some inspiration from Spanish writer and watchmaking enthusiast Javier Gutiérrez Chamorro, the past couple days I added a small wrapper script around a couple of my existing FFmpeg and...

    Taking some inspiration from Spanish writer and watchmaking enthusiast Javier Gutiérrez Chamorro, the past couple days I added a small wrapper script around a couple of my existing FFmpeg and ImageMagick wrapper scripts. This will skip files that are unlikely to be reduced much more and it starts with files with the most bloat first:

    $ pip install xklb
    $ library fsadd --video video.db ~/Videos/
    $ library shrink --invalid --no-valid video.db --delete-unplayable
    media_key    current_size    future_size    savings    processing_time
    -----------  --------------  -------------  ---------  -----------------------
    Video: ts    65.2 GiB        37.3 GiB       28.0 GiB   2 days and 14 hours
    Video: vob   59.3 GiB        33.9 GiB       25.4 GiB   2 days and 8 hours
    Video: m2ts  13.2 GiB        7.6 GiB        5.7 GiB    12 hours and 32 minutes
    Video: mp4   4.9 GiB         2.8 GiB        2.1 GiB    4 hours and 37 minutes
    Video: mkv   29.3 MiB        16.7 MiB       12.6 MiB   4 minutes and 6 seconds
    Video: dat   1.5 MiB         879.9 KiB      659.9 KiB  6 seconds
    
    Estimated processing time: 5 days and 15 hours
    Estimated savings: 61.2 GiB
    Proceed? [y/n] (n): 
    

    And I plan to add support for a few more things like turning table data into Zstd compressed Parquet, image heavy PDFs into AVIF, and text PDFs into ePUB (or maybe markdown+extracted image AVIF)

    1 vote