• Activity
  • Votes
  • Comments
  • New
  • All activity
  • Showing only topics in ~tech with the tag "data". Back to normal view / Search all groups
    1. Tips for managing a low-storage laptop?

      I bought an M2 Macbook Air at the start of this year for uni. I only planned to use it for uni work as I have another 'more powerful' laptop that I use for everything else, but I kinda love the M2...

      I bought an M2 Macbook Air at the start of this year for uni. I only planned to use it for uni work as I have another 'more powerful' laptop that I use for everything else, but I kinda love the M2 and want to make it my daily driver laptop. Battery lasts for ages, screen is great, it's thin and light, etc. The problem is - as you might guess - I only got the 512GB model and if there's one thing Apple hates, it's people having control over their hardware, so no expandable storage. I can't afford to upgrade the entire laptop, so I need to work with what I have. Here's what I want to use it for:

      • Graphic design: Adobe software, high-res images, typefaces, etc.
      • Music production: Ableton Live 11 Suite, sample packs, plug-ins, project folders, etc.
      • Music library: uncompressed .m4a files because iTunes hates Vorbis 😢, ~80% of my library (I don't have everything downloaded yet) is 25GB.
      • Web-browsing: Firefox... this one isn't really relevant but I feel like I should include it for completeness.

      Does anyone have any tips to stretch this 512GB as faaaaaar as it can go? I have a 2TB external SSD, but I'm wary of keeping anything important on it because it's small and I don't want to accidentally lose a bunch of stuff. I can spend a bit of money (maybe 30usd) if anyone has a good idea that requires buying something, but I can't spend any ludicrous amounts, I already did that to get the laptop!

      15 votes
    2. Data security help - SOC2ish

      Hi Tilderinos, I head up a small startup and we're looking to get some support for our data security. Up until now we've worked with small mom and pops that didn't have any requirements, but a few...

      Hi Tilderinos,

      I head up a small startup and we're looking to get some support for our data security. Up until now we've worked with small mom and pops that didn't have any requirements, but a few of our new clients have full data security teams and our infrastructure and policies/protocols aren't up to snuff. We reached out to a few consulting firms and they quotes us between $80-100k to get things set up and run us through a full SOC2 review. As a small company we don't really have that type of budget, more like $40-50k. I stumbled upon Vanta and Drata as alternatives and had meetings with their sales folks last week. Both of their offerings from setting up our protocols to monitoring and getting us through a SOC2 were only $16k.

      Are platform based companies like Vanta or Drata enough to get us off the ground while we're still getting set up? Has anyone worked with them before and have any feelings one way or the other? Should we be signing on with a security consulting company - be it at a lower rate if we can negotiate it?
      This is all quite new to me and any insight folks here can provide would be incredible useful.

      12 votes
    3. Chrome/Firefox Plugin to locally scrape data from multiple URLs

      As the title suggests, I am looking for a free chrome or firefox plugin that can locally scrape data from multiple URLs. To be a bit more precise, what I mean by it: A free chrome or firefox...

      As the title suggests, I am looking for a free chrome or firefox plugin that can locally scrape data from multiple URLs. To be a bit more precise, what I mean by it:

      • A free chrome or firefox plugin
      • Local scraping: it runs in the browser itself. No cloud computing or "credits" required to run
      • Scrape data: Collects predefined data from certain data fields within a website such as https://www.dastelefonbuch.de/Suche/Test
      • Infinite scroll: to load data that only loads once the browser scrolls down (kind of like in the page I linked above)

      I am not looking into programming my own scraper using python or anything similar. I have found plugins that "kind of" do what I am describing above, and about two weeks ago I found one that pretty much perfectly does what is described ("DataGrab"), but it starts asking to buy credits after running it a few times.

      My own list:

      • DataGrab: Excellent, apart from asking to buy credits after a while
      • SimpleScraper: Excellent, but asks to buy credits pretty much immediately
      • Easy Scraper: Works well for single pages, but no possibility to feed in multiple URLs to crawl
      • Instant Data Scraper: Works well for single pages and infinite scroll pages, but no possibility to feed in multiple URLs to crawl
      • "Data Scraper - Easy Web Scraping" / dataminer.io: Doesn't work well
      • Scrapy.org: Too much programming, but looks quite neat and well documented

      Any suggestions are highly welcome!

      Edit: A locally run executable or cmd-line based program would be fine too, as long as it just needs to be configured (e.g., creating a list of URLs stored in a .txt or .csv file) instead of coded (e.g., coding an infinite scroll function from scratch).

      8 votes