8
votes
What programming/technical projects have you been working on?
This is a recurring post to discuss programming or other technical projects that we've been working on. Tell us about one of your recent projects, either at work or personal projects. What's interesting about it? Are you having trouble with anything?
Learning Elixir+Phoenix LiveView for a different project. So far enjoying it. Pattern matching and forced functional+immutable approach is very very different fromy comfort zone (Java, Emacs-Lisp). If anyone knows any good tutorials made in past couple years, I'll really appreciate it. LiveView has changed a lot in past few years and older books/videos have enough differences to be a deterrent. As a beginner videos are useful to get the feel of things, after that I can probably safely move to books (Elixir in Action and LiveView books are pretty good)
I am trying to train a neural net to emulate an expensive computation I have to do in order to speed up some statistical inferences. I have been learning a lot about deep neural nets along the way!
Can you give more info about the computation?
Sure. It is an Einstein-Boltzmann solver which calculates the power spectrum of the cosmic microwave background from a primordial spectrum. Each computation takes around 5 seconds, but I need to do it potentially hundreds of thousands of times for each analysis.
Here's a notebook for working with an audio sample in JavaScript. It's just the basics, but I figured I'd write it down.
I've been playing with Stable Diffusion. Since ideas for prompts will often strike me out of the blue when I'm not at home, I cobbled together a remote-queueing solution using filespooler.
The idea is to run a short script on my laptop that takes the prompt and (optionally) various parameters (e.g. guidance scale, number of images to generate) and then prints a line of JSON with a job description my custom Stable Diffusion-script understands. I then pipe that into filespooler.
The filespooler utility will write it into a queue directory (in my cloud storage), where it sits until I boot up my desktop at home.
Once I am back home, I can run filespooler there and tell it to run all jobs in the queue, which will then generate the images sequentially.
Yes, I could just have appended the JSON to a single file and then manually piped that directly into my Stable Diffusion script, but I wanted an excuse to play with filespooler, so...