Introduction to Genetic Algorithms

Genetic algorithms can be used to solve problems that are difficult, or impossible to solve with traditional algorithms. Much like neural networks, they provide good-enough solution in short amount of time, but rarely find the best one. While they're not as popular as neural networks nor as widely used, they still have their place, as we can use them to solve complicated problems very fast, without expensive training rigs and with no knowledge of math.

Genetic algorithms can be used for variety of tasks, for example for determining the best radio antenna shape, aerodynamic shapes of cars and planes, wind mill shapes, or various queing problems. We'll use it to print "Hello, World!".

How does it work?

Genetic algorithm works in three steps.

1. Generate random solutions
2. Test how good they are
3. Pick the best ones, breed and mutate them, go to step 2

It works just like evolution in nature. First, we generate randomised solutions to our problem (in this case: random strings of letters).

Then, we test each solution and give it points, where better solutions gain more points. In our problem, we would give one point for each correct letter in the string.

Afterwards, we pick the best solutions and breed it together (just combine the strings). It's not bad idea to mutate (or randomize) the string a bit.

We collect the offsprings, and repeat the process until we find good enough solution.

Generate random solutions

First of all, we need to decide in which form we will encode our solutions. In this case, it will be simply string. If we wanted to build race cars, we would encode each solution (each car) as array of numbers, where first number would be size of the first wheel, the second number would be size of the second wheel, etc. If we wanted to build animals that try to find food, fight and survive, we would choose a decision tree (something like this).

So let's start and make few solutions, or entities. One hundred should be enough.

from random import randint

goal = "Hello, World!"
allowed_characters = list("qwertyuiopasdfghjklzxcvbnmQWERTYUIOPASDFGHJKLZXCVBNM ,!")

def get_random_entity(n, string_length):
    entities = []
    for _ in range(0, n):
        entity = ""
        for _ in range(0, string_length):
            entity += allowed_characters[randint(0, len(allowed_characters)-1)]
        entities.append(entity)
    return entities

print(get_random_entity(100, 13))

Test how good they are

This is called a "fitness function". Fitness function determines how good a solution is, be it a car (travel distance), animal (food gathered), or a string (number of correct letters).

The most simple function we can use right now will simply count correct letters. If we wanted, we could make something like Levenshtein distance instead.

def get_fitness(entity):
    points = 0
    for i in range(0, len(entity)):
        if goal[i] == entity[i]:
            points += 1
    return points

Crossover and mutation

Now it's time to select the best ones and throw away the less fortunate entities. Let's order entities by their fitness.

Crossover is a process, when we take two entities (strings) and breed them to create new one. For example, we could just give the offspring one part from one parent and another part from second parent.

There are many ways how to do this, and I encourage you to try multiple approaches when you will be doing something like this.

P:  AAAABBB|BCCCC
P:  DDDDEEE|FGGGG

F1: AAAABBB|FGGGG

Or we can just choose at random which letter will go from which parent, which works the best here. After we have the offsprint (F1), we should mutate it. What if we were unfortunate, and H (which we need for our Hello, World!) was not in any of the 100 entities? So we take the string and for each character of the string, there is a small chance to mutate it - change it at random.

F1:  ADDDEBEFGCGG
F1`: ADHDEBEFGCGG

And it's done. Now kill certain part of old population. I don't know which percentage is best, but I usually kill about 90% of old population. The 90% that we killed will be replaced by new offsprings.

There is just one more thing: which entities do we select for crossover? It isn't bad idea - and it generally works just fine - to just give better entities higher chance to breed.

def get_offspring(first_parent, second_parent, mutation_chance):
    new_entity = ""
    for i in range(0, len(first_parent)):
        if randint(0, 100) < mutation_chance:
            new_entity += allowed_characters[randint(0, len(allowed_characters)-1)]
        else:
            if randint(0, 1) == 0:
                new_entity += first_parent[i]
            else:
                new_entity += second_parent[i]
    return new_entity

When we add everything together, we get this output:

Generation 1, best score: 2 ::: QxZPjoptHfNgX
Generation 2, best score: 3 ::: XeNlTOQuAZjuZ
Generation 3, best score: 4 ::: weolTSQuoZjuK
Generation 4, best score: 5 ::: weTgnC uobNdJ
Generation 5, best score: 6 ::: weTvny uobldb
Generation 6, best score: 6 ::: HellSy mYbZdC
Generation 7, best score: 7 ::: selOoXBWoAKn!
Generation 8, best score: 8 ::: HeTloSoWYZlh!
Generation 9, best score: 8 ::: sellpX WobKd!
Generation 10, best score: 9 ::: welloq WobSdb
Generation 11, best score: 9 ::: selloc WoZjd!
Generation 12, best score: 10 ::: wellxX WoVld!
Generation 13, best score: 10 ::: welltX World!
Generation 14, best score: 10 ::: welltX World!
Generation 15, best score: 10 ::: welltX World!
Generation 16, best score: 11 ::: zellov Wobld!
Generation 17, best score: 11 ::: Hellty World!
Generation 18, best score: 11 ::: welloX World!
Generation 19, best score: 11 ::: welloX World!
Generation 20, best score: 11 ::: welloX World!
Generation 21, best score: 12 ::: welloX World!
Generation 22, best score: 12 ::: Helloy World!
Generation 23, best score: 12 ::: Helloy World!
Generation 24, best score: 12 ::: Helloy World!
Generation 25, best score: 12 ::: Helloy World!
Generation 26, best score: 12 ::: Helloy World!
Generation 27, best score: 12 ::: Helloy World!
Generation 28, best score: 12 ::: Helloy World!
Generation 29, best score: 12 ::: Helloy World!
Generation 30, best score: 12 ::: Helloy World!
Generation 31, best score: 12 ::: Helloy World!
Generation 32, best score: 12 ::: Helloy World!
Generation 33, best score: 12 ::: Helloy World!
Generation 34, best score: 13 ::: Helloy World!
Generation 35, best score: 13 ::: Hello, World!

As we can see, we find pretty good solution very fast, but it takes very long to find perfect solution. The complete code is here.

Maintaining diversity

When we solve difficult problems, it starts to be increasingly important to maintain diversity. When all your entities are basically the same (which happened in this example), it's difficult to find other solutions than those that are almost the same as the currently best one. There might be a much better solution, but we didn't find it, because all solutions that are different to currently best one are discarded. Solving this is the real challenge of genetic algorithms. One of the ideas is to boost diverse solutions in fitness function. So for every solution, we compute distance to the current best solutions and add bonus points for distance from it.

There are, sadly, far too many people and companies out there more than willing to take advantage of people. Fortunately, awareness is usually a good defense. What are some scams that we should all know about so that we don't fall for them?

Here's a list of a things that came out in this past week, up through Friday. Of course, there's no way to be completely comprehensive with this and I avoided including things where information was too lacking, so feel free to mention anything that isn't on here that you think is worth mentioning. Beyond that, if you have any thoughts of any of these albums, it would be great to hear them :)

Notes:
If you spot any mistakes, let us know.
Parental Advisory version of all albums linked (so NSFW).

Ghostemane & Parv0 - Human Err0r | Song.link says Single but is actually EP.
Idris Elba Presents: The YARDIE Mixtape | No song.link. Can't find anywhere. Linked his record label's official soundcloud, since that's where the other Idris Elba Presents are located, so I assume this one will show up there eventually too.

Thank you to @Cleb, @cfabbro, and @Bauke!

I personally usually heavily mod my games, due to finding the process of modding itself fun, along with me preferring to spend a LONG time at one run through.

As an example, I'd give minecraft where I usually play so-called expert packs, which are basically taking a lot of mods and making them depend on each other for progression.

I just moved into a new apartment, and am using a 32" tv in the living room. The TV is already way too small, but I'd rather prioritize spending on the speakers first.

I thought I could live with the TV speakers, but have quickly realized that they have made watching movies impossible. The dialogue is impossible to hear without cranking up the volume. And then if there is anything other than dialogue, it's way too loud.

The walls in the apartment are fairly thin, so I'm pretty sure a subwoofer is out of the question. So I was looking at soundbars but keep seeing conflicting advice. There are articles like this that make them sound fine, yet when you go to place like /r/hometheater, everyone despises them.

So my next step was to look at powered bookshelf speakers. They seemed like a pretty good option, until I went to best buy to listen to them. I'm not sure if they just weren't set up properly or what, but none of them sounded that great. Especially when compared to the tower speakers they had.

So now I'm at a loss. Should I go with a soundbar, bookshelf, or tower speakers? My budget is under $500.

So, I am far from the most experienced, or the most knowledgeable, or the most active amateur radio operator out there, but it is something that has piqued my interest none the less. Before I got into the hobby, I always assumed that the FCC just game amateurs a small bucket of useless spectrum and that was it. Maybe you could fly an RC plane, but surely that is about as cool as it gets.

It turns out I was dead wrong. Amateurs are allocated bands all across the RF spectrum - more or less. Bands from way below the AM broadcast frequency to way above the microwave frequencies used by our cell phones and wireless routers. Also, you are allowed to legally transmit at up to 1.5 kilowatts of power! That's 3,000 times as much power as your average walkie talkie! :) Also, importantly, the license exam only costs $15.

At many of the lower frequencies, the signals bounce off the ionosphere and you can make contact with people all over the world (propagation gods permitting). At the higher frequencies, you lose that "skip propagation," but more bandwidth is available. There are analog voice repeater networks, digital packet networks, mesh networks running on modified commercial WiFi gear, and even a handful of old school packet BBSes. There are some LEO satellites which run voice repeaters which allow you make international contacts, and sometimes even the International Space Station will participate in events. Lots of cool stuff going on. This hobby is kind of a bottomless rabbit hole of possibilities.

I got my technician license about a year ago, and I have been most interested in the data networking end of the hobby. Despite being a pile of hacks, APRS is still very cool, and sometime soon I hope to set up an AREDN node of my own. Every once in a while I'll call into the local repeaters and shoot the breeze.

So there's my story. Are there any other hams out there?