I need to stew about the real issue for a few more days...processing my emotions around this is tough right now.
However, to help break the ice and possibly get me out of my mental funk, I have a question.
Is there, really, any need to have a 'robots.txt' file in this day and age? I just have this gnawing feeling that search engines just don't give a shit.
What do you think?