Memory Hole Wars: Episode IV – CJ Strikes BackPosted: October 16, 2010
It appears that our recent memory hole series has touched a nerve with CJ, as he has apparently taken the time to block the entire archived history of his website. See for yourself:
We’re sorry, access to http://littlegreenfootballs.com/ has been blocked by the site owner via robots.txt.
In fact, if anyone can find any LGF thread in the archives, let me know.
CJ might have exercised his right to request that his archives be retroactively blocked from view:
Some sites are not available because of Robots.txt or other exclusions.
What does that mean?
The Standard for Robot Exclusion (SRE) is a means by which web site owners can instruct automated systems not to crawl their sites. Web site owners can specify files or directories that are allowed or disallowed from a crawl, and they can even create specific rules for different automated crawlers. All of this information is contained in a file called robots.txt. While robots.txt has been adopted as the universal standard for robot exclusion, compliance with robots.txt is strictly voluntary. In fact most web sites do not have a robots.txt file, and many web crawlers are not programmed to obey the instructions anyway. However, Alexa, the company that crawls the web for the Internet Archive, does respect robots.txt instructions, and even does so retroactively. If a web site owner ever decides he / she prefers not to have a web crawler visiting his / her files and sets up robots.txt on the site, the Alexa crawlers will stop visiting those files and mark all files previously gathered as unavailable. This means that sometimes, while using the Internet Archive Wayback Machine, you may find a site that is unavailable due to robots.txt or other exclusions. Other exclusions? Yes, sometimes a web site owner will contact us directly and ask us to stop crawling or archiving a site. We comply with these requests.
In any case, given the revelation in the thread downstairs, we’re not to assume that this is a coincidence, and that instead we’re being “fucked with“. I guess that I should be embarrassed right now, and just the fact that I’m wasting a thread to mention all this means that I’ve been “got”. Silly me.
So I wouldn’t post this unless there’s an opportunity for a point to be made. I mean, if I’m correct here, the guy decided to hide the entire history of the website’s evolution. Now, even if you wonder about the motivation a bit, this might not seem like that big of a deal, because most people don’t care that much about any one website (especially little design changes).
But remember this is someone who invested countless hours proudly enhancing, programming and generally tweaking the site from scratch almost daily for close to ten years. He periodically dedicates threads to bragging about his code-fu. So it means a little more when, suddenly, after being archived for so many years, all the old looks and styles and logos and drop-down boxes and buttons…how the site came to be as it is today, is gone from public view. If LGF is CJ’s baby, he basically just tossed her photo album in the trash. Out of spite, it would appear.
On paper, this should really be a sad day for the few remaining fans. They would hope that CJ does the right thing and in the spirit of “just fucking with” restores the archives, correct? Mich-again? Killgore? Thanos? Kragar? You can undo it, right?
But “Fucked with”? Shoot, we’re wondering what other crazy things we can get CJ to do. Hey, what if we can get him to delete a whole swath of threads? Like, say, anything with that dhimmitude tag? That’s like 200+ threads right there.