Taluntain
Fri, 29th Oct '04, 11:26pm
http://www.whitehouse.gov/robots.txt
I thought some of you might appreciate this one. For the uninitiated, the robots.txt file at the root of a site is used to tell web crawlers (content gatherers for search engines) which areas of a site they can't crawl and save in their cache.
If you scroll down the mile long list there, you'll see that the Bush administration has disallowed web crawlers from crawling pretty much every single web page put up during Bush's reign. Which basically means that, as there are no records of those pages in any of the search engines, that the Bush administration can edit all those pages to "correct" anything Bush ever said, or anything that's ever been written there, without there being any evidence anywhere that they did it.
The truth is out there - but not at http://www.whitehouse.gov
I thought some of you might appreciate this one. For the uninitiated, the robots.txt file at the root of a site is used to tell web crawlers (content gatherers for search engines) which areas of a site they can't crawl and save in their cache.
If you scroll down the mile long list there, you'll see that the Bush administration has disallowed web crawlers from crawling pretty much every single web page put up during Bush's reign. Which basically means that, as there are no records of those pages in any of the search engines, that the Bush administration can edit all those pages to "correct" anything Bush ever said, or anything that's ever been written there, without there being any evidence anywhere that they did it.
The truth is out there - but not at http://www.whitehouse.gov