What the White House doesn’t want you to google

by robopanda

http://www.democrats.org/blog/display/00010130.html

“someone at the White House added virtually all of the directories with “Iraq” in them to its robots.txt file, meaning that search engines would no longer list those pages in results or archive them.
[. . .]
“It’s easy enough to understand the reasoning if you look at past White House actions. Earlier this year, the White House revised pages on its website claiming that “combat” was over in Iraq, changing them to say “major combat.”
One of the reasons some alert readers noticed the change — and were able to prove it — was that Google had archived the pages before the change occurred. Now that all of the White House pages about Iraq are no longer archived by Google, such historical revisionism will be harder to catch.”

You can make the argument that the above is just democrat propaganda (it is their website after all), but here is the actual robots.txt at the official whitehouse site. You can see for yourself what’s been disallowed:

http://www.whitehouse.gov/robots.txt

Advertisements