robots.txt you can believe in.

Posted byWaldo Jaquith 1 Comment on robots.txt you can believe in.

Yesterday whitehouse.gov prohibited search engines from indexing 2,400 pages on their site. Today 0 pages are prohibited.

That really says it all about this transition, doesn’t it?

Published by Waldo Jaquith

Waldo Jaquith (JAKE-with) is an open government technologist who lives near Char­lottes­­ville, VA, USA. more »

One reply on “robots.txt you can believe in.”

Comments are closed.