Whitehouse robots.txt
A robots.txt file on a web site instructs search engines to ignore certain pages. Basically, this is a list of web pages on whitehouse.gov that they don’t want search engines to keep a record of.
A robots.txt file on a web site instructs search engines to ignore certain pages. Basically, this is a list of web pages on whitehouse.gov that they don’t want search engines to keep a record of.
This entry was posted on Wednesday, September 5th, 2007 at 12:51 pm and is tagged as: internet. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.
moonbuggy is proudly powered by WordPress. Site by h0st.com.au.
Entries (RSS) and Comments (RSS). 77 queries. 0.107 seconds.