HTML语言HEAD区元素整理
作者:Alex 日期:2006-03-25
防止网页被搜索的方法
作者:Alex 日期:2006-03-25
这两天搬实验室,没空来打理,竟然惊讶地发现我的刚刚放上外网的BLOG能被BAIDU搜索到了,在感叹BAIDU的强大能力的同时,又感到强烈的不爽,于是想起以前的看过的一个解决办法,不知道BAIDU是否遵循ROBOTS协议
Status of this document
This document represents a consensus on 30 June 1994 on the robots mailing list (robots-request@nexor.co.uk) [Note the Robots mailing list has relocated to WebCrawler. See the Robots pages at WebCrawler for details], between the majority of robot authors and other people with an interest in robots. It has also been open for discussion on the Technical World Wide Web mailing list (www-talk@info.cern.ch). This document is based on a previous working draft under the same title.
It is not an official standard backed by a standards body, or owned by any commercial organisation. It is not enforced by anybody, and there no guarantee that all current and future robots will use it. Consider it a common facility the majority of robot authors offer the WWW community to protect WWW server against unwanted accesses by their robots.
Status of this document
This document represents a consensus on 30 June 1994 on the robots mailing list (robots-request@nexor.co.uk) [Note the Robots mailing list has relocated to WebCrawler. See the Robots pages at WebCrawler for details], between the majority of robot authors and other people with an interest in robots. It has also been open for discussion on the Technical World Wide Web mailing list (www-talk@info.cern.ch). This document is based on a previous working draft under the same title.
It is not an official standard backed by a standards body, or owned by any commercial organisation. It is not enforced by anybody, and there no guarantee that all current and future robots will use it. Consider it a common facility the majority of robot authors offer the WWW community to protect WWW server against unwanted accesses by their robots.
