学步园

在网站根目录下建立robots.txt文件,写入:

User-agent: GoogleBot

Disallow: *

User-agent: googleBot

Disallow: *

User-agent: Baiduspider

Disallow: *

User-agent: baiduspider

Disallow: 

 

User-agent: GoogleBotDisallow: *
User-agent: googleBotDisallow: *

 

User-agent: BaiduspiderDisallow: *
User-agent: baiduspiderDisallow: *