Tag Archives: Tips Index

Hello. I never got all over to posting a robots. txt archive at my site. I hoped to uncover a " exactly how to" discussion these…. also a beneficial discussion about what exactly is best to consist of, what not in adding…. But after hunting for robots, robots. txt, software…. All I can find is a lot of messages saying, " You have to have a robots. txt file! "…. however no instructions…. Except I located this link of hospitality attire discussion: http: //www. robotstxt. org In this article I found these helpful pages: I attempted to adhere to the instructions right now there. Here below may be the result: here is the ENTIRE CONTENTS of an robots. txt file i will post on my site. The intention of this file should be to exclude robots via my image record named PIX. Code: User-agent: * Disallow: /pix/ More disallows might be added. If one example is I also required specifically to disallow robots from my directory page—but NOT from any other page in your WEB-DESIGN-TIPS directory….. then seems like I would make it happen: Code: User-agent: * Disallow: /pix/ Disallow: /web-design-tips/index. shtml Is this correct Perhaps there is anything more … Continue reading →