Skip to content
This repository has been archived by the owner on Aug 10, 2022. It is now read-only.

Guide for effective use of robots.txt #535

Closed
PaulKinlan opened this issue Jun 24, 2014 · 1 comment
Closed

Guide for effective use of robots.txt #535

PaulKinlan opened this issue Jun 24, 2014 · 1 comment

Comments

@PaulKinlan
Copy link
Contributor

Robots.txt is critical for SEO

might want to mention humans.txt (as a nice aside)

@petele
Copy link
Member

petele commented Sep 27, 2016

I don't believe that this is in scope for WebFundamentals. We should point folks at the Web Master Tools docs.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants