consul/grecia
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

improves seo updating robots.txt

Browse Source
This commit is contained in:
decabeza
2017-05-17 12:49:51 +02:00
parent 780afdbc8f
commit 6dc7afdb50
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
public/robots.txt
View File

@@ -1,9 +1,9 @@
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
# #
# To ban all spiders from the entire site uncomment the next two lines: # To ban all spiders from the entire site uncomment the next two lines:
# User-agent: *
# Disallow: / # Disallow: /
User-agent: *
Disallow: /users/ Disallow: /users/
Disallow: /comments/ Disallow: /comments/