consul/grecia
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

prevents pages indexation on robots.txt

Browse Source
This commit is contained in:
Alberto Garcia Cabeza
2017-04-21 16:40:16 +02:00
parent 68c5267a78
commit 3d0b7f1034
1 changed files with 7 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
public/robots.txt
View File

@@ -3,3 +3,10 @@
# To ban all spiders from the entire site uncomment the next two lines: # To ban all spiders from the entire site uncomment the next two lines:
# User-agent: * # User-agent: *
# Disallow: / # Disallow: /
Disallow: /users/
Disallow: /comments/
Disallow: /*?*locale
Disallow: /*?*order
Disallow: /*?*search