kiduc
/
bibiuc.com
1
0
Fork 0
Code Issues 0 Pull Requests 0 Projects 0 Releases 59 Wiki Activity
Browse Source

Robots.txt update + new htaccess for cache folder. 

Updated robots.txt + new htaccess files.

I made the following changes for the robots.txt and .htaccess files.

# robots.txt updated
- Allow theme assets (CSS, JS, Images, Fonts) for SEO
- Allow folder with uploaded images (/content/images)

# .httaccess files added
- /content - Deny all
- /content/images - Allow only jpg|png|gif
- /cache - Deny all
- /system - Deny all
- /system/admin/editor - Allow all
- /system/resources - Allow all
- /themes - Deny all
- /themes/blog/css - Allow all
- /themes/blog/fonts - Allow all
- /themes/blog/images - Allow all
- /themes/blog/js - Allow all
- /themes/clean/css - Allow all
- /themes/default/css  - Allow all
- /themes\default\img - Allow all
- /themes\logs\css - Allow all
pull/192/head
Andreas 10 years ago
parent
b2aef582f5
commit
80afb162d9
16 changed files with 35 additions and 4 deletions
Unified View
Diff Options
Show Stats Download Patch File Download Diff File
  1. +1
    -0
      cache/.htaccess
  2. +1
    -0
      content/.htaccess
  3. +4
    -0
      content/images/.htaccess
  4. +17
    -4
      robots.txt
  5. +1
    -0
      system/.htaccess
  6. +1
    -0
      system/admin/editor/.htaccess
  7. +1
    -0
      system/resources/.htaccess
  8. +1
    -0
      themes/.htaccess
  9. +1
    -0
      themes/blog/css/.htaccess
  10. +1
    -0
      themes/blog/fonts/.htaccess
  11. +1
    -0
      themes/blog/images/.htaccess
  12. +1
    -0
      themes/blog/js/.htaccess
  13. +1
    -0
      themes/clean/css/.htaccess
  14. +1
    -0
      themes/default/css/.htaccess
  15. +1
    -0
      themes/default/img/.htaccess
  16. +1
    -0
      themes/logs/css/.htaccess

+ 1
- 0
cache/.htaccess View File

@ -0,0 +1 @@
deny from all

+ 1
- 0
content/.htaccess View File

@ -0,0 +1 @@
deny from all

+ 4
- 0
content/images/.htaccess View File

@ -0,0 +1,4 @@
Deny from all
<Files ~ "\.(jpg|png|gif)$">
Allow from all
</Files>

+ 17
- 4
robots.txt View File

@ -17,17 +17,30 @@
# http://www.sxw.org.uk/computing/robots/check.html # http://www.sxw.org.uk/computing/robots/check.html
User-agent: * User-agent: *
# Directories
# Disallow directories
Disallow: /config/ Disallow: /config/
Disallow: /system/ Disallow: /system/
Disallow: /themes/ Disallow: /themes/
Disallow: /vendor/ Disallow: /vendor/
Disallow: /cache/ Disallow: /cache/
# Files
# Disallow files
Disallow: /changelog.txt Disallow: /changelog.txt
Disallow: /composer.json Disallow: /composer.json
Disallow: /composer.lock Disallow: /composer.lock
Disallow: /composer.phar Disallow: /composer.phar
# Paths
# Disallow paths
Disallow: /search/ Disallow: /search/
Disallow: /admin/
Disallow: /admin/
# Allow themes
Allow: /themes/*/css/
Allow: /themes/*/images/
Allow: /themes/*/img/
Allow: /themes/*/js/
Allow: /themes/*/fonts/
Allow: /content/images/*.jpg
Allow: /content/images/*.png
Allow: /content/images/*.gif

+ 1
- 0
system/.htaccess View File

@ -0,0 +1 @@
deny from all

+ 1
- 0
system/admin/editor/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
system/resources/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
themes/.htaccess View File

@ -0,0 +1 @@
deny from all

+ 1
- 0
themes/blog/css/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
themes/blog/fonts/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
themes/blog/images/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
themes/blog/js/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
themes/clean/css/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
themes/default/css/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
themes/default/img/.htaccess View File

@ -0,0 +1 @@
allow from all

+ 1
- 0
themes/logs/css/.htaccess View File

@ -0,0 +1 @@
allow from all

Write Preview
Loading…
Cancel
Save