Updated robots.txt + new htaccess files.
I made the following changes for the robots.txt and .htaccess files.
# robots.txt updated
- Allow theme assets (CSS, JS, Images, Fonts) for SEO
- Allow folder with uploaded images (/content/images)
# .httaccess files added
- /content - Deny all
- /content/images - Allow only jpg|png|gif
- /cache - Deny all
- /system - Deny all
- /system/admin/editor - Allow all
- /system/resources - Allow all
- /themes - Deny all
- /themes/blog/css - Allow all
- /themes/blog/fonts - Allow all
- /themes/blog/images - Allow all
- /themes/blog/js - Allow all
- /themes/clean/css - Allow all
- /themes/default/css - Allow all
- /themes\default\img - Allow all
- /themes\logs\css - Allow all
Andreas
Danang Probo Sayekti