User-agent: * 
Disallow: /admin/
Disallow: /pages/
Disallow: /components/
Disallow: /js/
Disallow: /images/
Disallow: /config/