User-agent: * # list folders robots are not allowed to index Disallow: /admin/ Disallow: /admin.off/ Disallow: /admin-new/ Disallow: /not_needed/ Disallow: /d/ Disallow: /dbadmin/ Disallow: /include/ Disallow: /secureorder/