User-agent: * Disallow: */customer/* Disallow: */checkout/* Disallow: /index.php/ Disallow: /*.php$ Disallow: /admin/ Disallow: /core/