User-agent: * Disallow: /scripts/ Disallow: /merchant/ Disallow: /checkout/ Disallow: /404.asp