User-agent: * Disallow: /index.asp Disallow: /404.htm Disallow: /404.html