User-agent: * Disallow: /cgi-bin/ Disallow: /scgi-bin/ Disallow: /error/ Disallow: /assets/ Disallow: /redirects/ Disallow: /home.html/ Disallow: /page2.html/ Disallow: /default.html/ Disallow: /page3.html/ Disallow: /page5.html/