# Disallow all crawlers access to certain pages. User-agent: * Disallow: /cgi-bin Disallow: /images Disallow: /media Disallow: /wp-admin Disallow: /wp-content Disallow: /wp-images Disallow: /wp-includes