# Allow all search engines to crawl the entire site User-agent: * Allow: / # Optional: Disallow specific pages or directories # Disallow: /private/ (Uncomment this line if you want to block specific paths) # Disallow: /example-page.html