# Change Disallow to this when going to production: # Disallow: /shopflow/ # And remove the Crawl-Delay entry User-agent: * # --- Block internal NetSuite/SCA routes --- Disallow: /app/site Disallow: /cart Disallow: /checkout Disallow: /login Disallow: /register Disallow: /myaccount Disallow: /search Disallow: /wishlist Disallow: /contactus Disallow: /*/newReview Disallow: /Product Management/Product Documents/ Disallow: /*media.nl Disallow: /core/media/ # --- Block query parameters and facets (prevent 404s and duplicates) --- Disallow: /*?* Disallow: /*facet* # --- Block PDFs from indexing --- Disallow: /*.pdf$ # --- Allow core content --- Allow: / # --- Sitemap --- Sitemap: https://www.bobbarker.com/sitemap.xml