# === AI / LLM crawlers toestaan === User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Amazonbot Allow: / # Uitsluiten van PDF-bestanden van indexering User-agent: * Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /admin/ Disallow: /dashboard/ Disallow: /?s= Disallow: /search/ Disallow: /bedankt/ Disallow: /thank-you/ Disallow: /checkout/ Disallow: /order-confirmation/ Disallow: /*?sort= Disallow: /*?filter= Disallow: /*?page= Disallow: /*?variant= Disallow: /test/ Disallow: /staging/ Disallow: /beta/ Disallow: /private/ Disallow: /tmp/ Disallow: /config/ Disallow: /scripts/ Disallow: /*.php$ Disallow: /*.zip$ Disallow: /*.sql$ Disallow: /tag/ Disallow: /category/ # Extra uitsluitingen zoals gevraagd: Disallow: /fryslan/ Disallow: /haccp/ Disallow: /app/ Disallow: /mindspace/ Disallow: /Inhuren/ Disallow: /info/ Disallow: /klantportaal Disallow: /klantportaal(.*) Disallow: /LOCATIE(.*) Disallow: /stocksysteem-admin/ Disallow: /bereidingswijze/ Disallow: /recept-voorraad/ Disallow: /mobile-contact/ Disallow: /event/ Disallow: /datum/ Disallow: /datum-keuze/ Disallow: /zoek-product/ Disallow: /todo/ Disallow: /quick-stock/ Disallow: /update-stock/ Disallow: /upload-foto/ Disallow: /upload-foto-event/ Disallow: /contact-2/ Disallow: /auto/ Disallow: /MEP/ Disallow: /mep/ Disallow: /mep-chef/ Disallow: /uithalen/ Disallow: /kerst-catering-bestellen-lunch-brunch-en-buffet-lpad/ Disallow: /ingredient-voorraad/ # Blokkeer alles met 'klantportaal' in de URL Disallow: /*klantportaal* Disallow: /*.pdf$ User-agent: Pinterestbot # Uitsluiten van URL's met het woord "klantportaal" van indexering Disallow: /*klantportaal/ Sitemap: https://www.happiedelivery.nl/sitemap_index.xml