# Crawlers Setup User-Agent: Baiduspider Disallow: / User-Agent: CazoodleBot Disallow: / User-Agent: Fasterfox Disallow: / User-Agent: Jyxobot Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: ShopWiki Disallow: / # Directories User-agent: * Disallow: /catalog_assembly_site_bookmark/assemblage_bookmarks/* Disallow: /cart_catalog_assembly/* Disallow: /catalog_assembly/assemblages/share/* Disallow: /catalog/products/read/* Disallow: /*/page/read/* Disallow: /*/product_contact_form/question/* Disallow: /cdn-cgi/* # Sitemap Sitemap: https://gamepc.nl/sitemap.xml