# robots.txt for istoedinheiro.com.br # Golden template v1, 2026-11-17. Generated per host: change the template, not this file. # Crawl rules only. Not access control, and not a way to remove pages from an index. Sitemap: https://istoedinheiro.com.br/sitemap_index.xml Sitemap: https://istoedinheiro.com.br/news-sitemap.xml Sitemap: https://istoedinheiro.com.br/video-sitemap.xml # Default group: every crawler without a group of its own below follows these rules. # Google ads crawlers (AdsBot-Google, Mediapartners-Google) ignore this group by design. # Never add a group for a search or ads crawler: a named group replaces this whole group for it. User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /*?s= Disallow: /search/ Disallow: /*?replytocom= Disallow: /tag/*/page/ Allow: /ads.txt Allow: /app-ads.txt # AI crawlers, variant R (restrictive): opt out of AI model training and bulk data collection. # AI search and user-triggered fetchers are not named on purpose, so they follow the default group. User-agent: GPTBot User-agent: ClaudeBot User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: MistralAI-Training User-agent: Amazonbot User-agent: Diffbot Disallow: /