Give Access to AdSense Crawler in your robots.txt file

If you’ve modified your site’s robots.txt file to disallow the AdSense crawler from indexing your pages, then AdSense is not able to serve Google ads on these pages. To update your robots.txt file to grant AdSense crawler access to your pages, remove the following two lines of text from your robots.txt file: User-agent: Mediapartners-GoogleDisallow: / This change will allow AdSense … Read more

How to Fix AdSense Crawler Issues

Making sure your site is fully crawlable can help you earn more revenue from your content. If the AdSense ads crawler can’t access your content, refer to the following list of crawler issues to help you fix the problem.  Access issues Possible reason What to check How to fix Your site is behind a login.It’s possible that … Read more