Many panicked when receiving the message, perhaps assuming that this meant that their site had a serious issue to correct or was in trouble with Google. After receiving notifications from Google for my own sites as well as some of our clients, I decided to investigate the issue further.
That’s not to say Google won’t punish sites for not adhering to their guideline and allowing the crawl of JS/CSS files. Rather, it appears that Google is simply warning webmasters that their sites aren’t complying and that, if they continue to not comply, they may see lower rankings. In other words: get your site compliant BEFORE Google starts punishing you.
How you resolve this issue will depend on your site’s platform, though generally speaking, it will require some editing of the robots.txt file for your site. For instance, sites built on the WordPress platform that receive this warning from Google tend to have their /wp-includes/ folder blocked by robots.txt. In this case, you’ll need to edit the robots.txt file to remove the line blocking /wp-includes/. The robots.txt file is usually in the root directory of your website.
When looking at your robots.txt file, look for any of the following lines of code:
Or anything that mentions Disallow: /wp-includes/, /wp-admin/ or similar.
Then simply remove those lines, save the robots.txt file, and upload the new file to your site.Another reported solution is to add the following lines to the robots.txt file:
Allow: *.js# global
Disallow: /wp-includes/Then save the file and upload it to your site.
From there, run the Google Fetch and Render Tool here. The tool should return no errors, which signals that Googlebot can fully access your site. If the tool does return an error, simply follow Google's instructions for resolving it.
As with many Google SEO warnings, it's important to resolve the problem quickly to avoid any negative consequences—such as a drop in rankings. Get your site compliant now by editing your robots.txt file as needed. As always, though, if you’re stuck or just have questions, SimpleTiger is here to help.
Sean is Chief Operating Officer at SimpleTiger, responsible for operations, process creation, team utilization and growth, as well as sometimes direct client consultation.
Actionable insights to help you grow your SaaS and dominate your search market!
Over 60+ pages detailing how to grow your SaaS company using a proven SEO process.