question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

robots.txt is blocking some CSS

See original GitHub issue

Issue Summary

I was seeking the Google Webmaster report when noticed that it is saying I have a blocked resource on subscribe page (a new feature to leave email addresses located at ghost.com/subscribe/. Actually we have a CSS there which has the following link: ghost.com/ghost/ghost.min.css but our robots.txt has this rule:

Disallow: /ghost/

Means that we are blocking our CSS and Google for example is unable to locate it.

P.S.: Also used View as Googlebot function now and it really sees this page without any styles.

Technical details:

  • Ghost Version: 0.8.0

Issue Analytics

  • State:closed
  • Created 7 years ago
  • Comments:5 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
ErisDScommented, Jun 9, 2016

Correct - the problem is not that the robots.txt is blocking the file - it’s doing the right thing ✅

The problem here is that we need to register these assets to be served over a shared URL where they are needed for the blog. There is a similar problem with the icons being served when the admin panel is set to be served over https but the blog is not.

0reactions
ErisDScommented, Jul 31, 2017

In Ghost 1.0.0 we no longer serve the admin CSS for the frontend of the blog - so I think this issue should be resolved.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Google SEO 101: Blocking Special Files in Robots.txt
Crawling CSS is absolutely critical as it allows Googlebot to properly render pages. Site owners may feel it's necessary to block CSS files...
Read more >
Blocking CSS files in robots.txt can affect your SEO Rankings
Google's John Mueller explains how blocking CSS in robots.txt can pose problems for Google in crawling your page.
Read more >
Google Says: If You Block CSS Files in Robots.txt They ...
In a hangout, John Mueller explained that if you block critical files like CSS files in robots.txt, you prevent Google from seeing how...
Read more >
Robots.txt - CSS allow or disallow
Google have very recently updated their guidelines to officially state that you should not block access to CSS or JS files in robots.txt....
Read more >
Robots.txt: do not block CSS and Javascript - Joomlaseo.com
Don't block CSS, Javascript and other resource files by default. This prevents Google bot from properly rendering the page and understanding ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found