Stack Snacks

Share this post

Robots.Txt Testing Tool

www.stack-snacks.com

Robots.Txt Testing Tool

John Siwicki
Oct 3, 2021
Share this post

Robots.Txt Testing Tool

www.stack-snacks.com

This week I had an issue with a robots.txt file. I have to be honest. I can't remember the last time I edited a robots file. Most of the sites I work on generally speaking we want all the content crawlable. So, we don't have a lot of advanced things set up. But, in this case. I needed to see what file Google had cached as well if one of my URLs was crawlable. I don't think this tool is linked from the Search Console anymore. But, it can still be something that can help you debug and run some tests especially if you are editing a robots file.

Google Search Console

Gebruik Search Console om zoekresultaatgegevens voor Google Zoeken bij te houden voor je property’s.
Share this post

Robots.Txt Testing Tool

www.stack-snacks.com
Comments
TopNew

No posts

Ready for more?

© 2023 John Siwicki
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing