Screaming Frog в Twitter: „@RichTatum @MaeneSigne @Google @wordpressdotcom You can also check in a free tool like @maxxeight's robots.txt testing tool as well btw - https://t.co/blSV8buUFG. Again, they are seeing the older
Robots Exclusion Checker Chrome Extension – Sam Gipson
Robots Exclusion Checker
Robots.txt Validator
Robots.txt validator and testing tool
What is robots.txt File and How Does It Work?
2.16 Is there any relevance of Robots.txt?
Check robots.txt file of a website for errors and typos