Robots.txt checker
Check if a website has a robots.txt file and review its sitemap and disallow rules.
Share
Similar tools
Check the status code returned by a website for a generated missing page.
Checks if a webpage is set to noindex, preventing it from appearing in search engines.
Get all the HTTP headers that an URL returns for a typical GET request.
Popular tools
Find JSON-LD schema markup on a webpage and check whether its JSON can be parsed.
Minify your CSS by removing all the unnecessary characters.
Find HTML elements that use inline CSS styles.
Minify your JS by removing all the unnecessary characters.
Minify your HTML by removing all the unnecessary characters.
Analyze the ratio of text content to HTML code for SEO and performance optimization.