Free tool
Fetch any public robots.txt and highlight User-agent, Allow, Disallow, and Sitemap lines.
How to check robots.txt
It must be at the site root, for example https://example.com/robots.txt. Search engines look there first before crawling.