You can use the search line on Google: site:www.example.com
This will tell you what Google has indexed on the site.
If you are looking for a specific sub-folder, then use: site:www.example.com/forum
Hope that helps.
Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Best posts made by alexhoug
-
RE: Forumsposted in Link Building
-
RE: How to prevent Google from crawling our product filter?posted in Intermediate & Advanced SEO
I would use your robots.txt file to prevent them from crawling the specific strings / pages. Go into your Google Webmaster Tools and you can see all the information Google has on your site and any issues, you can also specify robots.txt information in there. That would be the best route as Google is obedient with what is on the robots.txt file. If you want more information about robots.txt, go here.