How to find missing or incorrect title tags with a site hosting lots of pages.
-
i have a website that features more than 9,000 pages. i'm trying to figure out which ones have missing or incorrect title tags. Should I start with screaming frog??
-
Hi,
I can't recommend the ScreamingFrog enough!
The free version has a limit of 500 pages, so you will need a license.With such a large site it it recommended to check on the crawl progress to ensure there are no crawl 'loops'
If for example it turns out that a calendar on a page counts as a link for every day then the crawl will likely never finish!
Luckily you can fix such things by creating a URL Exclude rule and the re running the spider.Kind Regards
Jimmy
-
Hi there
Yes, you can try ScreamingFrog and also Moz Analytics will help with this as well.
Start there - hope it helps! Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should I set blog category/tag pages as "noindex"? If so, how do I prevent "meta noindex" Moz crawl errors for those pages?
From what I can tell, SEO experts recommend setting blog category and tag pages (ie. "http://site.com/blog/tag/some-product") as "noindex, follow" in order to keep the page quality of indexable pages high. However, I just received a slew of critical crawl warnings from Moz for having these pages set to "noindex." Should the pages be indexed? If not, why am I receiving critical crawl warnings from Moz and how do I prevent this?
Moz Pro | | NichGunn0 -
Canonical URLs all show trailing slash on main site pages - using Yoast SEO for Wordpress - how to correct
We are using Yoast for a number of our sites. We use naked domain as the canonical. I have noticed in the header tags that all our sites show the canonical URLs as having a trailing slash: Example: http;//foxspizzajc.com, when I look at the source code, it shows the canonical as http;//foxspizzajc.com/ Of course, it is much more likely that all sites that link to us will not use the trailing slash - so preferably we do not want that to be the canonical - among other reasons. Does this need to be fixed so the trailing slash is removed? I cannot see how to do this in Yoast SEO or in Permalinks structure for Wordpress. Sorry for my ignorance. Thanks for any help.
Moz Pro | | Adam_RushHour_Marketing1 -
How do I find out which pages are being indexed on my site and which are not?
Hi, I doing my first technical audit on my site. I am learning how to do an audit as i go and am a lost. I know some page won't be indexed but how do I: 1. Check the site for all pages, both indexed and not indexed 2. Run a report to show indexed pages only (i am presuming i can do this via screaming Frog or webmaster tool) 3. I can do a comparison between the two list and work out which pages are not being indexed. I'll then need to figure out way. I'll cross this bridge once i get to it Thanks Ben
Moz Pro | | benjmoz0 -
Have a Campaign, but only states 1 page has been crawled by SEOmoz bots. What needs to be done to have all the pages crawled?
We have a campaign running for a client in SEOmoz and only 1 page has been crawled per SEOmoz' data. There are many pages in the site and a new blog with more and more articles posted each month, yet Moz is not crawling anything, aside from maybe the Home page. The odd thing is, Moz is reporting more data on all the other inner pages though for errors, duplicate content, etc... What should we do so all the pages get crawled by Moz? I don't want to delete and start over as we followed all the steps properly when setting up. Thank you for any tips here.
Moz Pro | | WhiteboardCreations0 -
Finding a list of all inbound links
Hello. I just used Open Site Explorer to find inbound links to a site. But it does not seem to list all inbound links. I will be changing a lot of urls on the site, and I would like to put in 301 redirects only for the pages that have links to them. Is there a way to find all inbound links and the specific pages they link to? Thank you!
Moz Pro | | nyc-seo0 -
Finding affiliate links with opensiteexplorer
Hey guys, I'm trying to develop lists of our competitors affiliates using opensiteexplorer using the following method When logged in to seomoz, go to http://www.opensiteexplorer.org/ Search for<rival company="" domain=""></rival> Select Show ALL links from ALL pages to PAGES ON THIS ROOT DOMAIN and SHOW LINKS UNGROUPED Click 'Filter' Click_ 'Download csv'_ Open the csv in excel and filter the Target URL column for any known part of the affiliate link (example ?a_aid) - this leaves you with a list of the affiliate links Filter out duplicates Is this the best process? I have a feeling I'm missing some as OSE truncates to 25 links per domain. It would be nice also if OSE could do the filtering for me. Any better ways to do this?
Moz Pro | | pilkster2 -
Duplicate Page Titles and Content
The SeoMoz crawler has found many pages like this on my site with /?Letter=Letter, e.g. http://www.johnsearles.com/metal-art-tiles/?D=A. I believe it is finding multiple caches of a page and identifying them as duplicates. Is there any way to screen out these multiple cache results?
Moz Pro | | johnsearles0 -
Only one page has been crawled
I am running a campaing for three weeks now and first two crawls was ok but the last one is showing only one page crawled. the subdomain I am tracking is: www.cubaenmiami.com I have everything correct in my site. Regards Alex
Moz Pro | | esencia0