Some Tools Not Recognizing Meta Tags
-
I am analyzing a site which has several thousands of pages, checking the headers, meta tags, and other on page factors. I noticed that the spider tool on SEO Book (http://tools.seobook.com/general/spider-test) does not seem to recognize the meta tags for various pages. However, using other tools including Moz, it seems the meta tags are being recognized.
I wouldn't be as concerned with why a tool is not picking up the tags. But, the site suffered a large traffic loss and we're still trying to figure out what remaining issues need to be addressed. Also, many of those pages once ranked in Google and now cannot be found unless you do a site:// search.
Is it possible that there is something blocking where various tools or crawlers can easily read them, but other tools cannot. This would seem very strange to me, but the above is what I've witnessed recently.
Your suggestions and feedback are appreciated, especially as this site continues to battle Panda.
-
Hi,
I just run those with Screaming Frig - as a basic crawler - all is good. Source code also looks ok. There are no issues there - you should be safe.
I see the issues on the seobook crwler - it's for sure an issue there not on your side.
Cheers.
-
Sure. Try going to http://tools.seobook.com/general/spider-test to run a test on:
http://www.maxandchloe.com/bridal-jewelry
http://www.maxandchloe.com/nashelle
These are just two example where the meta tags nor text on the page seems to be getting picked up.
-
Hi.
Can you give some exact examples ? It will be easier to look into.
Cheers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is our noindex tag not working?
Hi, I have the following page where we've implemented a no index tag. But when we run this page in screaming frog or this tool here to verify the noidex is present and functioning, it shows that it's not. But if you view the source of the page, the code is present in the head tag. And unfortunately we've seen instances where Google is indexing pages we've noindexed. Any thoughts on the example above or why this is happening in Google? Eddy
Intermediate & Advanced SEO | | eddys_kap0 -
SEO Impact of External links in JS tag
We have our JS tag and iframe tag being used over by 100 leading websites. What would be the SEO impact if we added a follow link in the iframe. Would it have any negative impact ? Vivek
Intermediate & Advanced SEO | | kvivek050 -
Translated version of meta description showing in SERPs
Hi all, When a search for our brand is done, the homepage is shown but the meta description is in French. We have a translated version of the site available once the user is on the site, but there's no reason it should be displaying the translated version in the SERPs. This issue has never happened before and began last week. Anyone seen anything similar? https://www.google.com/search?q=revolve+clothing Thanks.
Intermediate & Advanced SEO | | ggpaul5620 -
Mobile Meta Descriptions?
Hi Guys, We have two different versions of each page for both desktop and mobile example: http://tinyurl.com/zkxlxax http://tinyurl.com/zelqcbv We want to create meta descriptions for both versions. However in the CMS (http://www.mantistech.com.au/ecommerce_website_package.aspx) it only allows one meta description. Example: http://s21.postimg.org/ar8bzrh3r/screenshot_1804.jpg Does anyone know anyway around this? To add two different meta descriptions and tell Google which one to use based on device type. Thanks.
Intermediate & Advanced SEO | | jayoliverwright0 -
Tool to bulk check outbound links
Hi. I have a list of 50 domains I need to check for links to three different sites. Does anybody know an easy way to do this? The best solution I have found so far is to crawl each with Screaming Frog and search for the domains, but I can only do one at a time this way. Some way to speed it up would be great!
Intermediate & Advanced SEO | | Blink-SEO0 -
Meta Abstract & Revisit
Moz Community, I have just noted a competitor using some meta information i have not seen before, Just wondering if anyone has any experience or feedback on using these tags and if they are worth implementing, Seems very similar to the meta description, i don't really see the point unless potentially this abstract could be more topic based if your meta description is designed for Click-Through optimization. Isn't this defined in the sitemap anyway? , and most of the time we will Tweet and Google Plus share any new updates to our site also Google seems to do a good job anyway of crawling anything new we publish or change, Any advice or feedback would be great please, Thanks James
Intermediate & Advanced SEO | | Antony_Towle0 -
Whole site blocked by robots in webmaster tools
My URL is: www.wheretobuybeauty.com.auThis new site has been re-crawled over last 2 weeks, and in webmaster tools index status the following is displayed:Indexed 50,000 pagesblocked by robots 69,000Search query 'site:wheretobuybeauty.com.au' returns 55,000 pagesHowever, all pages in the site do appear to be blocked and over the 2 weeks, the google search query site traffic declined from significant to zero (proving this is in fact the case ).This is a Linux php site and has the following: 55,000 URLs in sitemap.xml submitted successfully to webmaster toolsrobots.txt file existed but did not have any entries to allow or disallow URLs - today I have removed robots.txt file completely URL re-direction within Linux .htaccess file - there are many rows within this complex set of re-directions. Developer has double checked this file and found that it is valid.I have read everything that google and other sources have on this topic and this does not help. Also checked webmaster crawl errors, crawl stats, malware and there is no problem there related to this issue.Is this a duplicate content issue - this is a price comparison site where approx half the products have duplicate product descriptions - duplicated because they are obtained from the suppliers through an XML data file. The suppliers have the descriptions from the files in their own sites.Help!!
Intermediate & Advanced SEO | | rrogers0 -
How can I check if the FOLLOW,NOINDEX tag is working?
Hi everyone! After reading about pagination practices, a few days ago we introduced the <meta name="robots" content="FOLLOW,NOINDEX" /> tag, to prevent duplicate content. You can find an example below: http://www.inmonova.com/en/properties?page=2 I have been checking yahoo site explorer and result pages still get indexed. My question is: Am I doing something wrong? Is the code incorrect (follow,noindex - noindex,follow)? Or does it just take some time to have effect? Thanks in advance.
Intermediate & Advanced SEO | | inmonova0