Website Crawl problems
-
I have a feeling that Google doesn't crawl my website.
E.g. this blogpost - I copy a sentence from it and paste it to Google. The page that shows up in search results is www.silvamethodlife.com/page/9/ - which is just a blog page with all the articles listed, not the link to the article itself!
Did anyone ever have this problem? It's definitely some technical issue.
Any advice will be deeply appreciated
Thanks
-
When i use the same tactic as you defined in your question’s explanation i was able to see your page in the search results...
Use this common in search bar to see how many pages are indexed in Google ‘site:example.com’.
May be not all the pages are indexed, for that try and check the following two things:
- Make sure all pages of the website are follow,index for Google and other search engines
- Update your sitemap and submit it to Google webmaster tool and you will see the efficiency in website page index.
Hope this helps!
-
I noticed that your category pages specify noindex,follow and index,follow. Might want to make a decision there.
Google has indexed 676 pages of the 817 on your site and, since their are quite a few URLs that specify nofollow correctly without the additional index like mentioned above, I'd say that is about right.
Did not see the issue you spoke of when I checked some random sentences.
Wouldn't be concerned unless you notice this is coupled with a decrease in organic traffic. If so start looking at off page factors.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO QA automation of large websites
Can you share your experiences in managing SEO QA automation of large websites with millions of pages?
Intermediate & Advanced SEO | | terentyev
what are the things you are regularly testing for, besides the most obvious - hreflangs/canonicals, robots.txt, sitemap, non-200 status codes, redirect rules?
do you use in-house developed tools or external tools?
if external - which ones?
how do you run your QA automation scripts? external server or some online tools? upon every release or hourly/daily/monthly?0 -
Acquired a company, what should be done with their website?
Hi, I work for a furniture company that essentially purchased another furniture store some time back a few years ago. However, this furniture store that was acquired had a website. The website has no existing pages anymore, only the homepage. The homepage has a message on it describing how it's been taken over and then links to our website. The spam score for the website is 8. I was wondering if there was something else we should do instead of the link, whether that be a straight 301 redirect or if we should have the link at all considering its score. I can provide more information and links if needed. Thanks in advance, Adam
Intermediate & Advanced SEO | | AdamEgarr0 -
Should I NoFollow Links Between Our Company Websites?
The company I work for owns and operates hundreds of websites throughout the United States. Each of these is tied to a legitimate local business many times with specific regional branding and mostly unique content. All of our domains are in pretty good shape and have not ever participated in any shady link building/SEO. These sites currently are often linking together between the other sites within their market. It makes perfect sense from a user standpoint since they would have an interest in each of the sites if they were interested in the specific offering that business had. My question is whether or not we should nofollow the links to our other sites. Nothing has happened from Google in terms of penalties and they don't seem to be hurting our sites now as they are all currently followed, but I also don't want to be on the false positive side of any future algorithm updates surrounding link quality. What do you think? Keep them followed or introduce nofollow?
Intermediate & Advanced SEO | | MJTrevens0 -
Adding videos to a website
Hello! We are producing multiple videos (each about 1-minute long) for a company website. We have decided to use Wistia to host them, in order get the full SEO benefits of links to the videos. I have two questions: 1. Would it definitely be better for SEO to divide up the videos and place them on the various existing pages of the site that are related to the video content, rather than putting all the videos together on a separate video page? 2. If we do put different videos on different pages, would it be a bad idea also to have a video page with all the videos together? Would this be considered duplicate content? Thank you very much!
Intermediate & Advanced SEO | | nyc-seo0 -
Big problem with duplicate page content
Hello! I am a beginner SEO specialist and a have a problem with duplicate pages content. The site I'm working on is an online shop made with Prestashop. The moz crawl report shows me that I have over 4000 duplicate page content. Two weeks ago I had 1400. The majority of links that show duplicate content looks like bellow:
Intermediate & Advanced SEO | | ana_g
http://www.sitename.com/category-name/filter1
http://www.sitename.com/category-name/filter1/filter2 Firstly, I thought that the filtres don't work. But, when I browse the site and I test it, I see that the filters are working and generate links like bellow:
http://www.sitename.com/category-name#/filter1
http://www.sitename.com/category-name#/filter1/filter2 The links without the # do not work; it messes up with the filters.
Why are the pages indexed without the #, thus generating me duplicate content?
How can I fix the issues?
Thank you very much!0 -
Moving Code for Faster Crawl Through?
What are best practices for moving code into other folders to help speed up a crawling for bots? We once moved some javascript from an SEO's suggestion and the site suddenly looked like crap until we undid the changes. How do you figure our what code should be consolidated? What code do you use to indicate what has been moved and to where?
Intermediate & Advanced SEO | | siteoptimized0 -
Convertinh Website for Mobile ?
Dear All, My website (a rental website where you can hire anything online) currently has approx 1/3 of it's traffic from mobile devices , ipads, iphones, blackberry , HTC etc etc. The bounce rate is slightly higher for these at 47% but we have not optimised our site to be mobile friendly as yet. This is something I want to do. Do we just make it fit well into a 320 pixel screen or should we do new wire frames etc and essentially make a cut down website just for mobile. One of the things I know we will do is to make it pick up someones location and retrieve results nearest to them but is there any other do's and don'ts when going down the mobile route ?. I seem to find conflicting infomation when researching this , one example is about using a different url for mobile , one site says it gets you more traffic whilst another says don't use a different url. Also does anyone know of any good tips or sites where I can get some useful info about making the site Mobile Friendly >? thanks Sarah.
Intermediate & Advanced SEO | | SarahCollins0 -
Unable to Crawl my Website
Hi all, I have a website that I am trying to promote, but tried to add it here in SEOMoz and got the following message: We have detected that the root domain evolving-networks.co.uk does not respond to web requests. Using this domain, we will be unable to crawl your site or present accurate SERP information. Does anyone know why this website cannot be crawled? Please help. Thank you in advance!
Intermediate & Advanced SEO | | LSDigital0