Do uncrawled but indexed pages affect seo?
-
It's a well known fact that too much thin content can hurt your SEO, but what about when you disallow google to crawl some places and it indexes some of them anyways (No title, no description, just the link)
I am building a shopify store and it's imposible to change the robots.txt using shopify, and they disallow for example, the cart.
Disallow: /cart
But all my pages are linking there, so google has the uncrawled cart in it's index, along with many other uncrawled urls, can this hurt my SEO or trying to remove that from their index is just a waste of time?
-I can't change anything from the robots.txt
-I could try to nofollow those internal links
What do you think?
-
Hi there!
Yes, pages with poor user experience do affect SEO, even more if those pages receive traffic from google.
So there are two scenaries here, regarding whether they receive traffic:1. They do receive traffic, either move to other CMS (like wordpress and woocommerce) or improve those pages experience.
2. Do not receive traffic, leave them as is.Alls this is considering that you are not able to change Robots.txt and do not want to move to other CMS.
Adding nofollow links will not make any difference, because Google does honor the robot.txt, so pages blocked there will not be crawled never. So as to remove them fron index is crucial beind allowed in robots(or what's the sabe, not being disallowed)Hope it helps.
Best Luck.
GR
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Adding Video to Landing Pages-Beneficial SEO Effect in Terms of Links & Visitor Engagement?
I run a New York City commercial real estate in New York City. Lately, I have started to produce 30-second videos about property listings and neighborhoods. I have noticed that the engagement for these videos on Facebook is much higher that for text posts. Should adding these videos on our website (hosting them on Youtube) result in increased visitor engagement? Could there be a positive SEO effect such as more links and higher quality links? Anyone have any experience with this? Thanks, Alan
Intermediate & Advanced SEO | | Kingalan10 -
Splitting a strong page - SEO
Hi, I have a page with high traffic that is showing a list of flea markets in a unique URL. We are redesigning our website and we have created a listing directory of flea markets, so the users can look up and find the information for each. Each flea market will have its own URL in the future, and the listing directory shows only summarized info of each flea market in the results. Before activating the new flea market section, I would like to make sure which is our best bet: Option 1: Create pages with same URL/content as the current ones, which we won't link from frontend, and besides that, use the new flea market section on a separate page. Option 2: Redirect the current page to the new flea market section. As an inaccurate reference because it depends on many variables and SEO doesn't have an actual number, I understand this is more or less how it would work: Example Option 1 (after 1 week of launch): Old Flea Market Pages SEO traffic: 10,000 visits/month New Copied Flea Market Pages traffic: 9,700 (maybe a bit below 100 because of design changes etc) New Flea Market Section traffic: 500 visits/month (then increase over time) Example Option 2 (after 1 week of launch): Old Flea Market Pages SEO traffic: 10,000 visits/month New Redirected Flea Market Pages traffic: 9,000 (in principle PageRank wouldn't be affected, but other rankings might) New Flea Market Section traffic: (joined above, then increase over time) According to this, Option 1 would give us more total future visits compared to redirecting, plus the new flea market pages would add to it. If redirecting, the new flea market section would add up some SEO juice to the old page, but not as much as Option 1 (not redirecting). Please confirm. Which option is the best one and why? Thank you, New 301 Redirection Rules: https://moz.com/blog/301-redirection-rules-for-seo
Intermediate & Advanced SEO | | viatrading10 -
Pages getting into Google Index, blocked by Robots.txt??
Hi all, So yesterday we set up to Remove URL's that got into the Google index that were not supposed to be there, due to faceted navigation... We searched for the URL's by using this in Google Search.
Intermediate & Advanced SEO | | bjs2010
site:www.sekretza.com inurl:price=
site:www.sekretza.com inurl:artists= So it brings up a list of "duplicate" pages, and they have the usual: "A description for this result is not available because of this site's robots.txt – learn more." So we removed them all, and google removed them all, every single one. This morning I do a check, and I find that more are creeping in - If i take one of the suspecting dupes to the Robots.txt tester, Google tells me it's Blocked. - and yet it's appearing in their index?? I'm confused as to why a path that is blocked is able to get into the index?? I'm thinking of lifting the Robots block so that Google can see that these pages also have a Meta NOINDEX,FOLLOW tag on - but surely that will waste my crawl budget on unnecessary pages? Any ideas? thanks.0 -
Alternative HTML Structure for indexation of JavaScript Single Page Content
Hi there, we are currently setting up a pure html version for Bots on our site amazine.com so the content as well as navigation will be fully indexed by google. We will show google exactly the same content the user sees (except for the fancy JS effects). So all bots get pure html and real users see the JS based version. My questions are first, if everyone agrees that this is the way to go or if there are alternatives to this to get the content indexed. Are there best practices? All JS-based websites must have this problem, so I am hoping someone can share their experience. The second question regards the optimal number of content pieces ('Stories') displayed per page and the best method to paginate. Should we display e.g. 10 stories and use ?offset in the URL or display 100 stories to google per page and maybe use rel=”next”/"pref" instead. Generally, I would really appreciate any pointers and experiences from you guys as we haven't done this sort of thing before! Cheers, Frank
Intermediate & Advanced SEO | | FranktheTank-474970 -
What to do when you buy a Website without it's content which has a few thousand pages indexed?
I am currently considering buying a Website because I would like to use the domain name to build my project on. Currently that domain is in use and that site has a few thousand pages indexed and around 30 Root domains linking to it (mostly to the home page). The topic of the site is not related to what I am planing to use it for. If there is no other way, I can live with losing the link juice that the site is getting at the moment, however, I want to prevent Google from thinking that I am trying to use the power for another, non related topic and therefore run the risk of getting penalized. Are there any Google guidelines or best practices for such a case?
Intermediate & Advanced SEO | | MikeAir0 -
SEO-Friendly Method to Load XML Content onto Page
I have a client who has about 100 portfolio entries, each with its own HTML page. Those pages aren't getting indexed because of the way the main portfolio menu page works: It uses javascript to load the list of portfolio entries from an XML file along with metadata about each entry. Because it uses javascript, crawlers aren't seeing anything on the portfolio menu page. Here's a sample of the javascript used, this is one of many more lines of code: // load project xml try{ var req = new Request({ method: 'get', url: '/data/projects.xml', Normally I'd have them just manually add entries to the portfolio menu page, but part of the metadata that's getting loaded is project characteristics that are used to filter which portfolio entries are shown on page, such as client type (government, education, industrial, residential, industrial, etc.) and project type (depending on type of service that was provided). It's similar to filtering you'd see on an e-commerce site. This has to stay, so the page needs to remain dynamic. I'm trying to summarize the alternate methods they could use to load that content onto the page instead of javascript (I assume that server side solutions are the only ones I'd want, unless there's another option I'm unaware of). I'm aware that PHP could probably load all of their portfolio entries in the XML file on the server side. I'd like to get some recommendations on other possible solutions. Please feel free to ask any clarifying questions. Thanks!
Intermediate & Advanced SEO | | KaneJamison0 -
How can I change my website's content on specific pages without affecting ranking for specific keywords?
My client's website (www.nursevillage.com) content has not been touched for 4 years and we are currently ranking #1 for "per diem nursing". They do not want to make any changes to the site in fear that it might decrease our rankings. We want to try to use utilize that keyword ranking on specific pages (www.nursevillage.com/nv/content/careeroptions/perdiem.jsp ) ranking for "per diem nursing" and try redirecting traffic or placing some banners and links on that page to specific pages or other sites related to "per diem nursing" jobs so we can get nurses to apply to our new nursing jobs. Any advice on why "per diem nursing" is ranking so high for us and what we can change on the site without messing up our ranking would be greatly appreciated. Thanks
Intermediate & Advanced SEO | | ryanperea1000 -
Best SEO format for a blog page on an ecommerce website.. inc Source Ordered Content
Does anyone know of a page template or code I might want to base a blog on as part of an eccomerce website? I am interested in keeping the look (includes) of the website and paying attention to Source Ordered Content helping crawlers index the new great blogs we have to share. I could just knock up a page with a template from the site but I would like to investigate SOC at this stage as it may benefit us in the long run. Any ideas?
Intermediate & Advanced SEO | | robertrRSwalters0