Difficulty with Indexing Pages - Desperate for Help!
-
I have a website with product pages that use the same URL, but load different data based on what's passed to them with GET. I am using a Wordpress website, but all of the page information is retrieved from a database using PHP and displayed with PHP.
Somehow these pages are not being indexed by Google.
I have done the following:
1. Created a site map pointing to each page.
2. Defined URL parameters in Search Console for these type of pages.
3. Created a product schema using schema.org, and tested it without errors.
I have requested re-indexing repeatedly and these pages and images on the pages are still not being indexed! Does anybody have any suggestions?
-
Hey, David Butler . . . you are probably the only person who has looked at this issue, so I want to thank you again for your input.
I wanted to follow up about this. Since I am using Wordpress for the website, I used Wordpress's rewrite_rule function.
After confirming that it was working correctly, I deleted the old sitemaps and created new ones, then submitted them to Google.
Shortly after this, the pages were successfully indexed.
So from this experience I get the impression that using URL parameters doesn't necessary work -- I certainly am not going to use them in the future.
I am going to mark this issue as resolved.
-
Hi jacleaves,
I'm interested to see how this works out for you!
Please post an update after you've finished your work
Cheers,
David
-
Hey, David Butler,
I am at a loss when it comes to canonical tags -- I am trying to understand how to use them. However, in this case I thought it was set up correctly.
To better explain the website . . . all of the product pages use the same URL, which is http://amishdirectplaysets.com/playset-details/.
I programmed the pages to retrieve info from a database and display specific product information based on the parameters passed to them (?mfgID=A-1&catID=4). I cannot change the URL's to be anything different, as they are not actually different pages.
What I had read is that the canonical url should not include the URL parameters, so that is why they were just going to the same page. I created URL parameters in Google Search Console because I thought that would take care of this issue. However it is not.
So . . . what I have done (after reading your post) is gone ahead and changed the canonical URL to include the URL parameters.
Is that how I'm supposed to handle it in this type of a situation?
I am updating this response . . . after further investigation I can take care of changing the URL to something more search-engine friendly by using mod rewrite. I'll test it out.
-
Hi jacleaves,
The problem here is with your canonical tags (more info on canonical tags here).
This page: http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
Has a canonical tag pointing to: http://amishdirectplaysets.com/playset-details/
The same thing is happening on all of your product pages.
I would change all of your product pages to use "SEO-friendly" URLs and have a self-referring canonical tag.
Eg. your example page: http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
Would become: http://amishdirectplaysets.com/playset-details/a-1-standard-climber-vinyl-playset
And the canonical tag would point to: http://amishdirectplaysets.com/playset-details/a-1-standard-climber-vinyl-playsetCheers,
David
-
Hi Matthew,
Thanks for your quick response!
Here's one page:
http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
My issue is none of the individual product pages are being indexed.
In response to your starting suggestions:
1. I am not blocking any resources.
2. I am not using noindex.
3. Page is being rendered successfully.
One more thing . . . I mis-spoke about how the content is generated. The content on this page is generated by PHP and NOT Javascript. So that is a non-issue. (I corrected this in my initial question.)
I appreciate your feedback. Please let me know if you are able to determine what else I could be missing!
-
Hi jacleaves!
Without your website URL it will be difficult to diagnose the problem as there are a few potential technical issues here. My main worries would be whether you're blocking indexation somehow and the fact you're displaying your content using JavaScript.
I'd start here:
- Check you're not blocking crawlers in your robots.txt file
- Check you're not using the noindex tag
I'd also try using fetch and render in Google Search Console (https://support.google.com/webmasters/answer/6066468?hl=en) for your site pages to see how Google sees them. If googlebot isn't seeing your content, that's a strong hint there's a JavaScript crawling problem.
Also, strap yourself in and read this - https://www.elephate.com/blog/ultimate-guide-javascript-seo/ - it's THE guide for JavaScript SEO.
Let us know how you get on and we'll go from there!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to check if the page is indexable for SEs?
Hi, I'm building the extension for Chrome, which should show me the status of the indexability of the page I'm on. So, I need to know all the methods to check if the page has the potential to be crawled and indexed by a Search Engines. I've come up with a few methods: Check the URL in robots.txt file (if it's not disallowed) Check page metas (if there are not noindex meta) Check if page is the same for unregistered users (for those pages only available for registered users of the site) Are there any more methods to check if a particular page is indexable (or not closed for indexation) by Search Engines? Thanks in advance!
Intermediate & Advanced SEO | | boostaman0 -
I've got duplicate pages. For example, blog/page/2 is the same as author/admin/page/2\. Is this something I should just ignore, or should I create the author/admin/page2 and then 301 redirect?
I'm going through the crawl report and it says I've got duplicate pages. For example, blog/page/2 is the same as author/admin/page/2/ Now, the author/admin/page/2 I can't even find in WordPress, but it is the same thing as blog/page/2 nonetheless. Is this something I should just ignore, or should I create the author/admin/page2 and then 301 redirect it to blog/page/2?
Intermediate & Advanced SEO | | shift-inc0 -
Google Indexed Old Backups Help!
I have the bad habit of renaming a html page sitting on my server, before uploading a new version. I usually do this after a major change. So after the upload, on my server would be "product.html" as well as "product050714".html. I just stumbled on the fact G has been indexing these backups. Can I just delete them and produce a 404?
Intermediate & Advanced SEO | | alrockn0 -
Why does our business directions page rank above business profile page
Hi All, We are having an issue at the moment where our business direction page is ranking above the main business profile page. Our website is zodio.com, similar to Yelp but for South East Asia. An example of each page is below: Business Profile Page - http://www.zodio.com/business/detail/126037914/chowking Business Directions - http://www.zodio.com/business/direction/126037914 On many of our long tail searches for particular businesses, the business directions rank above the business details. Does anyone have any idea of why this would happen? I have researched Yelp and they do not have this issue. A few search examples in Google are as follows (one is in Thai): agonos dental clinic เวิลด์ชาร์มมิ่ง kawanku elektrik I have been rattling my brain and search for answers but cannot find anything. The communities help would be much appreciated. Many Thanks, Neil W
Intermediate & Advanced SEO | | zodiothailand0 -
Canonicals for product pages - confused, anyone help?
I have an ecommerce website (built using Magento), and have just had the functionality extended to allow me to define my own canonical URLs. Currently the URLs are www. domainname.com/product-name.html but I can now change this to www.domainname. com/product-category/product-name.html. I was led to believe that this would be good for SEO. However, I have since had conflicting advice - it's been suggested that any links across the website that link to domain/category/sub-category/product will pass weight and authority through to the specified canonical anyway. Plus longer URLs are generally worse... I'm confused. Is it worth changing them? If so, would it be a bad thing to change all 700 canonical URLs at once?
Intermediate & Advanced SEO | | Coraltoes770 -
Why Is Google Indexing These Product Pages On Shopify?
How can we communicate to Google the exact product pages we'd like indexed on our site? We're an apparel company that uses Shopify as our ecommerce platform. Website is sportiqe.com. Currently, Google is indexing all types of different pages on our site. **Example of a product page we want indexed: ** Product Page: sportiqe.com/products/PRODUCT-TITLE (Like This) **Examples of product pages being indexed: ** sportiqe.myshopify.com/products/PRODUCT-TITLE sportiqe.com/collections/COLLECTION-NAME/products/PRODUCT-TITLE See attached for an example of how two different "Boston Celtics Grateful Dead" shirts are being indexed. Any suggestions? We've used both Shopify and Google Webmaster tools to set our preferred domain (sportiqe.com). We've also added this snippet of code to our site three months ago thinking that would do the trick... {% if template == 'product' %}{% if collection %} {% endif %}{% endif %} sKwNZOl
Intermediate & Advanced SEO | | farmiloe0 -
Which page to target? Home or /landing-page
I have optimized my home page for the keyword "computer repairs" would I be better of targeting my links at this page or an additional page (which already exists) called /repairs it's possible to rename & 301 this page to /computer-repairs The only advantage I can see from targeting /computer-repairs is that the keywords are in the target URL.
Intermediate & Advanced SEO | | SEOKeith0 -
High number of items per page or low number with more category pages?
In SEO terms, what would be the best method: High number of items per page or low number with more pages? For example, this category listing here: http://flyawaysimulation.com/downloads/90/fsx-civil-aircraft/ It has 10 items per page. Would there be any benefit of changing a listing like that to 20 items in order to decrease the number of pages in the category? Also, what other ways could you increase the SEO of category listings like that?
Intermediate & Advanced SEO | | Peter2640