Crawl Test Question
-
Good Morning,
I am just looking for a little bit of advice, I ran a crawl report on our website www.swiftcomm.co.uk. I have resolved most of the issues myself, however I have two questions;-
Screenshot image http://imgur.com/VlFEiZ2
-
Highlighted blue, we have two homepages www.swiftcomm.co.uk and www.swiftcomm.co.uk/ both are set with a Rel-Canonical Target of www.swiftcomm.co.uk/. Will this cause me any SEO issues and or other potential issue? If this may cause an issue how would I go about resolving?
-
Highlighted yellow, Our contact and referral-form are showing as duplicate title and meta description. Both of these pages have separate title and meta desc which it does seem to be detecting. If I search the page in google it returns the correct title and meta desc. The only common denominator behind these pages is that both have php pages behind them for the contact form. Do you think that the moz crawl may be detecting the php page over the html? Could this be cause any issues when search engines crawl the site?
Kind Regards
Jonathan Mack
-
-
Hi Jonathan,
When I visit your site and I go to www.swiftcomm.co.uk/, it redirects me to www.swiftcomm.co.uk, so this looks OK.If I check the Google cache for both versions of the URL, the only one cached is www.swiftcomm.co.uk/ - this looks fine to me.
Might I suggest you download Screaming Frog and run a crawl with that as well, just to be sure. I can't do this today myself as I am on a Chrome box.
-Andy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Search engine blocked by robots-crawl error by moz & GWT
Hello Everyone,. For My Site I am Getting Error Code 605: Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag, Also google Webmaster Also not able to fetch my site, tajsigma.com is my site Any expert Can Help please, Thanx
Intermediate & Advanced SEO | | falguniinnovative0 -
Question about Syntax in Robots.txt
So if I want to block any URL from being indexed that contains a particular parameter what is the best way to put this in the robots.txt file? Currently I have-
Intermediate & Advanced SEO | | DRSearchEngOpt
Disallow: /attachment_id Where "attachment_id" is the parameter. Problem is I still see these URL's indexed and this has been in the robots now for over a month. I am wondering if I should just do Disallow: attachment_id or Disallow: attachment_id= but figured I would ask you guys first. Thanks!0 -
Content Audit Questions
Hi Mozzers Having worked on my companies site for a couple of months now correcting many issues, im now ready to begin looking at a content review, many areas of the site contain duplicate content, the main causes being 1. Category Page Duplications
Intermediate & Advanced SEO | | ATP
e.g.
Widget Page Contains ("Blue Widget Extract")
Widget Page Contains ("Red Widget Extract")
Blue Widget Page Contains ("Same Blue Widget Extract")
Red Widget Page Contains ("Same Red Widget Extract") 2. Product Descriptions
Item 1 (Identical to item 2 with the exception of a few words and technical specs)
Item 2 Causing almost all the content on the site to get devalued. Whilst i've cleared all moz errors and warnings im certain this is causing devaluation of most of the website. I was hoping you could answer these questions so I know what to expect once i have made the changes. Will the pages that had duplicate content recover once they possess unique content or should i expect a hard and slow climb back? The website has never receive any warnings from Google, does this mean recovery for penalties like duplicate content will be quicker Several pages rank on page 1 for fairly competitive keywords despite having duplicate content and keyword spammy content. What are the chances of shooting myself in the foot by editing this content? I know I will have to wait for google to crawl the pages before i see any reflection in the changes, but how long after google has crawled the page should I get a realistic idea of how positive the changes were? As always, thanks for you time!0 -
Crawl budget
I am a believer in this concept, showing google less pages will increase their importance. here is my question: I manage a website with millions of pages, high organic traffic (lower than before). I do believe that too many pages are crawled. there are pages that I do not need google to crawl and followed. noindex follow does not save on the mentioned crawl budget. deleting those pages is not possible. any advice will be appreciated. If I disallow those pages I am missing on pages that help my important pages.
Intermediate & Advanced SEO | | ciznerguy2 -
Backlink Questions
Hey Mozzers, I have spent some time researching proper backlink analysis, and then I have been going through some of the steps. Here are a few questions that I have had in the process. Why would backlink tools like OSE and Ahrefs return different results for (say): "www.domain.com" vs "domain.com"? I noticed that competitors have almost 6x the backlinks as I do, but when I look at where those links are coming from, they are coming from old sites with moderate DA (under 10-30), but many are not current. I also noticed that many of these sites have links placed site-wide so that there are maybe 6+ referring pages per domain. So I guess my question is, how powerful are these links? Am I better off building relationships with bloggers, even though they only offer one link per page? Ultimately it will take me a long time to build the same quantity of links, but it seems like many of these competitors' links are old fashioned, but still moderately effective. Any help is appreciated, you guys have always been so helpful!
Intermediate & Advanced SEO | | evan890 -
Implementation of AJAX Crawling Specifications
My URL is: http://www.redfin.com/TX/Austin/8413-Navidad-Dr-78735/home/31224372 We're using Google's AJAX crawling system, per the documentation here. https://developers.google.com/webmasters/ajax-crawling/The example page above requires JavaScript to display content; it includes in the source. We have a lot of pages like this on our site.We expect Google to query us at this URL:http://www.redfin.com/TX/Austin/8413-Navidad-Dr-78735/home/31224372?escaped_fragment=This page renders correctly with JavaScript disabled.Are we doing this correctly? There are some small differences between the escaped_fragment HTML snapshot and the JavaScript-generated content. Will this cause any problems for us?We ask because there was a period of about two months (from October 4th to Dec 29th) during which Google's crawler radically decreased the hits to our escaped_fragment URLs; it's maybe recovering now, but maybe it isn't, and I wanted to be absolutely sure we're doing this correctly.
Intermediate & Advanced SEO | | RyanOD0 -
What is better for SEO keywords in folder or in filename - also dupe filename question
Hey folks, I've got a question regarding URL structure. What is best for SEO given that there will be millions of lawyer names and 4 pages per lawyer www.lawyerz.com/office-locations/dr-al-pacino www.lawyerz.com/phone-number/dr-al-pacino www.lawyerz.com/reviews/dr-al-pacino www.lawyerz.com/ratings/dr-al-pacino OR www.lawyerz.com/office-locations-dr-al-pacino www.lawyerz.com/phone-number-dr-al-pacino www.lawyerz.com/reviews-dr-al-pacino www.lawyerz.com/ratings-dr-al-pacino OR www.lawyerz.com/dr-al-pacino/office-locations www.lawyerz.com/dr-al-pacino/phone-number www.lawyerz.com/dr-al-pacino/reviews www.lawyerz.com/dr-al-pacino/ratings Also, concerning duplicate file names: In the first example there are 4 duplicate file names with the lawyers name. (would this cause Google to not index some) In the second example there are all unique file names (would this look spammy to Google or the user) In the third example there are millions of duplicate file names (if 1 million lawyers then 1 million files called "office-locations" etc (could so many duplicate filenames cause ranking issues) Should the lawyers name (which is the main keyword target) appear in the filename or in the folder - which is better for SEO in your opinion? Thanks for your input!
Intermediate & Advanced SEO | | irvingw0 -
How to Set Custom Crawl Rate in Google Webmaster Tools?
This is really silly question to set custom crawl rate in Google webmaster tools. Any one can find out that section under setting tab. But, I have confusion to decide number for request per second and second between requests text field. I want to set custom crawl rate for my eCommerce website. I checked my Google webmaster tools and find out as attachment. So, Can I use this facility to improve my crawling? 6233755578_33ce83bb71_b.jpg
Intermediate & Advanced SEO | | CommercePundit0
