Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Crawling a website with redirects

Moz Pro

975

Cegeka last edited by

Hi,

I started a campaign for a website which uses multiple redirects before showing the real content. in the crawling report only one page is crawled.

Is there a way to let the crawler pass the redirects to get usefull reports?

The website is www.cegeka.be

Thank you
1 Reply Last reply
Reply Quote 0
heatherrobinson last edited by

Hi Peter

It would be helpful to know how you are redirecting these pages (301 etc) and for what reason?

Also whether any of your pages are blocked in your robots.txt file - perhaps to prevent duplicate content?
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Crawl Diagnostics Summary Problem

We added our website a Robots.txt file and there are pages blocked by robots.txt. Crawl Diagnostics Summary page shows there is no page blocked by Robots.txt. Why?
Moz Pro | | iskq

0
Switching to a new website & Search Engine Rankings

Hello! We have been doing a lot of work on our SEO over the last few months and are thrilled to be in the top four four "edmonton website design" in our city. However, we are planning to launch a new website soon and are very concerned that this could negatively effect our rankings (as was the case with one of our competitors this week). What tips and techniques can you recommend in this case? On paper, the SEO on our new site is much better than the last - the url structure, contact info and content is much more targeted to our desired search terms, however, I don't want to take any chances. Is there any way to be certain (as certain as possible) that we will not get bumped to page 2? Thanks, Anton
Creative Director
Web3 Marketing Inc.
web3.ca
Moz Pro | | Web3Marketing87

0
Crawl diagnostics taking too long

I started a crawl 2 days ago and it was still going after almost 48 hours so I deleted the entire campaign and resubmitted it. It's been 13 hours and still going. What happened to getting initial results in 2 hours? I've never had this problem and have run several campaign crawls here. Just wondering if there is a known issue I just can't seem to find? Thank you
Moz Pro | | LisaS13

0
54 new 404 errors on my website?

Hi There In the latest report I have 54 404-errors. All last week, previously I had 2 404s that I fixed. In report say: Title404 : ErrorMeta DescriptionTraceback (most recent call last): File "build/bdist.linux- x86_64/egg/downpour/init.py", line 391, in _error failure.raiseException() File "/usr/local/lib/python2.7/site- packages/twisted/python/failure.py", line 370, in raiseException raise self.type, self.value, self.tb Error: 404 Not FoundMeta RobotsNot present/emptyMeta RefreshNot present/empty Are these normal 404 errors I have to look at and fix? Or is this some script that running on my server and causing errors? In general - what should I do to fix this? Thanks Dean
Moz Pro | | Passanger88

0
Is there a way to get the SEO campaign crawl to run from outside the US?

We are working on a international site that uses IP redirection. I am currently trying to crawl and monitor the Australian version of the site, however the pro-campaign crawler is running from the US and only giving me US data. Is there a way to tell the crawler to run through a local proxy so we can track international versions? Thanks!
Moz Pro | | MBASydney

0
How long is a full crawl?

It's been now over 3 days that the dashboard for one of our campaigns shows "Next Crawl in Progress!". I am not complaining about the length... but I have to agree that SEOMoz is quite addictive, and it's quite frustrating to see that everyday 🙂 Thanks
Moz Pro | | jgenesto

0
Only one page has been crawled

I am running a campaing for three weeks now and first two crawls was ok but the last one is showing only one page crawled. the subdomain I am tracking is: www.cubaenmiami.com I have everything correct in my site. Regards Alex
Moz Pro | | esencia

0
Trying to understand how a website is getting higher than me with less links

Hi i am new to seo and trying to teach myself the best way to improve a site and the best way to use the tools on seomoz. The problem i have is. i am working on a page at the moment on a site. the page is called weight loss hypnotherapy http://www.clairehegarty.co.uk/weight-loss-hypnotherapy and i have around 130 links going to the page where as a site which is much higher than me in google has only around 5 links. I cannot understand with being new to seo how this can happen, can anyone please explain what i need to do to improve my ranking please. here is the site i am talking about that is higher than me www.weightlosshypnotherapy.co.uk/ any help would be great can anyone also give me a good example of a page before it has been optimised and a page after it has had this done.
Moz Pro | | ClaireH-184886

0