Crawling a website with redirects
-
Hi,
I started a campaign for a website which uses multiple redirects before showing the real content. in the crawling report only one page is crawled.
Is there a way to let the crawler pass the redirects to get usefull reports?
The website is www.cegeka.be
Thank you
-
Hi Peter
It would be helpful to know how you are redirecting these pages (301 etc) and for what reason?
Also whether any of your pages are blocked in your robots.txt file - perhaps to prevent duplicate content?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirecting back to initial redirect.
Hello, I have an example site A.com that is currently being redirected to site B.com. My client is having issues with B.com and finding that there is more equity in site A.com. The client now wants us to have A.com as the site. What is the best way to proceed with implementing A.com without hurting search in the long run, since A.com was initially a 301 redirect to B.com. How should I proceed in this redirection back to A.com What pitfalls should I look out for that could affect SEO and how should I input safegaurds to protect myself? I appreciate the support
Moz Pro | | arousta0 -
Are there tools to discover duplicate content issues with the other websites?
We have issues with users copy-pasting content from other sources into our site. The only way I know to find out, is to manually (!!) copy a snippet of their text into google, to see if I get results from other sites. I have been googling for tools to help automate this process, but without luck. Can you recommend any?
Moz Pro | | betternow0 -
Broad Website - What keyword to target
Hello, I have a Brand name Roclay; and my domain is roclay.com . It is technology blog and we cover literally all technologies etc and every article is unique with it's own keyword. Please help me as I am facing issue of SEO for many months now. What keyword should I focus on and how ? Moreover what should I setup in moz.com for keyword of my website when every single article is different. Regards
Moz Pro | | roclay0 -
A 301 redirect to a page with a rel canonical to a page with a 301 question...
MOZ registers thousands of DC and Duplicate titles on a Drupal site which has a little strange setup. Example: www.1234.com/en-us 301 redirects to www.realsite.com/en-us which has a rel canonical to www.1234.com which 301 redirects to www.realsite.com. If you're still with me I thank you.
Moz Pro | | Crunchii
My question is since MOZ registers errors, if indeed the rel canonical isn't recognized due to a 301 redirect?0 -
Find a 4xx or 5xx link referenced in an SEO Crawl Report
So I just got the Crawl Diagnostics report for a client site and it came back with a number of 4xx errors and even 1 5xx error. So while I can find the URL that has the problem, I cannot find the pages that have the links pointing to these non-existent or problematic pages. Normally I would just search the database for the site, but in this case I don't have access to it as the site is on a proprietary platform with no access other than to the CMS. Is there anyway to get the linking URL from the report? Thanks!
Moz Pro | | farlandlee0 -
Is it possible to exclude pages from Crawl Diagnostic?
I like the crawl diagnostic but it shows many errors due to a forum that I have. I don't care about the SEO value of this forum and would like to exclude any pages in the /forum/ directory. Is it possible to add exclusions to the crawl diagnostic tool?
Moz Pro | | wfernley2 -
Website migration
hi, I have to "refurbish" a website from scratch. This domain is quite old (2004) and has got a good audience. 1/ Is there a tip or a tool to guess with witch kind of framework (cms) is it made from ? I mean drupal, joomla, ezpublish, wordpress ..as i can't see it from code source. 2/ Have you got any method to migrate the old database (seems to be iis with asp language) into a new one (i work with php mysql) ? 3/ In order not to loose rankings in Serp, is there a tool to list the main urls with best link juice ? I will then redirect them with a 301 redirection in an .htaccess file. Many thanks..
Moz Pro | | mozllo0