Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Why my site not crawl?

Moz Pro

880

jahanidawodi last edited by

hi all

me allow rogerbot in robots.txt but rogerbot can't crawl my site

my site: toska-co.ir
1 Reply Last reply
Reply Quote 0
jahanidawodi last edited by

thanks brother

mr.maxi my problem has this:

moz bot can't crawl my website,

in robots.txt add rogerbot to allow crawl but moz can't crawl my site!

how fix that?
1 Reply Last reply
Reply Quote 0
jahanidawodi last edited by

hi maxi0218

How did you find out when Google crawled my site?
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

How do I mprove site visibility and keyword ranking for new product site

Hi, Sorry if this is a ridiculous post as I am really new to SEO, but I haven't had this problem with other sites! We had a website www.r-dna.co.uk that was never promoted or used very much as it was early days in the product lifecycle. The product (is called R-DNA or Remote Data Network Analysis) is now live so we re-branded and re-launched the site - it has now been live since the beginning of September but we still only have 0.35% visibility and very little ranking in our keywords. We are also using Google Adwords to try and generate business and have registered with numerous online business directories. I have been blogging to update content, tweeting and updating our facebook page, but we still aren't getting the traffic or visibility increases that we have experienced with our other sites. The MOZ site crawl shows 5 medium priority issues (duplicate title page & missing meta description tag), but no major issues. I know its probably fairly early days for a "new" site, but wondered if anyone could advise if there is anything wrong which would explain our lack of visibility.
Moz Pro | | sharon.bathurst

0
Why is my site not ranking?

I have done various link building strategies, and used all white hat seo methods. SEOMoz even shows that my site is better than all my competition, but yet it doesn't rank ANYWHERE on Google. Can someone point me in the right direction as to why this is happening? I have attached the opensitexplorer screenshot showing my competition. 2013-02-13_1456_zpsb86ab0e1.png
Moz Pro | | locallyrank

0
Crawled pages are missing and showing just 1 page crawled

One of my campaign has got around 8500 pages crawled(seomoz) and reports are shown, but suddenly it is showing 1 page crawled. Why it is happened like this? How can i get back the previous reports?
Moz Pro | | Sulekha

0
Crawl Diagnostics - unexpected results

I received my first Crawl Diagnostics report last night on my dynamic ecommerce site. It showed errors on generated URLs which simply are not produced anywhere when running on my live site. Only when running on my local development server. It appears that the Crawler doesn't think that it's running on the live site. For example http://www.nordichouse.co.uk/candlestick-centrepiece-p-1140.html will go to a Product Not Found page, and therefore Duplicate Content errors are produced. Running http://www.nhlocal.co.uk/candlestick-centrepiece-p-1140.html produces the correct product page and not a Product Not Found page Any thoughts?
Moz Pro | | nordichouse

0
How often does site explorer update.

My webmaster tools info is completely differernt to the opensite explorer info, I understand that site explorer only updates every so often but i reckon it been around four months since my stats were updated. Is there anywhere else i could view this info like PR and domain authority and actually get up to date info. Many thanks
Moz Pro | | totaldriveways

0
Open Site Explorer: Facebook Likes Accuracy

I show in open site explorer that I have 8 Facebook likes for my domain but I actually have 1500+ Facebook likes. Am I missing something?
Moz Pro | | fibers

1
Why Is SEOMOZ No Longer crawling All Of My Site

Hi all, I joined Seomoz over a month ago and Roger has been crawling all of the pages on the site approx 20 pages. Through out the last few weeks I have been working on the errors and notices identified by Roger. However, this week Roger has only re-crawled 1 page and is not picking up all the other pages. Has any one come across this problem. can you recommend any thing to resolve it? Many thanks in advance....
Moz Pro | | Dan28

0
Missing back links in Open Site Explorer?

I'm looking at the Open Site Explorer for my site, and it shows 9 links to my site, all from 2 domains (showing all links from all pages and for both www and not www version of my domain name). But I know for sure that there are other sites linking to my site. Are they not there because they are not important or because the links have not been crawled yet?
Moz Pro | | jsoldi

0