Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Why my site not crawl?

Moz Pro

900

jahanidawodi last edited by

hi all

me allow rogerbot in robots.txt but rogerbot can't crawl my site

my site: toska-co.ir
1 Reply Last reply
Reply Quote 0
jahanidawodi last edited by

thanks brother

mr.maxi my problem has this:

moz bot can't crawl my website,

in robots.txt add rogerbot to allow crawl but moz can't crawl my site!

how fix that?
1 Reply Last reply
Reply Quote 0
jahanidawodi last edited by

hi maxi0218

How did you find out when Google crawled my site?
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Unsolved How many sites can I track with one subscription?

moz pro

Hello, We are currently a MozPro medium member and we are tracking amlrightsource.com but we have other sites we'd like to track as well. Wondering if we can track more sites with this subscription?
Moz Pro | | KassandraSharr

0
How often does seomoz crawl the site? Can you force a crawl at a specific time ?

How often does seomoz crawl the site? Can you force a crawl at a specific time ?
Moz Pro | | stewbuch1872

0
Order of urls in SEOMoz crawl report

Is there any rhyme or reason to the order of urls in the SEOMoz crawl report, or are the urls just listed in random order?
Moz Pro | | LynnMarie

0
How can i get seomoz to crawl a campaign on demand

hi how can i get seomoz to crawl a campaign on demand instead of on a weekly basis? For example i have corrected some error warnings and on page elements and would like it to re crawl the site sooner to see how the corrections have worked? thanks
Moz Pro | | Bristolweb

0
Only 1 page has been crawled. Why?

I set a new profile up a fortnight ago. Last week seomoz crawled the entire site (10k pages), and this week has only crawled 1 page. Nothing's changed on the site that I'm aware of, so what's happened?
Moz Pro | | tompollard

0
Factoring in OBL to Open Site Explorer

Morning all - I've been using Open Site Explorer a fair bit since I signed up to SEOMoz a couple of months ago and found it to be a little different to other tools in the past, so would welcome some thoughts on what I should be looking for when I run reports. For example, I've always thought that Outbound links should be important when deciding whether to place a link on a a particular site, but in OSE I'm only given a Page Ranking and a Domain Ranking. Am I therefore to understand that these two factors outrank OBL and that the number of links on a page don't matter? Or have these been factored into the overall Page rank already? Thanks a lot for your help,
Simon
Moz Pro | | theshortstack

0
Internal links not showing in Open Site Explorer

So I'm working on a law firm site and looking at the links for pages in OSE. For practice areas, the links to each practice area are in the left hand menu on every page of the site. Can anyone help me with this question: Example: http://www.comitzlaw.com/personal-injury/car-accidents.html When I plug this URL into OSE, it only shows one linking page, www.comitzlaw.com/practice-areas.html, yet there is a link to this on every other page in the site. When I plug in a random competitors page, www.lesagelblaw.com/Personal-Injury-Overview/Car-Accidents.shtml, it does show all the internal pages linking to it. Since I'm not using a flash menu or javascript, any ideas as to why no internal links are showing up in OSE? Even when I plug in the main URL for the home page, it only shows 4 other internal pages linking to it, yet there is a link on every page. What am I doing wrong?
Moz Pro | | c2g

0
Links in Open Site Explorer turning into downloads

Hey guys. This is my first question on here so hello 🙂 I have noticed recently a couple of times in Open Site Explorer, when I am checking out links, they are direct download links. The two I have noticed are flash files and with one companies links, dropbox related. Can anyone shed any light on this? I am pretty new to SEO and find it really confusing. Thanks in advance 🙂
Moz Pro | | Nextman

0