Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Why my site not crawl?

Moz Pro

897

jahanidawodi last edited by

hi all

me allow rogerbot in robots.txt but rogerbot can't crawl my site

my site: toska-co.ir
1 Reply Last reply
Reply Quote 0
jahanidawodi last edited by

thanks brother

mr.maxi my problem has this:

moz bot can't crawl my website,

in robots.txt add rogerbot to allow crawl but moz can't crawl my site!

how fix that?
1 Reply Last reply
Reply Quote 0
jahanidawodi last edited by

hi maxi0218

How did you find out when Google crawled my site?
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Crawl diagnostics taking too long

I started a crawl 2 days ago and it was still going after almost 48 hours so I deleted the entire campaign and resubmitted it. It's been 13 hours and still going. What happened to getting initial results in 2 hours? I've never had this problem and have run several campaign crawls here. Just wondering if there is a known issue I just can't seem to find? Thank you
Moz Pro | | LisaS13

0
Which of these is the best guest blogging site

Which of these is best: http://www.guestblogit.com/http://www.bloggerlinkup.com/ http://www.Myblogguest.comhttps://www.helpareporter.com/ I like the look of MyBlogguest.com so far. We are wanting to guest write articles to be published on quality sites in exchange for one or two links back (link building) Also, how do you choose what article topics to write. So far my strategy is to look at the industry's biggest sites and to use the "Top Pages" tab in OSE to look for hot topics. Thanks!
Moz Pro | | BobGW

0
Finding page authority for a list of sites

I went to Distilled's linklove conference earlier this week. Many of the presenters showed spreadsheets where they had pulled in Page Authority for a long list of sites. What tool can you use to quickly do this? For instance, I want to be able to copy a list of 100 sites into a tool and have it spit out the PA for every site...anybody know how to do this?
Moz Pro | | znotes

0
Why Is SEOMOZ No Longer crawling All Of My Site

Hi all, I joined Seomoz over a month ago and Roger has been crawling all of the pages on the site approx 20 pages. Through out the last few weeks I have been working on the errors and notices identified by Roger. However, this week Roger has only re-crawled 1 page and is not picking up all the other pages. Has any one come across this problem. can you recommend any thing to resolve it? Many thanks in advance....
Moz Pro | | Dan28

0
Crawl still in progress ...

Hi guys, New crawl on one of my campaigns is still in progress since November 27th, i didn't get new data since November 19th 2011 ... What should i do ?
Moz Pro | | DavidEichholtzer

0
Is seomoz slower now crawling links?

It seems not to have updated any backlinks to my domain in a long long time
Moz Pro | | adam2012

0
Fetch googlebot for sites you don't own?

I've used the "fetch as googlebot" tool in Google webmaster tools to submit links from my site, but I was wondering if there was any type of tool or submission process like this for submitting links from other sites that you do not own? The reason I ask is, I worked for several months to get a website to accept my link as part of their dealer locator tool. The link to my site was published a few months ago, however I don't think google has found it and the reason could be because you have to type in your zip code to get the link to appear. This is the website that I am referencing: http://www.ranchhand.com/dealers.php?zip=78070&radius=20 (my website is www.rangeroffroad.com) Is there any way for Google to index the link? Any ideas?
Moz Pro | | texmeix

0
External Links through Open site explorer

I have just ran an Open site explorer query on our site due to having one of a constant ranking keywords drop, and found that we have 48 new links appear on the report under the anchor text 'home' These are not normal links, and I cannot see where or how these have been connected to our site for example: <colgroup span="1"><col span="1" width="696"></colgroup>
| http://regvac.com/TrIsland.swb <colgroup span="1"><col span="1" width="696"></colgroup>
| http://meteonorm.com/fileadmin/tmy3/722066ndry3.rdm | <colgroup span="1"><col span="1" width="696"></colgroup>
| http://www.sexintheshower.net/downloads/SS960-12-pack.psd?ActDo=ShowArt&Information_ID=2396&Parent_ID=&type=&Langue_ID=An&rubID=3068473 | My question is how and why are these appearing on the seomoz open site explorer report? What are they? How can I get them removed, and let google know this was nothing to do with us? Thanks S |
Moz Pro | | hickboy5

0