Is seomoz rogerbot only crawling the subdomains by links or as well by id?
-
I´m new at seomoz and just set up a first campaign. After the first crawling i got quite a few 404 errors due to deleted (spammy) forum threads. I was sure there are no links to these deleted threads so my question is weather the seomoz rogerbot is only crawling my subdomains by links or as well by ids (the forum thread ids are serially numbered from 1 to x).
If the rogerbot crawls as well serially numbered ids do i have to be concerned by the 404 error on behalf of the googlebot as well?
-
Roger only crawls by links.
When you are using forum software or a CMS it is very common for numerous links to be created by the software without your knowledge. If you examine your crawl reports, they will show you the URL of the page which provides the link which is generating the 404 error.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Links not appearing in Moz tool
Hey Guys I am finding that my Moz tool isn't showing links that are definitely there like from social media etc. Also links that are there about 4-5 months are not showing either! am i doing something wrong?
Moz Pro | | Johnny_AppleSeed0 -
How to exclude a specific subdomain from SEOMoz Campaign?
Forgive me if I've overlooked something obvious, but how can I exclude a subdomain from a campaign? I want to crawl/analyze mywebsite.com, but not subdomain.mywebsite.com Thanks in advance...
Moz Pro | | ahockley1 -
Crawl Report Warnings
How much notice should be paid to the warnings on the SEO Moz crawl reports? We manage a fairly large property site and a lot of the errors on the crawl reports relate to automated responses. As a matter of priority which of the list below will have negative affects with the search engines? Temporary RedirectToo Many On-Page LinksOverly-Dynamic URLTitle Element Too Long (> 70 Characters)Title Missing or EmptyDuplicate Page ContentDuplicate Page TitleMissing Meta Description Tag
Moz Pro | | SoundinTheory0 -
Not all pages are being crawled
I am set up on the PRO plan, I was under the impression that it would crawl up to 10,000 pages. My site has just over 200 pages, but whenever I am crawled it only crawls 121 pages. Is this normal? It's hard to know how reliable my data is because a significant amount of pages are missing.
Moz Pro | | KristinHarding0 -
How do you track new inbound links?
Hello Fellow SEOs, I've been charged with managing and tracking my company's linkbuilding efforts. I'd love to hear from others experienced in this area: -is there a way in OSE to sort links by date? -if this isn't possible, how can you tell what new links come in every month? Is this a manual process of downloading and comparing inbound links every week? This seems pretty tedious and I would love to hear what you all do and if there is a better way. I do have a Google Alert out for my company name, but that doesn't necessarily give me what I need. Thank you!
Moz Pro | | Jenny8675309
Jenny0 -
No follow Internal Links
Hello, I am comparing my site with my competitors. According to Open Site Explorer, my site has 541 internal follow links, and a total of 1,286 total internal links, implying I have 745 no follow internal links. I tried to drill into these internal no follow links using the "Inbound Links" report in OSE. But I'm receiving an error stating that No Data is Available for this URL. Does anyone have any insight to this? I'd really like to understand where those no follow links are coming from. Thanks in advance. eh70
Moz Pro | | TheBOTWGuys0 -
Seo moz crawl is not updating
When I check our seo campaign I can see that the report was not updated. It still show that the next crawl is Nov 1 but it is already Nov 3.
Moz Pro | | shebinhassan0 -
What the hell...spam on SEOMOZ!
I received this in my Private Messages section: My name is Fatima,i saw your profile at/www.seomoz.org/today and became intrested in you,i will also like to know you the more,and i want you to send an email to my email address so i can give you my picture for you to know whom i am.Here is my email address (fatimababy06@yahoo.com) I believe we can move from here I am waiting for your mail to my email address above.Fatima(Remeber the distance or colour does not matter but love matters alot in life) How can somebody spam like this on protected forum?
Moz Pro | | IM_Learner2