How to set the crawler or reports to ignore
-
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off
I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
-
Thanks for the confirmation. I hadn't wanted to put that in the robots file because if inquisitive, non-robot traffic if you get my meaning, but in it goes; can't stand seeing errors.
-
Got it, thanks for jumping in so quick.
-
Hey Str8,
Donford is correct. You would need to specifically block our crawler from the mobile pages in your robots.txt file. Unfortunately, we don't currently have a way to disregard specific pages or errors in the web app, but we are looking to add that function sometime in the future.
I hope this helps. Please let me know if you have any other questions.
-
Hi Str8
**user-agent: rogerbot disallow: /*mobile=**
I think may do the trick... somebody may need to confirm this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you create in the Keyword Difficulty Tool several separate reports?
If I go now to the Keyword Difficulty Tool and submit keywords, I get one list with all keywords (let's say 300), but I have actually say 30 keywords per segment/niche I wan't to view. Is is possible to have 10 separate reports?
Moz Pro | | TrendDevelopment1 -
How can I remove on-page reports from the Summary page?
Hi, I'd like to remove some on-page reports from the Summary page. I've already stopped them from running weekly. Is there a way to remove them completely?
Moz Pro | | csmm0 -
Can I setup SEOmoz PRO's 3 organic traffic metrics within Google Analytics (as custom reports)?
I like the 3 organic traffic metrics in SEOmoz PRO: 1) Organic Search Visits
Moz Pro | | AndreVanKets
2) URLs Receiving Entrances Via Search
3) Non-Paid Keywords Sending Search Visits They rock - especially for a high-level view of SEO / Organic performance. Is it possible to setup these metrics as custom reports directly in Analytics? Does anyone have these reports setup? Or maybe there are similar custom reports that give a similar high-level view?0 -
How to run down the actual source of a 404 error that is reported.
In my 404 errors, the second entry is as follows: URL: http://www.virginiahomesandforeclosures.com/listing/0428387-lot-k-commerce-park-franklin-va-23851/REWIDX_URL_CDNimg/no-image.gif Is there a simple way to find the root or page in which this error was generated? IF I visit this page " http://www.virginiahomesandforeclosures.com/listing/0428387-lot-k-commerce-park-franklin-va-23851" without the attached gobble de gook, I see a good page. So bottom line its possible it could be in one of my sitemaps, but I have 50 of those so its time consuming to search thru all 50 for each error like this since I have so many. I am pretty sure its not in my sitemaps, since google has not picked up any of these errors and they have crawled over 12,000 urls so far. When google gives me a 404 error I can click on the link and find what pages they found the link and go there and correct it at the root. Any suggestions would be greatly appreciated. I have more than 1,000 of these errors with the bad url with the junk attached to the end and have not been able to isolate the cause yet. Thanks in advance.
Moz Pro | | tommytx0 -
How would you set up campaigns?
Hi Guy's, I have a question about campaigns, We run a eCommerce website with several categories with sub cats/ i.e. natural hair care Natural Shampoo Natural Conditioner Natural Treatments natural Skin Care etc etc My question is this... do you use campaigns to separate the sites sections up? or do you run one campaign, trying to get my head around the best way to target my sections for performance/keywords etc... Thanks Daniel
Moz Pro | | LushDuck0 -
Are Pro plan users limited to a 3 report limit in open site explorer?
I have Pro Plan but get a 3 report limit for the day when exporting from open site explorer: Login Run a report in open site explorer Click 'Send as CSV' Message shows: Your export has been started and will be emailed to you in 5 - 10 minutes. email arrives Link takes me to a HTML message:
Moz Pro | | bitedigital
You've been busy! Looks like you've hit your 3 report limit for the day. Login or register for a free account to get unlimited reports with data on 5x more links! I thought I could use this unlimited?0 -
How to associate landing pages to specific key phrases on my report cards
On my on-page optimization reports, all my key phrases are related to my index page. Is that a way I can associate specific key words to specific landing pages automatically, without having to go to on-page report card and insert the landing page address all the time? The reason why I am asking this is because my marks are low, because associates with the index which is not optimized for some specific key phrases.
Moz Pro | | juliantile0