How to set the crawler or reports to ignore
-
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off
I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
-
Thanks for the confirmation. I hadn't wanted to put that in the robots file because if inquisitive, non-robot traffic if you get my meaning, but in it goes; can't stand seeing errors.
-
Got it, thanks for jumping in so quick.
-
Hey Str8,
Donford is correct. You would need to specifically block our crawler from the mobile pages in your robots.txt file. Unfortunately, we don't currently have a way to disregard specific pages or errors in the web app, but we are looking to add that function sometime in the future.
I hope this helps. Please let me know if you have any other questions.
-
Hi Str8
**user-agent: rogerbot disallow: /*mobile=**
I think may do the trick... somebody may need to confirm this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
OnPage report check
Is anyone else having issues with onpage report card on SEOmoz: I keep getting this message: The change you wanted was rejected. Maybe you tried to change something you didn't have access to.
Moz Pro | | deaddogdesign0 -
Where can I upload my logo for custom reports?
Hi, I've read the custom reports FAQ and it said I can upload my logo for white labeling under campaign settings. I navigated to campaign settings but haven't found the place to upload my logo. Could you please help? Barnabas
Moz Pro | | Barna0 -
My rankings report is giving out wrong information
Hi, i am very puzzled about the rankings report. For some reason the past couple of weeks it is giving wrong information for example, my site www.in2town.co.uk the report says that the keyword gastric band hypnosis is eight in google on page one but when i have checked i cannot find it. It also says the word gastric band hypnotherapy is sixth place in google on page one can anyone please let me know what is going on
Moz Pro | | ClaireH-1848860 -
Site Ranking Report
Hi guys, My site ranking report says that I've gone from being 1-20 for a variety of keywords in Google UK to not in the top 50. When I do a search myself I see that my site remains where it previously was (between 1-20). How reliable is the site ranking reporting on a weekly basis? Is it best to look at it monthly?
Moz Pro | | columbus0 -
Bing Not Complete in Ranking Report
Curious as to what the "FRI" image means under Bing on my Keyword Ranking reports? I saw this on Friday and assumed it hadn't crawled yet (as it was to set to crawl on Friday Jan 27, 2012) but here we are Monday AM and I'm still seeing the same thing. Glf4F.jpg
Moz Pro | | QueenSt0 -
Will Social be Incorporated into the New Reports Interface
Just wondering if there are plans to integrate the social media reporting section with the new "Reports" section. Having a social section in the new Reports interface that could show weekly/monthly/yearly Facebook and Twitter interactions would be awesome to have all in one PDF report with the rest of the reporting options.
Moz Pro | | noBulMedia0 -
How to set up SEOMOZ to track multilanguage sites?
Hi, I am managing a site in 5 different languages/regions. Our language structure is as follows: www.domain.com/en-us/ - For US www.domain.com/en-uk/ - For UK www.domain.com/fr/ - For France ... However, SEOMOZ does not allow to set up a domain with "/" as a campaign. How can I do it? Thanks
Moz Pro | | hockerty1