How to set the crawler or reports to ignore
-
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off
I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
-
Thanks for the confirmation. I hadn't wanted to put that in the robots file because if inquisitive, non-robot traffic if you get my meaning, but in it goes; can't stand seeing errors.
-
Got it, thanks for jumping in so quick.
-
Hey Str8,
Donford is correct. You would need to specifically block our crawler from the mobile pages in your robots.txt file. Unfortunately, we don't currently have a way to disregard specific pages or errors in the web app, but we are looking to add that function sometime in the future.
I hope this helps. Please let me know if you have any other questions.
-
Hi Str8
**user-agent: rogerbot disallow: /*mobile=**
I think may do the trick... somebody may need to confirm this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Site Content found in Moz; Have a URL Parameter set in Google Webmaster Tools
Hey, So on our site we have a Buyer's Guide that we made. Essentially it is a pop-up with a series of questions that then recommends a product. The parameter ?openguide=true can be used on any url on our site to pull this buyer's guide up. Somehow the Moz Site Crawl reported each one of our pages as duplicate content as it added this string (?openguide=true) to each page. We already have a URL Parameter set in Google Webmaster Tools as openguide ; however, I am now worried that google might be seeing this duplicate content as well. I have checked all of the pages with duplicate title tags in the Webmaster Tools to see if that could give me an answer as to whether it is detecting duplicate content. I did not find any duplicate title tag pages that were because of the openguide parameter. I am just wondering if anyone knows:
Moz Pro | | MitchellChapman
1. a way to check if google is seeing it as duplicate content
2. make sure that the parameter is set correctly in webmaster tools
3. or a better way to prevent the crawler from thinking this is duplicate content Any help is appreciated! Thanks, Mitchell Chapman
www.kontrolfreek.com0 -
SeoMoz keyword page grader report card
Hi Ive recently 301 redirected old pages/urls to new pages/urls due to a site redesign. The seomoz kw report card is still reporting the old urls though with a significantly reduced score for most pages (i.e. from A's to now C's, from B to now D's etc). Does this mean mozbot is following the 301's & its actually the new urls being graded as such or is it referring to the old pages ? I will be adding the new urls to report card shortly but just interested in clarifying the above since i would have thought, if it is the old pages, they would not be reporting any score for those, or its scoring the new pages ? Many Thanks Dan
Moz Pro | | Dan-Lawrence0 -
Do the SEOmoz Campaign Reports follow Robots.txt?
Hello, Do the SEOmoz Campaign Reports (that track errors and warnings for a website) follow rules I write in the robots.txt file? I've done all that I can to fix the legitimate errors with my website, as reported by the fabulous SEOmoz tools. I want to clean up my pages indexed with the search engines so I've written a few rules to exclude content from Wordpress tag URLs for instance. Will my campaign report errors and warnings also drop as a result of this?
Moz Pro | | Flexcin0 -
Seomoz puts hyphen and company name after page title in the report, why?'
Hi Community, Can you figure out why this is happening? The title in the url itself does not contain - CodeBaby. Thank you! W6yg1cJ.png
Moz Pro | | CodeBaby0 -
How can i extract back link report in OSE of HTTPS domain?
Hello, Recently i was reviewing backlinks of one of the HTTPS domain and was socked to see the difference of backlinks in Majestic SEO and OSE tool. I tried a lot to find the option to explore the backlink of HTTPS domain but i think OSE is not providing that. Can anyone suggest the tool or method to find link report of HTTPS domains? Thank you, Sophie
Moz Pro | | sophiep0 -
Best Automated Report?
I would like to implement a reporting function to my website to offer a bit of value and information to potential clients. I am thinking along the lines of a simple input form to include a business name and url. The output would be a clean, branded (my business, url, phone) report that shows opportunities, lowest lying fruit, keywords most prominent, and any errors. I found this site - http://www.analyticsseo.com/ but, it seems pretty expensive. Does anyone have any suggestions on another suite that might work? Many thanks!
Moz Pro | | adell500 -
Personalised PRO Dashboard reports?
Hi guys, I'm loving the SEOMoz PRO dashboard and have learnt so much from the campaigns I've been running. I was wondering if I could personalise the reports to have my logo on them instead of SEO MOz's? At the moment, I export them and try recreate them offline, but it wouold be way easier if I could just send them the reports PDF'ed up straight from the dashboard.
Moz Pro | | Lindsay_D0 -
What is mT/mR good for In the keyword tool difficulty full report results?
So the ratio is MozTrust to MozRank, but what is this good for? What can I deduce from this and what can I use it for?
Moz Pro | | MarloSchneider2