SEO Web Crawler - Referrer Lists XML Sitemap URL
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Strange "?offset" URL found with content crawl issues
I recently recieved a slew of content crawl issues via Moz for URL's that I have never seen before For example:
Moz Pro | | HannahPalamara
Standard URL: https://skilldirector.com/news,
Newly identified URL: https://skilldirector.com/news?offset=1469542207800&category=Competency+Management). Does anyone know where the URL comes from and how to fix it?0 -
Best SEO for New Lead Gen Site: Use Corporate Domain or Product Name?
Hello, wanted to poll the Moz community about a URL discussion my company is having. We plan to launch a new publicly-facing resource and want to leverage organic search as much as possible. For the domain, we’re considering these options: the corporate domain since it’s well established or the URL for the product, which is more descriptive of the content that will reside on the page, but doesn’t have much authority because almost all of the relevant content is behind a paywall. The product domain is appealing because we want to build brand recognition. Should we also look at a more specific domain for the topic that doesn’t leverage either branded domain? Any Moz tools you’d recommend to help research this decision? Thank you in advance for your thoughts!
Moz Pro | | Gbtyne0 -
How to do an SEO audit
Hi all, I am new to SEO at my company and I would like to complete a SEO audit. As a beginner, I am unsure as the depth to go in to this. A template for such an audit would be amazing! Can this be done without much technical help from the development team is the main question. They often seem stretched with current projects. I'd love to be able to show through the audit the state of our current SEO and then prioritize changes based on data. Some practical tips and suggestions on tools is greatly appreciated because through measuring the correct data, I will be able to put a case of which areas of our SEO needs work on. I really hope you can help me with this! Thanks,
Moz Pro | | Eric_S
Eric1 -
Automatically Check List of Sites For Links To Specific Domain
Hi all, Can anyone recommend a tool that will allow me to put in a list of about 200 domains that are then checked for a link back to a specific domain? I know I can do various link searches and use Google site: command on a site by site basis, but it would be much quicker if there was a tool that could take the list of domains I am expecting a link on and then find if that link exists and if so on what page etc. Hope this makes sense otherwise I have to spend a day doing it by hand - not fun! Thanks,
Moz Pro | | MrFrisbee
charles.0 -
Need help understanding search filter URL's and meta tags
Good afternoon Mozzers, One of our clients is a real estate agent and on that site there is a search field that will allow a person to search by filtered categories. Currently, the URL structure makes a new URL for each filter option and in my Moz reports I get the report that there is missing meta data. However, the page is the same the filter options are different so I am at a loss as to how to proper tag our site to optimize those URL's. Can I rel canonical the URL's or alt rel them? I have been looking for a solution for a few days now and like I said I am at a loss of how to properly resolve these warning messages, or if I should even be concerned with the warning messages from Moz (obviously I should be concerned, they are warning messages for a reason). Thank you for your assistance in advance!
Moz Pro | | Highline_Ideas0 -
DMOZ listing help
Is there someone with the wisdom to help me get my businesses listed on DMOZ? www.admiralmovers.com www.admiralrecordsmanagement.com
Moz Pro | | Smcnelley0 -
How to set the crawler or reports to ignore
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
Moz Pro | | Str82u0 -
GWT data v SEO Moz data
I'm sure there's a simple explanation but I can't find it- Looking through the GWT avg position data v SEOMoz ranking data and Market Samurai data there is a large discrepancy. For one term that we hold #1, and have held for a month or two GWTis showing that the avg position is 180 (and down 30). Any reason you know of why the GWT avg position data would be so out of whack with our SERP's and other data? Thanks.
Moz Pro | | MrPaulB0