Sitemap links
-
Hi, I´m running a sitemap using pro-sitemaps and I find several pages that shouldn´t be listed. How do I find how are these pages being generated? Can´t find the links the robot is following to get to those pages..
-
Screaming Frog is the best crawler out there imo. Have you talked to your hosting provider? They may be refusing the connection on their end.
-
Hi Thanks for your help! I keep getting "Connection Refused" status from the Screamin Frog..just couldn´t use it..I have tried the proxy, firewall and all recommended steps for solving this issue..
Is there a similar app?
Thanks!
-
Will try doing that thanks!
-
Have you considered using a tool like Screaming Frog SEO Spider?
It can crawl your site and it will list the inbound links to pages all neatly in a tab (exportable to Excel).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Correct Internal Linking Strategy
Hello. So my website currently has 8 pages in total. (Homepage, 5 Service Pages, Contact, About). I currently have about 80 quality RD and my Homepage already ranks #8 for my main keyword, while all Service Pages (P1, P2, P3, P4, P5) are stuck somewhere at #30-60 positions for their target keywords. My internal linking scheme looks like this https://i.imgur.com/2cA529v.png. The Homepage has a sidebar with links to all Service Pages, and each Service Page has the same sidebar that links to each Service Page, but doesn't link back to my Homepage. Contact and About pages can be accessed only via the links in the menu. I don't have any contextual links on my website, so all pages that are important for SEO are linked only via this same very sidebar. All these Service Pages are equally valuable to me, but they don't seem to grow much in Google. The Onpage Score of these pages is better than those of TOP10 competitors, and my content provides more value (I used the Skyscraper Technique). Taking all that into consideration, can you please tell me what might be wrong? Why Should I build more quality backlinks to these service pages instead of the homepage? Should I add contextual links to all my service pages from the homepage? Does my internal linking strategy look good to you? If not, what should I change? Can I hit top #10 with my internal pages for their target keywords if I mainly build links only to my homepage? All keywords that I'm after have low to medium competition. My website has 90 RD in total, and my website's DA is 27. Thank you. 2cA529v.png
Technical SEO | | NathalieBr3 -
URL Indexed But Not Submitted to Sitemap
Hi guys, In Google's webmaster tool it says that the URL has been indexed but not submitted to the sitemap. Is it necessary that the URL be submitted to the sitemap if it has already been indexed? Appreciate your help with this. Mark
Technical SEO | | marktheshark100 -
Google Search Console - Sitemap
Hi all, Quick question. I'm trying to update my sitemap via Google Search Console using a sitemap.xml file that I've created with ScreamingFrog. However, when trying to submit it, it seems that Google only allows sitemaps that are located at a path within your domain (i.e. www.example.com/sitemap.xml) as opposed to being able to directly upload a sitemap.xml file.Is there any way that I can easily upload my sitemap.xml file? Or is there any easy way that I can upload the file to a path on my domain so I can upload via the URL?Any insight would be much appreciated!Best,Sung
Technical SEO | | hdeg0 -
Sitemap duplicate title
At the moment we have a html sitemap which is pulling the same h1's/ titles. How big a problem is the duplicate content issue which is medium priority in the moz pro softaware? Would you recommend changes as sitemap page 1 - page 2 etc. Thanks
Technical SEO | | VUK-SEO0 -
Internal links best practices
In looking at the inbound links to a client’s Home page, I see that the link from each page of the website back to the Home page is an image, and the ALT text is “Home.” I have a few questions about this, and would appreciate help understanding best practices: --Does it matter that the link back to the Home page is an image (presumably the client’s logo)? -- If we keep the image link, wouldn’t it be better to use “client’s company name” as ALT text rather than “Home”? --Should I recommend using an HTML link back to the Home page, and using the company name as anchor text? (I don't think it's relevant, but the site is built in Drupal.) Thanks!
Technical SEO | | jrae0 -
What is the value of having an HTML sitemap on site?
For years now whenever we recreate a site we always set up both an xml sitemap and an html sitemap page. Stupid question maybe - but what is the value to having an html sitemap on site?
Technical SEO | | Pete40 -
How does your crawler treat ajax links?
Hello! It looks like the seomoz crawler (and google) follows ajax links. Is this normal behavior? We have implemented the canonical element and that seems to resolve most of the duplicate content issues. Anything else we can do? Example: Krom
Technical SEO | | AJPro0 -
Redirect not picking up any link juice
Hi, We recently had a domain name change, as we had an established site we had all pages redirected to the new domain. This was over a month ago but despite the redirect SEOmoz doesn't recognise any links to and from the site. Is this due to simply time duration and SEOmoz can't pick up on any redirected info, or could there be a problem with the redirect? Thanks, Adam
Technical SEO | | adamgthorndike0
