Software/tool for Content Inventory
-
Is there any tool out there which can crawl a section of a website (or whole website) and gives a list of urls by subsections?
I have tried PowerMapper but it only gives visual map, not a list.
Thanks!
-
You can use Moz, Screaming Frog, Sort Site to get results.
-
Xenu mya work http://home.snafu.de/tilman/xenulink.html
-
How about Screaming Frog? - http://www.screamingfrog.co.uk/seo-spider/
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to block index of link and content
Hi, We have pages where articles are shown and in the sides we have small snippets of Articles which shows the title and close to 25 words and a image. When i search for something in Google the snippet image and content is shown and in Google when clicked it redirects to a page which is not meant to be shown for the keyword the visitor is querying Is there a way i can block all the links and content shown in the right and left side of the page so Google does not get confused with the page content thats not related to that page? thanks
On-Page Optimization | | AlexisWithers0 -
Duplicate content penalty
when moz crawls my site they say I have 2x the pages that I really have & they say I am being penalized for duplicate content. I know years ago I had my old domain resolve over to my new domain. Its the only thing that makes sense as to the duplicate content but would search engines really penalize me for that? It is technically only on 1 site. My business took a significant sales hit starting early July 2013, I know google did and algorithm update that did have SEO aspects. I need to resolve the problem so I can stay in business
On-Page Optimization | | cheaptubes0 -
Duplicate content, is it ever ok?
I am building a large site for a client who sells physical products. I am using WordPress as my CMS (as a piece of background information). There are a few products that need to be listed in the sites hierarchy in multiple locations as such: Parent A Child 1 Parent B Child 2 Child 3 Parent C Child 1 I am concerned that having a product exist in multiple instances will cause indexing problems for that product. I can't be the only person to come across this issue, would love some feedback on the best practices for such an issue. Thanks in advance
On-Page Optimization | | Qcmny0 -
Logged In Only Content Made Available to Googlebot
Hi guys, On this page, http://www.jobiness.sg/changi-airport-group/work-reviews/id-18180200170/?page=2, I require my users to sign up to be able to view the content. I would like to make this available to search engine crawlers. Also, are there any general guidelines regarding making this type of optimization? Is this considered acceptable within Google's guidelines? From my research, there seems to be 3 ways to go about doing this: Creating an account for the bots such that they are considered 'logged in users' Adding checks to my html to see the http user agent Google click first free (havent dont much research into this yet)
On-Page Optimization | | adminjob0 -
Moving content from one site to another
I have a couple established, content rich sites with some content that I would like to move over to a new site. My question is what steps I need to take to ensure that neither my older sites nor newer sites are penalized for duplicate content. The purpose for moving the content is to add some depth to the new site for users, as well as possibly optimize it all for SEO. There is a fair amount of content involved, about 50 posts and pages per site, so I'd like to know if the potential problem with duplicate content might be serious enough that I should think twice. What do you recommend?
On-Page Optimization | | LeeAbrahamson0 -
Summarize your question.Images being seen as duplicate content/pages
My images suddenly are appearing in my crawl reports as duplicate content, without meta tags, this happened over night and cant figure out why.
On-Page Optimization | | RBYoung0 -
Duplicate Page Content Issues
How can I fix Duplicate Page Content Issues on my site : www.ifocalmedia.com. This is a WP site and the diagnostics shows I have 115 errors? I know this is damaging to my SEO campaign how do I clear these? Any help is very welcome.
On-Page Optimization | | shami0 -
SEOMOZ tool - on page optmization question
Ok, I had the tool examine a page and while I got an A, it did say this..... Avoid Keyword Self-Cannibalization Easy fix <dl> <dt>Cannibalizing link</dt> <dd>"Kitchen Storage Racks", "Home Storage Racks", "Garage Storage Racks", "Wine Storage Racks", "Bicycle Storage Racks", and "wine storage racks"Explanation</dd> <dd>It's a best practice in SEO to target each keyword with a single page on your site (sometimes two if you've already achieved high rankings and are seeking a second, indented listing). To prevent engines from potentially seeing a signal that this page is not the intended ranking target and creating additional competition for your page, we suggest staying away from linking internally to another page with the target keyword(s) as the exact anchor text. Note that using modified versions is sometimes fine (for example, if this page targeted the word 'elephants', using 'baby elephants' in anchor text would be just fine).</dd> <dt>Recommendation</dt> <dd>Unless there is intent to rank multiple pages for the target keyword, it may be wise to modify the anchor text of this link so it is not an exact match.</dd> </dl> The keyword that was optimized was "storage racks". In the explanation it says that baby elephants is fine if elephants is your keyword so why isn't wine storage racks or kitchen storage racks ok what is the difference? why is mine cannibalizing but baby elephants is not? This may be very simplistic to you all but I'm learning as i go, thank you in advance
On-Page Optimization | | stacksofracks0