Welcome to the Q&A Forum

Thanks a lot for sharing Travis. This is really helpful!

Appreciate your help here.

Thanks Schwaab!

Hi Travis

That sounds like a smart way to go about this. Could you please guide me regarding how to add parameters like lastmod, priority, changefreq etc in the XML sitemap, using the URLs that I have in the Excel sheet.

Thanks!

Hi!

Our website has a very large no of pages. I am looking to create an XML Sitemap that contains only the most important pages (category pages etc). However, on crawling the website in a tool like Xenu (the others have a 500 page limit), I am unable to control which pages get added to the XML Sitemap, and which ones get excluded.

Essentially, I only want pages that are upto 4 clicks away from my homepage to show up in the XML Sitemap.

How should I create an XML sitemap, and at the same time control which pages of my site I add to it (category pages), and which ones I remove (product pages etc).

Thanks in advance!

Apurv

Thanks for sharing this information Thomas. Appreciate your time and help here. Regards.

Hi Thomas! When I say 1 click, I mean all links that can directly be reached from www.wishpicker.com. For example

wishpicker.com/gifts-for can be reached directly from wishpicker.com

wishpicker.com/gifts-for/boyfriend cannot be reached directly from wishpicker.com. I would first need to go to wishpicker.com/gifts-for, and then go to wishpicker.com/gifts-for/boyfriend. So wishpicker.com/gifts-for is 1 click away, and wishpicker.com/gifts-for/boyfriend is 2 clicks away from wishpicker.com.

I am looking to crawl all links that are only 1 click away. Thanks for your help here. Really appreciate it.

Hi Thomas

Thanks for your response. Here is my website: www.wishpicker.com

What I am looking for is all the links present only 1 click away from the page www.wishpicker.com (both internal and external).

Performing a crawl with screaming frog is giving me all links (1, 2, 3, 4, and more clicks away). Not sure how to limit the crawl to show links that are only 1 click away, and exclude links that are 2 or more clicks away from this page.

Look forward to your response.

Thanks!

Hi! This might sound like a newbie question, but I'm trying to find all crawlable links (that google bot sees), on a particular page of my website. I'm trying to use screaming frog, but that gives me all the links on that particular page, AND all subsequent pages in the given sub-directory. What I want is ONLY the crawlable links pointing away from a particular page. What is the best way to go about this? Thanks in advance.

Thanks! We shall wait in that case. Cheers

Hi folks! I was checking the backlink profile for my website - wishpicker.com - we got linked to by a large number of prominent websites in the last couple of months. For some reason, this does not seem to show up when I do a backlink search on OSE. Is there something that I need to do here/ fix? Thanks in advance!