Can SEOMoz crawl a single page as oppose to an entire subfolder?
-
I would like the following page to be crawled:
http://www.ob.org/_programs/water/water_index.asp
Instead, SEOMoz changes the page to the following subfolder which is an invalid url:
-
Yes. I think that will solve your problem.
-
Collin,
The address:
http://www.ob.org/_programs/water/
is an invalid link that does not exist - it's something that SEOMoz created, assuming that the valid link, which is a single page, is under that subfolder. So what you suggest is creating a redirect from the invalid link to the single page, correct?
-
By Resolve, I mean that the URL in question actually needs to end up showing the user content and not be a blocked page.
If you go to this address:
http://www.ob.org/_programs/water/
it gets a 403 server error. I'm not sure how SEOmoz handles this, but my gut tells me you'd probably be safe to just 301 redirect that URL to the following:
http://www.ob.org/_programs/water/water_index.asp
However, if that doesn't work, you will need to add content to and allow users to browse that specific page.
-
Hi Collin.
Thanks for your feedback. Now when say "resolve", what does that actually mean?
-
According to their "Set up a Campaign" page, subfolder is as specific as it gets. They mention that the subfolder must be resolved in order to be crawled.
Alternatively, if you're mainly interested in on-page items, you can use the "on-page optimization" tool under "Research Tools" to grade specific pages on keywords. Though I would suggest just resolving your .../water/ to actually show a page, then crawl the whole subfolder.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I hope someone can help me with page indexing problem
I have a problem with all video pages on www.tadibrothers.com.
Technical SEO | | TadiBrothers
I can not understand why google do not index all the video pages?
I never blocked them with the robots.txt file, there are no noindex/nofollow tags on the pages. The only video page that I found in search results is the main video category page: https://www.tadibrothers.com/videos and 1 video page out of 150 videos: https://www.tadibrothers.com/video/front-side-rear-view-cameras-for-backup-camera-systems I hope someone can point me to the right way0 -
Help! Pages not being indexed
Hi Mozzers, I need your help.
Technical SEO | | bshanahan
Our website (www.barnettcapitaladvisors.com) stopped being indexed in search engines following a round of major changes to URLs and content. There were a number of dead links for a few days before 301 redirects were properly put in place. And now, only 3 pages show up in bing when I do the search "site:barnettcapitaladvisors.com". A bunch of pages show up in Google for that search, but they're not any of the pages we want to show up. Our home page and most important services pages are nowhere in search results. What's going on here?
Our sitemap is at http://www.barnettcapitaladvisors.com/sites/default/files/users/AndrewCarrillo/sitemap/sitemap.xml
Robots.txt is at: http://www.barnettcapitaladvisors.com/robots.txt Thanks!0 -
Can you redirect from a 410 server error? I see many 410s that should be directed to an existing page.
We have 150,000 410 server errors. Many of them should be redirected to an existing url. This is a result of a complete website redesign, including new navigation and new web platform. I believe IT may have inadvertently marked many 404s as 410s. Can I fix this or is a 410 error permanent? Thank you for your help.
Technical SEO | | sxsoule0 -
How can the search engines can crawl my java script generated web pages
For example when I click in a link of this movie from the home page, the link send me to this page http://www.vudu.mx/movies/#!content/293191/Madagascar-3-Los-Fugitivos-Madagascar-3-Europes-Most-Wanted-Doblada but in the source code I can't see the meta tittle and description and I think the search engines wont see that too, am I right? I guess that only appears the source code of that "master template" and that it is not usefull for me. So, my question is, how can I add dynamically this data to every page of each movie to allow crawl all the pages to the search engines? Thank you.
Technical SEO | | mobile3600 -
Request to seomoz staff
Hi SeoMoz personnel I am pro member for few months here in the community. You have all googles in the rank tracking tool and the keyword analysis tool. Except from one. You dont have the google.com.cy and I was wondering if is problem to add it. If no its ok I track my results on the google.gr and google.com. But I would love if you could add it. Is also one plus for me when I promote the software to my local clients.... Thank you
Technical SEO | | nyanainc0 -
Duplicate Page Titles and %3E, how can I avoid this?
In my crawl report I keep seeing duplicate page title warning with URL's being referenced twice: e.g. /company/ceo-message/ /company/ceo-message/%3E I'm using canonical link tags but after the new crawl report, I'm still seeing this duplicate page title crawl error. How can I avoid this? I've been looking for answers for a few days but don't seem to see this exact problem discussed. Any insight is appreciated!
Technical SEO | | mxmo0 -
Page not being indexed
Hi all, On our site we have a lot of bookmaker reviews, and we are ranking pretty good for most bookmaker names as keywords, however a single bookmaker seems to have been shunned by Google. For a search "betsafe" in Denmark, this page does not appear among the top 50: http://www.betxpert.com/bookmakere/betsafe All of our other review pages rank in top 10-20 for the bookmaker name as keyword. What to do if Google has "banned" a page? Best regards, Rasmus
Technical SEO | | rasmusbang0 -
What is the largest page size a searchbot will crawl?
When setting up pagination, what should we limit the page size to? When will a searchbot stop crawling a particular page?
Technical SEO | | nicole.healthline0