Changing Subfolder that has been crawled before
-
Question:
I am using a wordpress multisite and I enabled the crawl options yesterday
www.abc.com/subfolder <-original
but i find that www.abc.com/sub is good enough
I checked the site:abc.com but I find that my pages in the /subfolder has been crawled before.
Can I just change it to www.abc.com/sub or it will raise duplicate content issue?
-
Thank you so much. I think it wasn't a big deal everything seems fine!
-
If you go to the research tools tab, there's a link to SEO Web Crawler. You can request a crawl of your site instead of waiting the week for Roger to normally come back to your site.
-
Updated Reply
I will study the plugin and wait for MOZ crawl and will get back to you.
Thanks Keri
The MOZ crawl shows yesterday's data. so it hasn't checked my updated URLs.
I am worried that all of my new /sub will be 404 by tomorrow.
-
It's useful to have the redirection plugin in general, I've found.
Can you tell me a little bit about the crawl error you're getting from the SEOmoz crawl?
-
Thank you so much Keri again for your super fast reply.!
are you suggeting that I need to do both?
the redirection plugin and sitemap update?
or sitemap update should be just fine?
I am studying the Redirection plugin right now I think it would be useful to redirect what SEOMOZ analytic bot thinks is an wrong URL to a proper URL?
P.S. I am asking this because
I have an horrific experience before. (it's a different case, not related to my previous questions) It's a bit different because I once moved one of my websites to a different domain and google just kept on crawling the previous domain name's data, and sending 404 and my new domain name got penalized. (I still can't get it shown on Google after a few months) so I thought it would happen the same to subfolders.
-
You'll probably be just fine. The XML sitemap plugin will also help tell Google where the new URLs are, and you'll have the redirection as well.
-
Thank you so much Keri for answering my questions.
The subfolder website is totally new. Google hasn't crawled it fully yet.
there is no backlink. no one knows the website exists except our team.
hmmm. so updating the sitemap won't do it all? sigh. I am a newbie so i just have to trust you guys..
I already changed the subfolder and will download the Redirection plugin in WP right now
-
You would want to use a 301 redirect (the Redirection plugin in WP is good for this) to tell Google that the old content moved to the new location. If you install it then do the changes, it may even do the necessary redirection for you automatically.
Am I correct in that you just set this up a day ago, so it's not like you're doing this three years in with a whole bunch of backlinks and needing to worry about link juice?
-
Thank you so much for answering this so quick
so i can just change it, and update the sitemap and i should have no problem right?
I was worried because I thought once google crawl my web, it remembers my previous /subfolder and add my /sub on top of it. and I thought my original /subfolder would be 404 and /sub would be duplicate content.
but I am so relieved now! I think i was just being paranoid.
-
Change it and make sure you update your sitemap so when it is crawled again, they will have it correctly.
if you don't already have a sitemap plug in use the google xlm sitemap plug in. Does a great job....
Cheers.....
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Changing url (permalink) structure of website??
Currently I'm working on SEO of one website www.mocomi.com. I want to change url (permalink) structure of entire website which has more than 5000 pages. Currently website have structure of http://mocomi.com/tenali-raman-the-kings-condition/ Which I want to change it to http://mocomi.com/fun/stories/tenali-raman/tenali-raman-the-kings-condition/ Likewise I want to change entire website permalink url structure to make site architecture more SEO friendly. Which means I'am going to add only categories & subcategories before actual link. Kindly guide with following questions which I need to move forward with this step. How much is it worth to change URL structure? Checklist or factors I need to consider while making this decision? Is it a good practice to change URL's of entire website at once or Should I change it in Parts? How much time it takes google to rank those urls again? Which are the best practices to do so?
On-Page Optimization | | Mocomi1 -
Moz crawl
Hi, 1. Is there any way to get the moz crawl to analyse any site like the website auditor tool in seo powersuite on command. It would be good to see what keyword my competitors are using. would also like to analyse my site when i have corrected errors on command. 2. Is google adwords keyword tool still the best keyword research tool? I Don't see anything in the newbie guides to the moz pro tool regarding keyword research. Thanks! David.
On-Page Optimization | | WallerD0 -
Moz Crawl Shows Duplicate Content Which Doesn't Seem To Appear In Google?
Morning All, First post, be gentle! So I had Moz crawl our website with 2500 high priority issues of duplicate content, not good. However if I just do a simple site:www.myurl.com in Google, I cannot see these duplicate pages....very odd. Here is an example....
On-Page Optimization | | scottiedog
http://goo.gl/GXTE0I
http://goo.gl/dcAqdU So the same page has a different URL, Moz brings this up as an issue, I would agree with that. However if I google both URL's in Google, they will both bring up the same page but with the original URL of http://goo.gl/zDzI7j ...in other words, two different URL's bring up the same indexed page in Google....weird I thought about using a wildcard in the robots.txt to disallow these duplicate pages with poor URL's....something like.... Disallow: /*display.php?product_id However, I read various posts that it might not help our issues? Don't want to make things worse. On another note, my colleague paid for a "SEO service" and they just dumped 1000's of back-links to our website, of course that's come back to bite us in the behind. Anyone have any recommendations for a good service to remove these back-links? Thanks in advance!!0 -
Why would changing 404 pages increase traffic by 9%?
Neil Patel claimed in this article that by creating a custom 404 page that links out to 25 to 50 random internal pages on the website, he was able to increase the traffic of Techcrunch by 9%. I'm a bit skeptical about this claim. A couple of questions: Is this theory sound? If you've personally tried this or have read other articles supporting Neil, I'd love to learn more. Would a big site like Techcrunch really have problems with Google not indexing all of its pages? Also, does getting more pages crawled help you get more traffic? Specifically, would it help a site like mine? For reference, my site gets an average of 12,040 pages crawled per day in last 90 days. Currently 28,922 pages have been indexed. Are there any possible downsides to trying this? Thanks!
On-Page Optimization | | Brand_Psychic0 -
Error is not going away and crawling
I have fixed an error but its still showing in red as error. Im totally new to SeoMoz and to SEO in general so im not sure how this tool works. Did I fix it correctly or not if its still showing? It was a broken link and now it links up to another page. Do I just have to wait? My website only has 8 pages and on the dashboard it says crawled 8 pages but it takes up to a week for a full crawl? Im really confused. Thank you in advanced!
On-Page Optimization | | Pixeltistic0 -
I built a website on magentogo - IrisScottPrints.com. The seomoz crawl report states 301 rel canonical crawl notices. What if anything should I change?
Wondering if I should remove "IRIS SCOTT PRINTS |" from all the title tags and/or change the url structure of the pages, to not include the breadcrumbs... I don't really understand the whole rel canonical structure thing. Also lots of errors on page title too long - does that really matter? Lots of faith in everyone here. Thanks in advance. Marcia
On-Page Optimization | | RedTrout0 -
How To Prevent Crawling Shopping Carts, Wishlists, Login Pages
What's the best way to prevent engines from crawling your websites shopping cart, wishlist, log in pags, ect... Obviously have it in robots.txt but is their any other form of action that should be done?
On-Page Optimization | | Romancing0 -
Would it be bad to change the canonical URL to the most recent page that has duplicate content, or should we just 301 redirect to the new page?
Is it bad to change the canonical URL in the tag, meaning does it lose it's stats? If we add a new page that may have duplicate content, but we want that page to be indexed over the older pages, should we just change the canonical page or redirect from the original canonical page? Thanks so much! -Amy
On-Page Optimization | | MeghanPrudencio0