Open Site Explorer is finding old html Files that havn't been on my site in two years... even after a 301 Redirect. HELP!
-
Hello!
My problem started when I became aware that when I checked my backlinks for the past two years, it states that no backlinks have been found. When I ran a site analysis on SEMrush - No backlinks are found on the URL, or Domain. There are 7 Backlinks on the Root Domain and those were configured in 2012. I made a second domain www.columbusweddingphotographersreviews.comwhere I linked to my domain at www.morganlindsayphotography.com so I could test that google had crawled both websites and after, still no backlink was found. I have also been published on a dozen or so wedding websites that has linked to my website where they are follow links and still nothing. (http://www.brendasweddingblog.com/blogs/2015/2/23/an-elegant-fall-wedding-in-ohio-with-morgan-lindsay-photography)**Website Background- **
In 2012 I had two separate websites - One for Seniors that was an HTML website I build in Dreamweaver at www.morganlindsayphotography/seniors and another for Wedding Clients found at www.morganlindsayphotography.com/Wedding - (wordpress) I had a Splash page wish was found atwww.morganlindsayphotography.com. Two years ago when I became aware splash pages were frowned upon in Google, I combined the two websites and stayed with the Wordpress which was www.morganlindsayphotography.com/Wedding
Because I did not want users to have to go to www.morganlindsayphotography.com/Wedding to view my url, Godaddy moved my wordpress site from thewww.morganlindsyphotography.com/Wedding directory towww.morganlindsayphotography.comWhen I ran the Open Site Explorer with Moz I found after runningwww.morganlindsayphotography.com the TOP pages on this domain according to Page Authority are old HTML files from my senior website, as well as old Posts from when my wordpress site was found atwww.moragnlindsayphotography.com/Weddings
No current pots or pages are showing up besideswww.morganlindsyphotography.com I do run a cache management system to speed up my system and recently cleaned out my .htcacess folder and still had no luck. This is difficulty something**Last night I made a 301 Redirect in my htaccess for all the old links pointing to the new links as best as I could. My htacess folder looks like this..
BEGIN WordPress
<ifmodule mod_rewrite.c="">RewriteEngine On
RewriteBase /
RewriteRule ^index.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]</ifmodule>END WordPress
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /Wedding http://www.morganlindsayphotography.com/
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /Wedding/ http://www.morganlindsayphotography.com/
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /about.html http://www.morganlindsayphotography.com/about-morgan-lindsay/
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /app.html http://www.morganlindsayphotography.com/blog/
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /experience.html http://www.morganlindsayphotography.com/senior-sessions/
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /index.html http://www.morganlindsayphotography.com/
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /senior.html http://www.morganlindsayphotography.com/ohio-senior-photographer/
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /seniorsconstruction.html http://www.morganlindsayphotography.com/ohio-senior-photographer/
Permanent URL redirect - generated by www.rapidtables.com
Redirect 301 /Wedding/2012/06/22/brittany-reis-jason-mcclaflin-tiffin-ohio-wedding/ http://www.morganlindsayphotography.com/holy-family-church-columbus-wedding/
After I ran the open site moz explorer and the www.morganlindsayphotography/Wedding was still there..
-
I don't know if you're looking at the right thing...
- Your site is listing in Google if you check with a site:morganlindsayphotography.com search, so that's current.
- Plus DNS tools show that your site is pointing to the correct nameservers: https://www.whatsmydns.net/#NS/morganlindsayphotography.com.
- Further, there aren't any pages listed that are your old 'html' style: https://encrypted.google.com/search?q=site%3Amorganlindsayphotography.com+inurl%3Ahtml.
- And I'm seeing pages that have been crawled as recently as February: site search with "past month" selected from search tools.
- If you're in Google Webmaster Tools and go to Google Index >> Index Status, you'll see a running timeline of how many pages Google has in their index up to recent dates.
Starting a new domain and rebuilding your site would be a bad idea as it would only delay OSE further.
-
Hi Ryan, I undated my google sitmap to Google and bing two weeks ago and it still hasn't fixed anything. I re-uploaded today and still nothing. I understand it takes time but I feel like there may be another issue.
I I have a Google +. local page and have updated it weekly for the past 6 months. you can find my profile here https://plus.google.com/+MorganLindsayPhotographyTiffin
after doing some reserch I remembered I used to have used MAMP application configured and pointed to my www.morganlindsayphotography.com site two years ago. This was used to test a php contact form when my website was html: I also found a robot.txt file but no site map in the root folder. I checked the mamp folder and found files that are still coming up in the moz open site explorer In this mamp root folder.
the www.morganlindsayphotography.com/app.html
the www.morganlindsayphotography.com/senior.html
the www.morganlindsayphotography.com/experience.html
....all of the files found on my MAMP root directory for Www.morganlindsayphotography.com were the url's that were named in the folder of the in the mamp application.. Could this be causing the issue? I'm ready to start a new domain and rebuild my site. I'm not sure what to do.
thanks again, Ryan!
-
Wow. Well the good news is that I see a sitemap at http://www.morganlindsayphotography.com/sitemap.xml which seems accurate to your current site. If you submit that within Google Webmaster Tools and Bing that will help refresh pages there.
The other aspect of all this stuff is getting more external links, so feel free to link up your social profiles: linkedin, twitter, facebook, etc. to point back to your site as your home page. You can announce new blog posts via twitter as well. You can also link up photography orientated sites like 500px, flickr, dphoto, and so on to point back to your main site as your home page within your profile. All this should help update the other services as they crawl those sites.
The other aspect is local sites, like Google + Local, Bing Local, Yelp, Facebook and others. Moz Local covers many of them. Each of those also offers a place for you to point to your main site.
Updating throughout there should get you up to speed in no time. Plus David gave you the inside info on your site's status in OSE, so you should be set. Cheers!
-
Anytime and you can use OSE to research those with high authority as well
Cheers!
-
I will definitely keep that in mind when choosing who to submit publications too. Thanks again!
-
Hi Morgan
The more sites that link to your blog posts and site, the higher chance there will be for our index to pick them up. Our index is based on freshness and importance so it's best to build your links on sites with high authority.
Hope this helps
-
I just ran the index status in Google Webmaster tools and found that there are currently no files and hasn't been since July 2014 indexed from my domain name at www.morganlindsayphotography.com -- This is nuts.
-
Hi Ryan! Thank you so much for your info. After running a few reports the SemRUSH, Ahref and Majectic... It is coming up that my domain http://www.morganlindsayphotography.com is not found. Although, http://morganlindsayphotography.com is. have uploaded my sitemap through google and bing and went into my Godaddy file manager to see if there was any issues there...
I found that there is no sitemap.xml folder found on my root directory in Godaddy and there are two videositemaps.xml one that says video-sitmap.xml and another that says video-sitemap.xml.gz.. Is it a problem that my regular sitemap.xml is not found in my root in my file manager with godaddy? and is it a problem that there are two video-sitemap's? You have been so much help, thank you!
-
I have updated my website and have new blog posts almost every week, so I'm nervous why there are no new links to crawl! I think there is something definitely wrong. Thank you for time and answering my question!!
Morgan
-
Hi Ryan! Thank you so much for your info. After running a few reports the SemRUSH, Ahref and Majectic... It is coming up that my domain http://www.morganlindsayphotography.com is not found. Although, http://morganlindsayphotography.com is. have uploaded my sitemap through google and bing and went into my Godaddy file manager to see if there was any issues there...
I found that there is no sitemap.xml folder found on my root directory in Godaddy and there are two videositemaps.xml one that says video-sitmap.xml and another that says video-sitemap.xml.gz.. Is it a problem that my regular sitemap.xml is not found in my root in my file manager with godaddy? and is it a problem that there are two video-sitemap's? You have been so much help, thank you!
-
Hey Morgan!
It appears we last crawled your site on November 14th 2014. If we do not re-crawl a site, data can be stored in our index for up to 160 days. In order for us to update you information we will need to discover new links to re-crawl. There are a couple in the queue for processing from Wedding Wire so you should see those top pages update in the next 1-2 index updates.
Hope this helps!
-
Hi Morgan. Your updates look good. One thing with OSE is that it doesn't update instantaneously and is actually refreshed on a monthly schedule or so which means any changes you make that work well in Google and on your site will take a while to get recorded in OSE. Did you try checking your site in the webmaster tools Google and Bing offer? Uploading the current sitemap should help clear things up further. The latest update is scheduled for March 11th at which time you might see this information updated, see: http://moz.com/products/api/updates for past information and this post discussing OSE: http://moz.com/community/q/have-questions-about-the-jan-27th-mozscape-index-update-get-answers-here in more detail.
There are also some other backlink checking tools out there such as Ahrefs and Majestic that are useful for finding even more links. Mostly OSE is suited for checking the link profile of several competitors and getting ideas one where else you can market your site. For example, if you know of some other photography sites that are ranking highly you can add them into OSE and begin to see what they've done and how you could improve. Your current work looks fine though so you should be good to go. Cheers!
-
yes! I love that the open site explorer allows you to check backlinks... When I found that none of my backlinks were showing up from other websites I know I have been published at, I dug further into the top pages tab linking to my domain and found the only pages it was pulling were old worspress pages and old html files from two years ago. there is no access to those files anywhere on my website And hey have been deleted two years ago.
Thank you for your reply!
-
The purpose of Open Site Explorer is to show backlinks. It is not intended to show how those links are redirected on your site. If your 301 redirects are set up properly, anyone who clicks on them will be redirected to the proper page on your site. However, you would have to ask the websites linking to you to change the URLs if you want those URLs to be updated (and reflected in OSE).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
Site: www.kpmg.us Getting robots.txt timeout fail since 02/29/20. We've checked our server logs and see no errors. Went through all the steps of the "Troubleshooter". Updated robots.txt to allow rogerbot full access: User-agent: rogerbot
Link Explorer | | KPMG-Search-Social
Disallow: Any ideas how to get roger to crawl my site????1 -
May I know multiple campaigns set up, with same site url is allowable in Moz campaign or not?
Hi Guys, I have a question regarding moz campaign. I am a Moz Pro member, have taken Standard Plan. (Time being, am not in a position to upgrade to a higher plan) I have utilized only one campaign slot among total 5 slots. I have added xyz.com website in one campaign, there I have added 350 keywords which is the maximum count we can add in a a single campaign. Still, I have plenty of keywords to track for same website xyz.com. I am not planning to use the remaining 4 campaign slots for time being for any other websites. May I know, if I can add same xyz.com website in remaining campaign slots for tracking the remaining keywords for my website?
Link Explorer | | zco_seo0 -
My facebook stats are not showing up in open site explorer when I enter my website
My facebook stats are not showing up in open site explorer when I enter my website (www.transformationstreatment.com). I have over 15k likes on my facebook page but the open site explorer shows zero. If someone could please help me with this I would greatly appreciate it.
Link Explorer | | vrluis9k000 -
Open Site Explorer only showing 10 internal links, and 270 external links
Hi, I run the website www.abackpackerstale.com ,and for some reasons opensite explorer is only showing 10 internal links, and a 200 and something external links. How can I fix this as I am sure it is hurting my DA authority, and overall site score. Thanks! Stephen
Link Explorer | | backpackerstephen0 -
Why Moz Doesn't See or Count Our Backlinks?
Hi Moz Community! We have been working hard to improve our Moz metrics, measuring against a high ranking competitor to help us set our goals. Our Majestic and Webmaster Tools find tens of thousands of external backlinks pointing to our domain. That's all well and good. Moz's Open Site Explorer, however, only finds 900 total links - including internal links! This being the case, we have worked diligently to build a variety of great external backlinks, creating Bitly links and encouraging clicks on those through social promotion. Yet, our competitor has over 7,000 external backlinks in Moz's index, while ours is not growing relative to their number of backlinks. Can anyone share with us what they do to tell Moz about their backlinks? We already know we have many more backlinks than our competitor, from trusted domains with good authority, yet it seems Moz is not discovering them. We just want to understand how to use these Moz metrics to create meaningful calls-to-action. Otherwise, it seems like a gargantuan waste of time, and our team has difficulty getting buy-in from our company to put time and assets toward tasks based on our Moz numbers!
Link Explorer | | RegistrarCorp0 -
Page Authority dropped to 1 for subdirectory in my site
Hey, one of my sites https://www.automationanywhere.com/testing has had all it's pages drop to a page authority of 1 in Moz and the campaign doesnt appear to be indexing any pages from this directory. We launched a new site in this directory on the 12th and havent been getting any moz love since. The pages are indexable and followable, and are being indexed by google and others. The site on the root domain has been unaffected. Please help me get my moz campaign back on track. Thanks!
Link Explorer | | aatethys0 -
Does OSE crawl our site often? Or do we have an other problem? (internal links)
I am wondering if i can find out when OpenSiteExplorer crawled our entire website for the last time.
Link Explorer | | wilcoXXL
A few months ago we added some internal textlinks to all of our productpages. Those are links to the brandpage of that particular product. Some of our brands do have up to 1500 products, so there should be at least 1500 internal links pointing to that brandpage. But OSE still gives me a wrong count. It says there is only 1 internal link pointing to that brandpage.
Is it because OSE never crawled our site again? Or am i missing something here?(maybe too many internal links to one specific brandpage is not okay?) I'll hope you guys can help me out with this one.0 -
Repeated mysterious 404's from ancient site structure killing my rankings
Several years ago I changed my site structure to go from a flash based site to a blog based wordpress site. After doing so I went from page 1 to page 30 for my relevant search terms. I have employed people to help me track down the problem and I believe that they have narroed it to the existance of 404's being created from some unknown internal source. I have been for years getting links like this... <colgroup><col width="792"></colgroup>
Link Explorer | | dfphotographer.com
| http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/?share=facebook http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/charisma-and-steve-301/?share=email http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-04-2/?share=email http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-12-2/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/?share=facebook http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/feed/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-16-2/?share=email | ......regularly showing in webmaster tools, (this is from a top pages report from MOZ where there are hundreds also shown). When I do a moz crawl of the site, none of these links show up. Therefore I have no way of finding the source of these links (they also do not show me the source in WMT as they should). We have completely cleared the site and rebuilt it and although it is still only a couple of weeks in it still does not appear to have stopped them. Does anyone have any way of helping me find the source of these mysterious 404's?0