Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Adding index.php at the end of the url effect it's rankings
-
I have just had my site updated and we have put index.php at the end of all the urls. Not long after the sites rankings dropped. Checking the backlinks, they all go to (example) http://www.website.com and not http://www.website.com/index.php. So could this change have effected rankings even though it redirects to the new url?
-
Lot's of good advice here, so I'll just weigh in with my two cents...
Instead of redirecting all your files to /index.php, why not rewrite those in .htaccess to redirect back to the original (without the /index.php)
This has the dual effect of preserving your link equity to those original urls, and there's a slight correlation between shorter URLs and higher rankings (in part possibly because shorter URLs have a higher click-thru rate)
Regardless, I suspect a perfect storm of factors contributed to your rankings, as you stated yourself:
1. Site was down when on old US host for a minimum of 3 hours one day and perhaps longer
2. Changed from US host to host based in Spain
3. Analytics stopped recording data for 3 days and site was down briefly after the change of host
4. All original URLs now have /index.php at the end
I purposely left out a Google Algorithm change, because of Occam's Razor - the simplest explanation is usually correct, and an algorythm change would be too much coincidence.
As Robert said, make sure you're targeting the right country in Google Webmaster. Other than that, I would try very hard to return all URLs, hosting and settings back to their original state before all these changes.
-
Hi Robert,
Thanks for your input on this.
The webmaster changed the hosting from US to Spain without my knowledge, the first I knew of it was when I saw the rankings drop and called him to see if there were any changes done to the site.
The site also seemed to be down at various times during the process and the analytics stopped recording data for 3 days.
We had excellent rankings in UK & US (both our target markets) but the day we changed host, the rankings all dropped from between 5 to 30 positions and so far are showing no real sign of returing to their original rankings even though we have now changed to a new US host.
I don't know if you have ever had the same experience but I wonder how much of an impact this will have in the long run for the rankings and will they even return without having to significantly promote the site again.
There are a number of factors which took place over this period:
1. Site was down when on old US host for a minimum of 3 hours one day and perhaps longer
2. Changed from US host to host based in Spain
3. Analytics stopped recording data for 3 days and site was down briefly after the change of host
4. New Google algorithm change
5. All original URLs now have /index.php at the end
Can it be a combination of all these factors or is there one main culprit?
I will speak with our webmaster Monday and ensure that he has set the target language to EN-US but we are also targeting the UK market and prior to this we were ranked very well in both countries.
Again, thanks for all your feedback!
-
Authority, You just named the issue. Changed from US to Europe. I am assuming the site is in English, what country are you targeting?
If US, and you changed to Europe, you would have had to go into GWMT and change language settings to EN-US. As a .com is not a ccTLD, and a server residing in Europe will be presumed to be targeting there, if you are not set up with GWMT as EN-US, your rankings will drop for a US search.
So, now, no matter what you are targeting, go into GWMT and go to site config, settings, language and choose the correct language config. Even if you are US and you are hosted in US, I urge you to insure this is done.
LMK
-
Thanks all for you input!
We have done redirected the old urls to the new ones ie from www.site.com/keyword/ - to - www.site.com/keyword/index.php
We changed host on the 5th Feb. and literally the same day all rankings dropped. I know there have been recent Google updates but finding the real cause of this is still difficult. If there were no changes to the site, then I may have leant more towards a google algorithm update but the rankings dropped as soon as the sites hosting was changed from US to Europe. Hosting has since been changed back to US based.... 3 days on though and no significant improvements although some keywords are moving up 5 places or so.
Any more input appreciated
-
Authority
This may be implied or I may be missing something, but as to your links and 301's, if you are saying you did a single 301 of http://www.website.com to http://www.website.com/index.php then your rankings drop is because of that. For each url with links, you need to do the redirect of .com/url-a, url-b, etc. to .com/url-a/index.php, .com/url-b to .com/url-b/index.php, and so forth. This should be done in the .htaccess file. You will not transfer link juice by tranferring domain to domain, etc. You must do it url to url.
Hope it helps.
-
You say you have put index.php at the end of all the URLs? So each page is in it's own directory?
Harald is 100% correct but I am wondering; did you always have each page in it's own directory or was that part of the recent change? If the file names used to be more SEO friendly (i.e. keywords in the file name) and now they are just named index.php then that could have a lot to do with your rankings dropping.
Just wanted to add that, cheers.
-
Hi Authority Sitebuilder, First of all Google doesn't seem to care about these but for users' sake, for the sake of conformity and as a good practice, it is best to do a redirect
from(example)
to
http://www.website.com/index.php
In other words, select one URL and stick with it, redirect all others. Make a 301 redirect of your old URLs to your new URLs. Then it should not affect your ranking unless you will do some other changes on your pages As you said earlier that all the back links go to the http://www.website.com (old url), so it is better to redirects o the new url i.e http://www.website.com/index.php
I hope that your query had been solved.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My url disappeared from Google but Search Console shows indexed. This url has been indexed for more than a year. Please help!
Super weird problem that I can't solve for last 5 hours. One of my urls: https://www.dcacar.com/lax-car-service.html Has been indexed for more than a year and also has an AMP version, few hours ago I realized that it had disappeared from serps. We were ranking on page 1 for several key terms. When I perform a search "site:dcacar.com " the url is no where to be found on all 5 pages. But when I check my Google Console it shows as indexed I requested to index again but nothing changed. All other 50 or so urls are not effected at all, this is the only url that has gone missing can someone solve this mystery for me please. Thanks a lot in advance.
Intermediate & Advanced SEO | | Davit19850 -
Wrong URLs indexed, Failing To Rank Anywhere
I’m struggling with a client website that's massively failing to rank. It was published in Nov/Dec last year - not optimised or ranking for anything, it's about 20 pages. I came onboard recently, and 5-6 weeks ago we added new content, did the on-page and finally changed from the non-www to the www version in htaccess and WP settings (while setting www as preferred in Search Console). We then did a press release and since then, have acquired about 4 partial match contextual links on good websites (before this, it had virtually none, save for social profiles etc.) I should note that just before we added the (about 50%) new content and optimised, my developer accidentally published the dev site of the old version of the site and it got indexed. He immediately added it correctly to robots.txt, and I assumed it would therefore drop out of the index fairly quickly and we need not be concerned. Now it's about 6 weeks later, and we’re still not ranking anywhere for our chosen keywords. The keywords are around “egg freezing,” so only moderate competition. We’re not even ranking for our brand name, which is 4 words long and pretty unique. We were ranking in the top 30 for this until yesterday, but it was the press release page on the old (non-www) URL! I was convinced we must have a duplicate content issue after realising the dev site was still indexed, so last week, we went into Search Console to remove all of the dev URLs manually from the index. The next day, they were all removed, and we suddenly began ranking (~83) for “freezing your eggs,” one of our keywords! This seemed unlikely to be a coincidence, but once again, the positive sign was dampened by the fact it was non-www page that was ranking, which made me wonder why the non-www pages were still even indexed. When I do site:oursite.com, for example, both non-www and www URLs are still showing up…. Can someone with more experience than me tell me whether I need to give up on this site, or what I could do to find out if I do? I feel like I may be wasting the client’s money here by building links to a site that could be under a very weird penalty 😕
Intermediate & Advanced SEO | | Ullamalm0 -
Will disallowing URL's in the robots.txt file stop those URL's being indexed by Google
I found a lot of duplicate title tags showing in Google Webmaster Tools. When I visited the URL's that these duplicates belonged to, I found that they were just images from a gallery that we didn't particularly want Google to index. There is no benefit to the end user in these image pages being indexed in Google. Our developer has told us that these urls are created by a module and are not "real" pages in the CMS. They would like to add the following to our robots.txt file Disallow: /catalog/product/gallery/ QUESTION: If the these pages are already indexed by Google, will this adjustment to the robots.txt file help to remove the pages from the index? We don't want these pages to be found.
Intermediate & Advanced SEO | | andyheath0 -
Partial Match or RegEx in Search Console's URL Parameters Tool?
So I currently have approximately 1000 of these URLs indexed, when I only want roughly 100 of them. Let's say the URL is www.example.com/page.php?par1=ABC123=&par2=DEF456=&par3=GHI789= All the indexed URLs follow that same kinda format, but I only want to index the URLs that have a par1 of ABC (but that could be ABC123 or ABC456 or whatever). Using URL Parameters tool in Search Console, I can ask Googlebot to only crawl URLs with a specific value. But is there any way to get a partial match, using regex maybe? Am I wasting my time with Search Console, and should I just disallow any page.php without par1=ABC in robots.txt?
Intermediate & Advanced SEO | | Ria_0 -
URL Injection Hack - What to do with spammy URLs that keep appearing in Google's index?
A website was hacked (URL injection) but the malicious code has been cleaned up and removed from all pages. However, whenever we run a site:domain.com in Google, we keep finding more spammy URLs from the hack. They all lead to a 404 error page since the hack was cleaned up in the code. We have been using the Google WMT Remove URLs tool to have these spammy URLs removed from Google's index but new URLs keep appearing every day. We looked at the cache dates on these URLs and they are vary in dates but none are recent and most are from a month ago when the initial hack occurred. My question is...should we continue to check the index every day and keep submitting these URLs to be removed manually? Or since they all lead to a 404 page will Google eventually remove these spammy URLs from the index automatically? Thanks in advance Moz community for your feedback.
Intermediate & Advanced SEO | | peteboyd0 -
Remove URLs that 301 Redirect from Google's Index
I'm working with a client who has 301 redirected thousands of URLs from their primary subdomain to a new subdomain (these are unimportant pages with regards to link equity). These URLs are still appearing in Google's results under the primary domain, rather than the new subdomain. This is problematic because it's creating an artificial index bloat issue. These URLs make up over 90% of the URLs indexed. My experience has been that URLs that have been 301 redirected are removed from the index over time and replaced by the new destination URL. But it has been several months, close to a year even, and they're still in the index. Any recommendations on how to speed up the process of removing the 301 redirected URLs from Google's index? Will Google, or any search engine for that matter, process a noindex meta tag if the URL's been redirected?
Intermediate & Advanced SEO | | trung.ngo0 -
Ending URLs in .html versus /
Hi there! Currently all the URLs on my website, even the home page, end it .html, such as http://www,consumerbase.com/index.html Is this bad?
Intermediate & Advanced SEO | | Travis-W
Is there any benefit to this? Should I remove it and just have them end with a forward slash?
If I 301 redirect the old .html URLs to the forward slash URLs, will I lose PA? Thanks!0 -
How to prevent 404's from a job board ?
I have a new client with a job listing board on their site. I am getting a bunch of 404 errors as they delete the filled jobs. Question: Should we leave the the jobs pages up for extra content and entry points to the site and put a notice like this job has been filled, please search our other job listings ? Or should I no index - no follow these pages ? Or any other suggestions - it is an employment agency site. Overall what would be the best practice going forward - we are looking at probably 20 jobs / pages per month.
Intermediate & Advanced SEO | | jlane90