The only think I can see that is missing, is a self rel=canonical to the home page. I would have this as a matter of course.
I also can't do a quick crawl on the site as I am getting a 403 Denied error.
-Andy
Welcome to the Q&A Forum
Browse the forum for helpful insights and fresh discussions about all things SEO.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
The only think I can see that is missing, is a self rel=canonical to the home page. I would have this as a matter of course.
I also can't do a quick crawl on the site as I am getting a 403 Denied error.
-Andy
It does make sense Stephen, but this bit bothers me:
The URL mappings must be used to redirect any link to a deleted page to an existent page.
If I am reading that correctly then are they saying that 404's can't exist, just 302's? You don't always want to direct someone to a page, especially if it isn't applicable. In many cases, a 404 would be the right thing to do if a page is just being removed.
Of course, if there is somewhere to redirect someone to, then you would do so with a 301 (permanent redirect) rather than a 302 (temporary redirect).
I don't really understand their system, so might be missing something in translation.
-Andy
Hi Stephen,
What are you using to see 302 of them? I didn't get anything like that number when I looked. There is the off-site 302, but we're talking just a few.
-Andy
Hi,
the 302's mostly appear to be PDF documents. Does this sound right to you? Has this only just come to your attention, or have you recently uploaded lots of documents?
For example:
http://www.thephysiocompany.com/s/Clinic-Info-Patricks-Quay-Spec.pdf --> http://static1.squarespace.com/static/537b0649e4b0f6c6b6877a35/t/542be1d5e4b005bb34fa0cfb/1412162005901/Clinic+Info+-+Patricks+Quay-+Spec.pdf
-Andy
Hi Patrick,
Will this hurt your SEO? Maybe, but not in the more traditional way. For example, there is no direct penalty that this would fall under, but what it could do is confuse the user experience. Just keep in mind that SEO isn't just about your SERP positions.
As a user on any site, you want to see consistency. If you change theme part way through, then this can devalue the level of trust in the site as it no longer looks like the original site.
I would stick with one theme and if you aren't happy with the current look and feel, change your whole site to match this.
From Google's perspective, no, this wouldn't cause a devalued ranking by installing an additional theme (unless SEO issues arise from the installation), but there are a whole host of reason why you shouldn't do it.
-Andy
Hi,
What you have there will work absolutely fine with a little tweak. And no need to leave spaces between lines.
Disallow: /numberOfStars=0
However, no need to add the wildcard at the end if there is nothing more after that.
The best way to test what works, is before you go and add it to live, use the Robots.txt test tool in Search Console (Webmaster Tools), add in the lines above and then check to make sure none of your other pages are blocked. They won't be, but it's a great way to test before going live.
I hope this helps
-Andy
Well it isn't Googlebot and it isn't one I have come across before. Don't forget that any user agent can be spoofed very easily so I wouldn't worry about blocking it.
**Should I assume that the drop in reported indexed pages is a result of blocking the teracent-feed-processing user agent? **
I really don't think that this is Google. The only one they have is Googlebot, and tell you this is the one to add if you wish to block them.
Just a thought, can you share your robots.txt file just to make sure pages aren't being unintentionally blocked?
-Andy
It sounds like your typical spammy site so I would suggest just blocking them. Add the following to the top of your robots.txt file:
**User-agent: teracent-feed-processing**
**Disallow: /**
However, before you go live with this, use the webmaster tools Robots.txt tester to make sure everything else still gets crawled.
-Andy