Not completely relevant, but might be good to be aware of this, the site is serving me a HTTP authentication form to login into your domain on port 80 when I visit the site.

Hi Chris,

I'm not sure this is what you're wanting to do, but what you could do is check your competitors. Get all the details from ScreamingFrog, export the data and then do manual checks on the data in Excel to see for certain keywords if they're in the META descriptions. This should be something that you should do manually anyway because a tool can never really help you out in grading it the way you'd like it.

Hi John,

It seems obvious, but why not go for a adding a trailing slash to every URL instead or removing it, would solve your issues at least.

That clearly changes my ideas about this ;-). As we're talking about a couple of million pages I wouldn't include them in the sitemaps then and to make sure they're absolutely made sure that it's noindexed.

Hi Silviu,

Hard question, related to your use case I would suggest not to include them. But on the other hand it also shouldn't harm your performance as the URLs in a sitemap are mostly meant to search engines as a full list of URLs they might miss otherwise. It would also help you to see what your indexation rate is. Curious to see what other people think about this.

Hi Richard,

Are you able to share the site we're talking about here? That would make it easier for us to help you with feedback on the specific example.

Hi Jon,

Why not just: Disallow: /viagra

SameAs markup probably won't be enough as for now it's really meant to be used for identifying social network accounts for a specific Web site. What I would also look into is marking up your actual content via Schema.org because Google probably will need the data for it's knowledge graph in some structured way at least.

Like Patrick already mentioned, what you could do is create a new view which is filtered based on the hostname. This should allow you to make sure you'll only have the data for lp.example.com in there.

Yes, like answered above this is for sure a plugin/extension in your browser using your queries to also embed your Evernote notes in there. Nobody else, except you, will see them,

I agree with the guys above, just do it because it usually can't harm anything. It's more a sign to Google that these images are out there then it's really a signal that they're of high quality. So in the end they'll still decide if they think it's worth indexing them or not.

Wouldn't do it, it's an XML file.

Hi David,

It doesn't matter that much, but mostly from an efficiency perspective I would go for 1 plugin who handles all of it and probably even beter then having 2 plugins. There is no harm in removing the plugin you're currently using for generating sitemaps and switching over to Yoast.

My reaction won't help the original question ;-). But unfortunately this tactic doesn't always we work we see. We deal with a lot of roadblocking campaigns for certain pages and usually what they also recommend is that you have to create new ad units for these kind of take overs to make sure that you only target 1 banner to them.