404 or 503 Malware Content ?
-
Hi Folks
When it comes to malware , if I have a site that uses iframe to show content off 3rd party sites which at times gets infected. Would you recommend 404 or 503 ing those pages with the iframe till the issue is resolved ? ( I am inclined to use 503 .. )
Then take the 404/503 off and ask for a reindex ( from GWT malware section )
OR
Ask for a reindex as soon as the 404/503 goes up. ( I do understand we are asking to index as non existing page , but the malware warning gets removed )
PS : it makes sense for this business to showcase content using iframe on these special pages . I do understand these are not the best way to go about SEO.
-
Thanks Peter, apologies for the delay was tied downed with some other things. Your help is much appreciated.
-
Sorry, I realized my comments about the 503 were kind of confusing. A 503 shouldn't serve a page for visitors, either - it's just a matter of 404s sometimes seeming a little more friendly, from the user perspective. It just depends on how you're set up.
My only other concern about the 503 is that it's generally intended for short-term use (at least it's been implemented that way). It's great if your site is down for a day and basically tells Google to come back later. If you leave one up for weeks or months, though, I'm honestly not sure what will happen. It's probably going to be treated like a 404, but it also could signal to Google that you have technical problems on the site. So, it may depend on the timeframe. The problem here is that you don't control the malware - it could be weeks before the 3rd party takes action.
-
Come to think of it we don't get a lot of malware warning in GWT anymore , I am guessing that is because the framed pages are no longer indexed. ( We could have potentially got the warnings while they were still being de-indexed ?? )
I am worried about that since GWT used to warn us about these and if the pages are no longer indexed and Google no longer sends us notification , we might miss these pages with malware. I have to look in to some way of tracking this ( if you have come across any solution I would love to hear more about it ) .
Thanks a lot for your help Peter.
Serving up malware content to users was never an option. I think .. in our case it makes sense for us to go the 503 route . If anyone is wondering how we plan to handle it :
When we see a malware notification on the i-framed pages.
- We plan to disable the iframe and send a general page for visitors saying the content is temporarily disabled .
- We will send a 503 header response with this page to state that this is a temporary issue. ( for search engines )
- Ask the site owner to fix the issue .
- Once issue is resolved , remove the 503 and make the framed content live again.
This helped me make this decision : https://support.google.com/webmasters/answer/2600719?hl=en&ref_topic=2600715&rd=1
-
So, it's not indexed, but you're still get malware warnings? That's odd. Honestly, Google shouldn't even see something in a frame as directly being part of your site, in many cases. If you 404 those pages, you potentially kill them for visitors, too - on the other hand, you probably shouldn't be sending your visitors to frames with malware. If it's just a few, I'd probably 404 them temporarily - it'll protect your rankings and your visitors. I'm honestly not sure if the 503 is going to do much that the NOINDEX isn't doing.
-
Hi Peter
The content used to be index, but I have added the noindex tag on there ( since I felt the same way about them being indexed as you did ) but we still get the GWT warning about malware from time to time. My initial concern was do I 503 or 404 the page till we fix the malware issue. I think 503 is the best way to go about it.
-
Is there any compelling reason to index this content? It's probably going to look thin to Google, at best (since it's mostly a wrapper around an outside site), and the search value is pretty minimal. In other words, it's good for your users and possibly conversion, but it doesn't have much value for search visitors. If the page is really just a wrapper around a demo site, then I'd consider using META NOINDEX on the frameset and just keep those out of your search results completely.
-
Hi Peter
Thanks for looking in to this.
We sell templates and themes for various cms and we find that it's great if we can demo the content to users before they purchase them. Our content is created by the community and most of them often add updates to existing content. We find that its best to let our authors host their own files and we link to that content through an iframe.
At times some of the author's might get hacked / or some of their advertisement gets flagged as malware. We get notified by WMT when google see an malware on these iframed pages.
-
I tend to agree with Sorina - in a perfect world, it would be great if you could somehow vet that content and make sure it stays safe for your users (even crawl the sites offline if you need to). What content does the page have around the iFrame (if you can explain it generally without giving away private details)? I'm wondering if these pages should be indexed at all, malware or no, since they're mostly just re-displays of other people's content. META NOINDEX might be a better bet here.
-
Probably you will not like my answer and you will give me the thumb down but:
Your main concern should be your visitors. You are displaying on your website content that, as you personally say, "at times" is dangerous to your visitors. Studies show the percentage of internet users that don't have any antivirus software or use outdated/expired software is somewhere around 50-60%. You should care more about your visitors and stop putting them in danger.
I don't know what content you are iframing on your website, but you should find a more trusted source that doesn't get infected at all.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate content analysis
Hi all,We have some pages being flagged as duplicates by the google search console. However, we believe the content on these pages is distinctly different (for example, they have completely different search results returned, different headings etc). An example of two pages google finds to be duplicates is below. if anyone can spot what might be causing the duplicate issue here, would very much appreciate suggestions! Thanks in advance.
Technical SEO | | Eric_S
Examples: https://www.vouchedfor.co.uk/IFA-financial-advisor-mortgage/harborne
https://www.vouchedfor.co.uk/accountant/harborne0 -
Duplicate content issue
Hi, A client of ours has one URL for the moment (https://aalst.mobilepoint.be/) and wants to create a second one with exactly the same content (https://deinze.mobilepoint.be/). Will that mean Google punishes the second one because of duplicate content? What are the recommendations?
Technical SEO | | conversal0 -
Set Canonical for Paginated Content
Hi Guys, This is a follow up on this thread: http://moz.com/community/q/dynamic-url-parameters-woocommerce-create-404-errors# I would like to know how I can set a canonical link in Wordpress/Woocommerce which points to "View All" on category pages on our webshop.
Technical SEO | | jeeyer
The categories on my website can be viewed as 24/48 or All products but because the quanity constantly changes viewing 24 or 48 products isn't always possible. To point Google in the right direction I want to let them know that "View All" is the best way to go.
I've read that Google's crawler tries to do this automatically but not sure if this is the case on on my website. Here is some more info on the issue: https://support.google.com/webmasters/answer/1663744?hl=en
Thanks for the help! Joost0 -
Content Duplication - Zencart
Hi Guys !!! Based on crawler results, it shows that I have 188 duplicate content pages, out of which some are those in which I am not able to understand where the duplication is ??? The page created is unique. All the URL's are static, all titles, metat tags are unique. How do I remove this duplication !!! I am using Zencart as a platform. Thanks in advance for the help !!! 🙂
Technical SEO | | sidjain4you0 -
Duplicate content on user queries
Our website supports a unique business industry where our users will come to us to look for something very specific (a very specific product name) to find out where they can get it. The problem that we're facing is that the products are constantly changing due to the industry. So, for example, one month, one product might be found on our website, and the next, it might be removed completely... and then might come back again a couple months later. All things that are completely out of our control - and we have no way of receiving any sort of warning when these things might happen. Because of this, we're seeing a lot of duplicate content issues arise... For Example... Product A is not active today... so www.mysite.com/search/productA will return no results... Product B is also not active today... so www.mysite.com/search/productB will also return no results. As per Moz Analytics, these are showing up as duplicate content because both pages indicate "No results were found for {your searched term}." Unfortunately, it's a bit difficult to return a 204 in these situations (which I don't know if a 204 would help anyway) or a 404, because, for a faster user experience, we simultaneously render different sections of the page... so in the very beginning of the page load - we start rendering the faster content (template type of content) that says "returning 200 code, we got the query successfully & we're loading the page".. the unique content results finish loading last since they take the longest. I'm still very new to the SEO world, so would greatly appreciate any ideas or suggestions that might help with this... I'm stuck. 😛 Thanks in advance!
Technical SEO | | SFMoz0 -
Duplicate Content in Wordpress.com
Hi Mozers! I have a client with a blog on wordpress.com. http://newsfromtshirts.wordpress.com/ It just had a ranking drop because of a new Panda Update, and I know it's a Dupe Content problem. There are 3900 duplicate pages, basically because there is no use of noindex or canonical tag, so archives, categories pages are totally indexed by Google. If I could install my usual SEO plugin, that would be a piece of cake, but since Wordpress.com is a closed environment I can't. How can I put a noindex into all category, archive and author peges in wordpress.com? I think this could be done by writing a nice robot.txt, but I am not sure about the syntax I shoud use to achieve that. Thank you very much, DoMiSol Rossini
Technical SEO | | DoMiSoL0 -
WordPress Duplicate Content Issues
Everyone knows that WordPress has some duplicate content issues with tags, archive pages, category pages etc... My question is, how do you handle these issues? Is the smart strategy to use robots meta and add no follow/ no index category pages, archive pages tag pages etc? By doing this are you missing out on the additional internal links to your important pages from you category pages and tag pages? I hope this makes sense. Regards, Bill
Technical SEO | | wparlaman0 -
Duplicate Content
We have a main sales page and then we have a country specific sales page for about 250 countries. The country specific pages are identical to the main sales page, with the small addition of a country flag and the country name in the h1. I have added a rel canonical tag to all country pages to send the link juice and authority to the main page, because they would be all competing for rankings. I was wondering if having the 250+ indexed pages of duplicate content will effect the ranking of the main page even though they have rel canonical tag. We get some traffic to country pages, but not as much as the main page, but im worried that if we remove those pages and redirect all to main page that we will loose 250 plus indexed pages where we can get traffic through for odd country specific terms. eg searching for uk mobile phone brings up the country specific page instead of main sales page even though the uk sales pages is not optimized for uk terms other than having a flag and the country name in the h1. Any advice?
Technical SEO | | -Al-0