What is robots.txt file issue?
-
I hope you are well. Mostly moz send me a notification that your website can,t be crawled and it says me o check robots.txt file. Now the Question is how can solve this problem and what should I write in robots.txt file?
Here is my website. https://www.myqurantutor.com/
need your help brohers.... and Thanks in advance
-
Not sure. Your robots.txt file looks fine & shouldn't be blocking anything except for admin:
User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php sitemap: https://www.myqurantutor.com/sitemap_index.xml
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Potential duplicate content issue?
We have a category on our website for PVC rolls to buy as standard 50m rolls (this includes 15 products in the category). We're also releasing PVC rolls to buy per metre (10m roll/25m roll etc...), again with 15 products, which we are adding as a separate category as it makes more sense for our customers and removes the risk of having too many options. Would using the same description be bad practice for SEO? The product is exactly the same just available in different roll sizes, but we definitely do not want to combine categories as it doesn't work for our customers. Any help or suggestions would be appreciated, thanks.
On-Page Optimization | | RayflexGroup0 -
How do i fix my duplicte page issues on Prestashop platform?
I have tried many things such as rel-canonical, duplicate url redirect modules, but still im looking at over 70 duplicate page titles. Most of this is because the same title is used across all the pages and im not sure if this is possible to change. (ex: http://apostolicclothing.com/15-modest-womens-dresses, http://apostolicclothing.com/15-modest-womens-dresses?p=2)
On-Page Optimization | | nathanielleee0 -
SEO Issues with Avactis Shopping Cart Please Help
The home page title duplicates on all cms pages. this is causing the title to be over 70 characters. This is my first experience with Avactis so I am not exactly sure how to handle. Does anyone know?
On-Page Optimization | | MACameron0 -
How to fix duplicate issue among multiple root domains
Hello, I’m doing SEO for one E-commerce website which name is Lily Ann Cabinets & I’ve around 300 different root domains which having same linking structures, same design & even same product database for all 300 websites, but currently I’m focusing only on Lily Ann Cabinets website & trying to get ranking on some targeted keywords, but website is not performing well in Google.com For Example: http://www.lilyanncabinets.com/ (Main Websites)
On-Page Optimization | | CommercePundit
http://www.orlandocabinets.com/
http://www.chicagocabinets.org/
http://www.miamicabinets.org/
http://www.newyorkcabinets.org/
http://www.renocabinets.org/ So please can anyone tell that Will it create duplicate issue in search engines or may be due to this reason website doesn’t have good ranking in search engines, then how can I fix this issue? Do I have to make different structures for Lily Ann Cabinets?0 -
Mozbar # issue
Hi, When viewed through the Mozbar page analysis tool my Joomla site is always displaying a bullet point and space character before the site. Is this likely to effect search engine reading of my ? www.clearvisas.com - is the site. Please have look and let me know what you think. If you are a Joomla expert your feedback on my website and this issue will be really welcome. Thanks, Fuad
On-Page Optimization | | Fuad_YK0 -
Duplicate content issues with products page 1,2,3 and so on
Hi, we have this products page, for example of a landing page:
On-Page Optimization | | Essentia
http://www.redwrappings.com.au/australian-made/gift-ideas and then we have the link to page 2,3,4 and so on:
http://www.redwrappings.com.au/products.php?c=australian-made&p=2
http://www.redwrappings.com.au/products.php?c=australian-made&p=3 In SEOmoz, they are recognized as duplicate page contents.
What would be the best way to solve this problem? One easy way i can think of is to nominate the first landing page to be the 'master' page (http://www.redwrappings.com.au/australian-made/gift-ideas), and add canonical meta links on page 2,3 and so on. Any other suggestions? Thanks 🙂0 -
Ranking Issues Recently Popping Up
We have a site that based on your research tools, holds its own in almost all aspects in regards to # of links, # of different linking domains, quality of links, mozrank, moztrust and all that stuff. Compared to our top competitors, we do very well based on your tools via our campaign monitor. The issue is we seem to be dropping like crazy every month in our rankings and traffic despite this fact, and we can't get our head around the cause. I do have a couple of ideas, and I wanted to run them by you guys to get your opinion. Domain: bonitaj.com My Thoughts On Possible Issues... 1. Text Content & Panda Update I know one of the big things with the panda update was quality of content. I know one thing we have for sure is a lack of "text-based" content. Sure, we have home page, main cats, sub-cats and product pages, but they are mostly just windows into the product pages, and don't have a whole lot of good copy. THIS IS MOST EVIDENT ON OUR PRODUCT PAGES, where each product page is loaded with content, but only 3-4 very short paragraphs of text. Do you think this is hurting us? THE ONLY ISSUE IS THAT our competitors also don't have a whole lot of text-based content on their pages. 2. Too Many Category Pages & Same Products Featured Somewhat on them I think another problem may be that on each category page, we do have a lot of the same products featured. I don't think its crazy duplicate content or anything, but I do think that back in the old days we got a little crazy with creating "niched out" category pages that pretty much feature the same products as some of the more important and base category pages. Do you think this is hurting us? I've pitched a solution to this that involves trying to tone down the amount of sub-cats we feature that were originally geared towards attracting long-tail traffic. In the end that really isn't working anymore anyway, so maybe we're spreading our site thin by going to deep with some of these niche category pages? 3. Lack of a sitemap? We used to use an xml sitemap, and really don't anymore. We have nothing on file with google webmaster tools. I've recently read in one of your blog posts that a simple thing like adding a good sitemap could help our 600+ page site or so get crawled a bit deeper allowing more pages to rank? IN THE END, MY QUESTION IS SIMPLY, IF THERE IS ONE OR TWO THINGS I CAN DO TO GET OVER THIS HUMP, WHAT WOULD YOU SUGGEST?
On-Page Optimization | | AarcMediaGroup0 -
Will a "no follow" "no index" meta tag resolve duplicate content issue?
I have a duplicate content issue. If the page has already been indexed will a no follow no index tag resolve the issue or do I also need a rel canonical statement?
On-Page Optimization | | McKeeMarketing0