New pages on my web site
-
I have created web sites that appear somewhere on Google in hardly any time at all,
but I appear to have forgotten something or things are different for pages added recently to an existing website.
I have added a page on a particular subject, optimized it using on page grader, so that I get an A, and a check mark for everything except H1 tags and rel=canonical which my web hosting provider does not support. I do have a check mark for accessible to search engines
The page has the format http://www.domain.com/specific-keyword
It is in the menu, so should have internal links to it, as I understand it.
I have created a new site map, and submitted it in webmaster tools.
Interestingly it says that of the 96 pages only 76 were indexed
is this a clue? and why would they not index a page
I have then shared the page on google plus, facebook, tumblr, pinterest and twitter and some others
In OSE it comes up as domain authority 28 page authority 1, the social media shares do show up in metrics on the right but no links internal or external are shown, they do on other pages I created in the same way.
Is it just a case of waiting or is their something I do to help
thank you
-
As Ryan mentioned, OSE is updated on a schedule. Our next update is scheduled for March 11th. We try to update it -- barring any technical difficulties -- at least once a month.
-
That has definitely fixed the problem the page is on the second page of google
and I can carry on building it up
Thanks very much
-
Ok my site is back up and the new robots,txt file has been uploaded and submitted to google,
I have tested that the site map is allowing robots.
and it is, but no change yet to the OSE and search results.
I will wait to see if these are any changes
Thanks again
-
hmm I found a robots.txt editor in Google webmaster tools
downloaded the new file and uploaded it to my file manager
then discovered that my whole site had crashed page not found
dunno if I caused it, or the host was already having probems
gotta wait and see now, Their live chat help is also not working and I have sent an email so it does look like it's their problem
How can the robots.txt file have changed if I did not do it
-
You'll want to contact your hosting company or look at their FAQ on how to edit robots.txt. Cheers!
-
actually there is no file of that name in my file manager
-
hmm delete the line?, would it work if I deleted the file upload a blank text file named robots.txt
-
That certainly could be causing problems. It'd be best to delete that line.
-
thanks for the quick response I looked in robots.txt and found this:
User-agent: * Disallow: Sitemap: http://www.realsingingtelegrams.com/sitemap.xml is that causing the problem?
-
GWT very infrequently shows a 100% of pages submitted via sitemap matching pages indexed, but there could be a few very reasonable reasons for this. For example, you could be disallowing a portion of pages in your robots.txt file that are listed in your sitemap.
As for OSE explorer, you're most likely looking at link data from prior to the last update. In that case, any linking and work done won't be recorded by OSE until the next update is made live. Here's the latest on their scheduling: http://moz.com/products/api. Short answer: keep doing what you're doing, and wait a bit on the reporting numbers to update. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz can't crawl my site
Moz is being blocked from crawling the following site - https://www.cleanchain.com. When looking at Robot.txt, the following is disallowing access but don't know whether this is preventing Moz from crawling too? User-agent: *
Moz Pro | | danhart2020
Disallow: /adeci/
Disallow: /core/
Disallow: /connectors/
Disallow: /assets/components/ Could something else be preventing the crawl?0 -
Filter Pages
Howdy Moz Forum!! I have a headache of a job over here in the UK and I'd welcome any advice! - It's sunny today, only 1 of 5 days in a year and i'm stuck on this! I have a client that currently has 22,000 pages indexed to Google with almost 4000 showing as duplicate content. The site has a "jobs" and "candidates" list. This can cause all sorts of variations such as job title, language, location etc. The filter pages all seem to be indexed. Plus the static pages are indexed. For example if there were 100 jobs at Moz being advertised, it is displaying the jobs on the following URL structure - /moz
Moz Pro | | Slumberjac
/moz/moz-jobs
/moz/moz-jobs/page/2
/moz/moz-jobs/page/3
/moz/moz-jobs/page/4
/moz/moz-jobs/page/5 ETC ETC Imagine this with some going up to page/250 I have checked GA data and can see that although there are tons of pages indexed this way, non of them past the "/moz/moz-jobs" URL get any sort of organic traffic. So, my first question! - Should I use rel-canonical tags on all the /page/2 & /page/3 etc results and point them all at the /moz/moz-jobs parent page?? The reason for this is these pages have the same title and content and fall very close to "duplicate" content even though it does pull in different jobs... I hope i'm making sense? There is also a lot of pages indexed in a way such as- https://www.examplesite.co.uk/moz-jobs/search/page/9/?candidate_search_type=seo-consulant&candidate_search_language=blank-language These are filter pages... and as far as I'm concerned shouldn't really be indexed? Second question! - Should I "no follow" everything after /page in this instance? To keep things tidy? I don't want all the variations indexed! Any help or general thoughts would be much appreciated! Thanks.0 -
Duplicate pages coming from links from the login page - what should we do about them?
This is a follow on to an earlier question which was well answered by Dirk Ceuppens regarding abnormal crawl issues. We are seeing that the issues relating to Duplicate Pages are coming from links from the login page which shows information about where the user was redirected from. For example, if the visitor is not logged on and wishes to wish-list an item, they will be redirected to the login page, with the item code and intended action in the url; which can then continue on to the desired page once logged on. The MOZ crawler is seeing these pages as having Duplicated Content whilst they are all the same apart from a piece of information in the URL. Should we be blocking these duplications? Are they a risk to us? What should we be doing? Many thanks, Sarah
Moz Pro | | Mutatio_Digital0 -
I have a site that is showing Internal 0 Equity-Passing Links, 0 Internal links, and every page bar the homepage has a PageAuthority of 0\. Any suggestions on why this could be?
The website has been around for several years, although did undergo a significant redesign at the end of last year. I greatly appreciate any help.
Moz Pro | | embracedarrenhughes0 -
My Campaign only crawled 3 pages on my site
On my first crawl of a new campaign, the software only crawled 3 pages. XXXaceXXXscholarships.org any ideas?
Moz Pro | | Santaur0 -
One page report are empty !
Hi Rodgerbot, Now, i've no seomoz one page report for any campaign 😞 What happen ? I've previously several report. Thanks,
Moz Pro | | Max840 -
Still Cant Crawl My Site
I've removed all blocks but two from our htaccess. They are for amazonaws.com to block amazon from crawling us. I did a fetch as google in our WM tools on our robots txt with success. SEOMoz crawler here hit's our site and gets a 403. I've looks in our blocked request logs and amazon is the only one in there. What is going on here?
Moz Pro | | martJ0 -
How often is Open Site Explorer updated?
Or perhaps my question is actually how often does the seomoz bot crawl the web? I ran some benchmark link counts for a number of websites about this time last month and I noticed when I went to update them for this month the data is the same. Thanks.
Moz Pro | | WCR1