@tom-capper
Thanks Tom was more about server settings outside of robots.txt for hosting providers.
Managed to get them to remove rogerbot blocking on ALL there servers as they first stated that it was well known as a malicious robot hence the block???
Until I made them aware.... cough cough
Posts made by Moving-Web-SEO-Auckland
-
RE: Replicate rogerbot error for server/hosting provider
-
Replicate rogerbot error for server/hosting provider
Anyone got any ideas how to get a server/hosting provider who is preventing rogerbot from crawling and me not been able to set up a campaign to duplicate the error on there end?
The server/hosting provider is crazydomains dot com
My clients robots.txt
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
User-agent: rogerbotDisallow:
Sitemap: https://www. something
-
RE: Crawl test csv has lost its formatting??
Ok worked out a solution for anyone updating to win 10 and having trouble opening csv files.
To change
- Settings - Time & Language
- Additional date, time & regional setting (at the bottom
-change date, time or number formats - Additional settings ... (Button)
Change the List Separator from the semi colon to a comma.(,)
-
RE: Crawl test csv has lost its formatting??
Pasting from sheet to excel works, would appear to be a win 10 change in formatting issue.
Thanks any ways.
-
RE: Crawl test csv has lost its formatting??
I agree it opens fine with Google sheets, lets see if anyone else has issues with win 10 and excel..
-
RE: Crawl test csv has lost its formatting??
Have been using office 2016 excel for the past three years or so with no issues. Only recent change is that I have updated to Win 10 from 8.1
Updated to the latest office still no joy.
This is a major issue for me
-
RE: Crawl test csv has lost its formatting??
Had a look/download all the past reports. All data has merged into one column??
-
Crawl test csv has lost its formatting??
All the columns/heading merged into column A.
Anyone else noticed this over the past few days?
-
RE: How can I use Open Site Explorer to Identify why my own URL's are appearing as inbound links
Silly question but are the urls of the product category and the urtl that you set in Open Site Explorer on the same domain?
-
RE: Keyword Difficulty and SERP Analysis Full report not working?
Just to be clear and sorry to hijack this thread.
With the KW Diff and SERP Analysis page you can only get search volume from Bing?
Irrespective of the SE and selecting New Zealand I get no volume whatsoever?
With Google keyword tool been very unhelpful compared to previous version this has made life a lot harder!
Any suggestions as to best method to obtain country specific search volumes?
Bing Ads Intelligence via excel is about as good as i can find atm!
-
RE: Micro Site Penalty?
Cheers, yea certainly unintentional from my client.
I will include a Google docs spread sheet showing the actions taken to remove these links and probably a link to this discussion!
With a rather humble and embarrassed apology!
oh well my first penalty in a 100 sites or so.
Thanks for your help!
have a great day!
-
RE: Micro Site Penalty?
Cheers Tim I suspected this was a result of this "Unnatural links to your site" and appreciate the reinforcement.
Ranking improvements were solid before unnatural links were put in place but I agree it is a combination of the two.
This just popped up in "Manual Actions" in Webmaster Tools
Google has detected a pattern of unnatural artificial, deceptive, or manipulative links pointing to pages on this site. Some links may be outside of the webmaster’s control, so for this incident we are taking targeted action on the unnatural links instead of on the site’s ranking as a whole.
I will get all the links removed to show best intent then click "Request A Review" hopefully this will speed up the process?
This was out of my control but certainly reinforces my view "Links are earned not bought!"
-
Micro Site Penalty?
I have been carrying out On-Page optimisation only for a client www.shade7.co.nz.
After three months or so I have been getting some great results, improving to the top three positions for at least 30 of 45 keywords targeted. Couple of more tweaks and I would be a very happy camper.
Disaster overnight! Rankings CRASH!
Unbeknown to me the client a month or so back decided to link just about every product/link on a micro site he owns (www.shademakers.com/ ) plus one other site he owns. Explorer I think discovered over 350 back-links (follow) from these sites!
As this is a site he owns and it is targeting the same keywords I presume this falls into the EVIL bucket of SEO.
Two part question do you believe I am correct that this is the reason for this rankings crash and what would be the best way to resolve this!
- server-side 301 redirect for the micro site?
- Delete the micro site (drastic measure)
- Remove all the links other than maybe one in the contact page saying visit our other site shade7
- other options?
The client or I have not received any bad link Emails from Google.
-
RE: Avoiding "Duplicate Page Title" and "Duplicate Page Content" - Best Practices?
Every site you monitor should have a keyword distribution sheet in excel.
Each line will have the url, meta description, title tag, and h1 tag showing (LEN) character count for meta details. With a further column showing the keywords targeted for each page.
With this you have a way to monitor each page in a more direct visual way and avoid duplication, especially titles and meta descriptions.