Welcome to the Q&A Forum

Hi,

Tool that can retrieve mysite URL's

I am not talking about href,open explorer, Majestic etc

I have a list of 1000 site URL's where my site name is mentioned. I want to get the exact URL of my site next to the URL i want to query with

Example

http://moz.com/community is the URL i have and if this page has mysite name then i need to get the complete URL captured.

Any software or tool that can do this? I used one for sure which got me this info but now i don't remember it

Thanks

As we have 10K+ pages indexed already we set as Noindex and expect the search engines to drop off those pages after which we can block via Robots.

if i do the indexed pages will not be dropped right?

Also URL removal request for 10K pages 1 by 1 is going to be tedious

Hi,

We set pages with this and i can see in the view source of the page

<meta name="robots" content="noindex"/>

We had a new page posted in the site and its indexed by Google but now the new post is visible on a page thats shows partial data which we noindexed as above because its duplicate data and search engines dont have to see it

But its still crawling

Any ideas?

Hi,

Webmaster or analytics can we find pages that are 404

404 landing pages?

From which source to what page and from page i get the 404 error when someone accesses my webpage?

Need to know which pages are live on sites that are broken in my site

Thanks

Yes you need right at the same time to know which of the google indexed ones are 404

As google does not remove the dead 404 pages for months and was thinking to manually add them for removal in webmaster tools but need to find all of them that are indexed but 404

Thanks you

I will try explaining my query again and you can correct me if the above is the solution again

1. My site has 70K pages

2. Google has indexed 500K pages from the site

Site:mysitename shows this

We have noindexed etc on most of them which is got down the counts to 300K

Now i want to find the pages that show 404 for our site checking the 300K pages

Webmaster shows few hundred as 404 but am sure there are many more

Can we scan the index rather then the site to find the ones Google search engine has indexed that are 404

Thanks but this would be scanning pages in my site. How will i find 404 pages that are indexed in Google?

Hi,

Can we retrieve all 404 pages of my site?

is there any syntax i can use in Google search to list just pages that give 404?

Tool/Site that can scan all pages in Google Index and give me this report.

Thanks

Hi All,

I am doing a link profile audit

I have few questions

1. Should i stop worrying about backlinks that i once had and now the websites is down or page is 404

2. The link is nofollow

Also i have 60% of my site links few root link and many articles/blogs links pasted in sites without any anchor text, should i worry about them?

Thanks

Thanks

i am talking about the site that's not hit by any algorithm change and the keywords of few articles are dropping.

I wanted help with exact things i can try

Title change, Revisit the article content, Add images/Videos into the article?, have less links, any of such guidelines that i can work on...

Hi,

https://drupal.org/project/alinks

We have 1,000's of Soft links created like this in 1,000's of pages

Each page 1 to 2 links that are soft links would this be fine?

SEO would this be good or should we remove it

Thanks

Hi,

Login required pages that redirect back to the post get the same description

Example

http://www.Somesite.com/modal/register?destination=post title

Every post when a non member sees it has links that are as above

post title is the only difference in the URL's

So these Meta descriptions 1,000's of them are same. What can we do

Thanks

Hi,

Keywords loosing positions whats best can be done?

We have 1,000's of keywords we receive traffic each day and new ones added daily and many loose from position 1 to 10 or more

What can we do to get back to position1 or the first page?

Any tips i could get?

Thanks

Hi,

Forum website  rel="nofollow" is this Good?

We have a Q & A site and have all links as Nofollow. Would this be a good way?

Thanks

As the links show

http://localhost

http://192.168.1.1

These are dummy in an article we need to use such names and ip's to explain a product or a scenario to explain with examples as such URL's

Hi,

Dummy links in posts. We use 100's of sample/example lnks as below

http://<domain name></domain name>

http://localhost

http://192.168.1.1

http:/some site name as example which is not available/sample.html

many more

is there any tag we can use to show its a sample and not a link and while we scan pages to find broken links they are skipped and not reported as 404 etc?

Thanks

Hi,

Changing the spellings of titles and URl changes

We identifies 500+ titles with some issues like spellings and punctuations and short or too long.

We want to change them, but the titles are connected with the URL's when we change the titles the URl's change as well.

My questions are

1. Is it a good way to change them all in one shot or do few daily

2. As the URl's change will Google index drop the old pages as they would be 404 and index new ones?

3. Will we have chances to have drop in traffic due to this?

4. Any way to redirect? as we have a Drupal website

Thanks

Hi,

Temporary Redirect pages

example

when a non member goes to

http://www.Somesite.com/detail/Username-Mike

As he clicks the user names the user is directed to the login page

http://www.Somesite.com/user/login

We have 50K user accounts and 50K pages of content and each page has an option to comment and to comment user should be a member

Moz campaing i get these 1,000's of links in Temporary Redirect page

What is the action i can take

thanks

Hi,

When we have a page as 301 (Permanent Redirect) is a Rel=Canonical needed or should we make 1 Noindex?

Example

http://www.Somename.com/blog/138760

when clicked goes to

http://www.Somename.com/blogs/whenittyam

Should i noindex the below pages

http://www.Somename.com/blog/138760

and add Rel=Canonical

Thanks

Thanks but my questions would be will answering in forums and providing links of no use?

Direct traffic is the goal

But will the Algorithmic benefit hurt?

So forum posting is not a good medium?

Helping members on sites and then giving an exact URL which has relevant info?

Among these 3 and blog commenting which do you suggest

Hi,

Forum profile section or signature line as backlink VS Answering a question and giving a related post URl as the answer is better?

I have the above question on which would be better

Would a signature or website name in the profile is valuable then a link to your site where information is available?

Does Google consider both as spam/blackhat?

Thanks

Thanks

To be more clear here is the details

1. We have spammers who first post irrelevant content on our site

2. We delete them in 1 or 2 hrs and within this time

3. They spam many other sites with the post link of our on those sites

Now the link they posted is deleted and 404.

i have 4 questions

a. Many of these links that are on spam sites are 404. Should i take any action

b. All these pages are 100% made just to spam or even the sites are made to spam. Should i take any action

c. Some sites itself are down and guess they are shutdown as they were made just to spam. Should i take any action

d. Should i disallow all such links

I havent received any penalty notice but my traffic has dropped by 70%

Hi All,

Backlinks that we have if they are 404?

Open site explorer shows 1,000 of links and when I check many are 404 and those are spammy links which we had but now the sites are 404

I am doing a link profile check which is cleaning up all spammy links

Should i take any action on them? As open site explorer or Google still shows these links on the searches.

Should we mention these URL's in disallow in Google webmaster.

Thanks

When the user is logged in they wont see such links

Only when a non member clicks they go to the login page and Bots scan as non member only

When a user clicks and logs in and he is redirected to the page automatically he is intended to reach after login

If i have 1,000's of such links

http://www.somename.com/article/15633

Should i add the noindex to all of them one by one

Any specific way to handle this on bulk pages

Hi,

How can i stop such links being indexed

The first link is what i want to stop indexed. We have 1,000's of people writing articles and the below URl shows how many articles each did

http://www.somename.com/article/15633

But this is the URl which shows the exact articlehttp://www.Somename.com/article/step-step-installation-ibm-lotus-notesAs both start as thishttp://www.Somename.com/article/How can i set noindex? Should we set for each URL manually one by oneThanks

Hi All,

Deal with links that need login to view

We have member names in the site in many places and when clicked it takes the user to the login page

As just logged in members can view the details

The redirection type is 302 and Moz Campaign says we have many and need to make them 301

What is the best way as we have a drupal website

Thanks

Noindex is good or robots deny

Whats the difference or can do both?

Hi,

Would posting content into these sites be a good boost related to authority?

Press releases

PRWebPRLeapArticlesthetechscoop.netthecampussocialite.comtechi.combusiness2community.commediaite.comexaminer.commakezine.comhuffingtonpost.comAll these site charge to post is it worth?Thanks

Hi,

We have 70K posts in our site but Google has scanned 500K pages and these extra pages are category pages or User profile pages.

Each category has a page and each user has a page. When we have 90K users so Google has indexed 90K pages of users alone.

My question is. Should we leave it as they are or should we block them from being indexed? As we get unwanted landings to the pages and huge bounce rate.

If we need to remove what needs to be done? Robots block or Noindex/Nofollow

Regards

Here you go with a excellent tool to collect contact info

http://tools.citationlabs.com/tools/contacts-finder/index.html

Its free for a few after which its cheap 10$ for 100 MB of queries. I tried this and could collect 1000 sites info in 10$

Try it before you buy it..

Hi,

Sitemap do they get cleared when its a 404. We have a drupal site and a sitemap that has 60K links and i want to know if in these 4 years we deleted 100's of links and do they have them automatically cleared from Sitemap or we need to build the sitemap again?

Thanks

Hi All,

Find all 404 links in my site that are indexed. We deleted a lot of URl's from site but now i dont have the track of all we deleted. Any site/Tool can scan the index and give me the exact URL's so I can use

https://www.google.com/webmasters/tools/removals?hl=en&rlf=all

Regards

Martin

Hi,

Webmaster suddently today i could see 100's of posts showing title tags are missing

Html Improvements Missing title tags

https://www.google.com/webmasters/tools/html-suggestions?hl=en&siteUrl=

Please see image

Can anyone help on why this happened suddenly and what is this and whats the solution

http://imgur.com/zHsXVJN

Thanks

Thanks

i have been using this for some time but not sure how i can scan my site pages and find the 3rd party links within that page and find the anchor

Say my site has 50K pages and each page has 1 to 10 3rd party URL's i want those 1 to 10 checked.

Hi,

Find all links in the site and anchor text and i need this done on my own website so i know if we dont have links that are anchored to numbers and punctuations that are not seen at all.

Thanks

Thanks

In my case how can i deal with it and have the Moz and Google not detect them as duplicates?

What should i add and my site is Drupal

Hi,

I just had my Moz Campaign scan 10K pages out of which 2K were duplicate content and URL's are

http://www.Somesite.com/modal/register?destination=question%2F37201

http://www.Somesite.com/modal/register?destination=question%2F37490

And the title for all 2K is "Register"

How can i deal with this as all my pages have the register link and login and when done it comes back to the same page where we left and that it actually not duplicate but we need to deal with it propely

thanks

Hi,

Google webmaster and analytics access to others with restricted and user access is this ok and secure?

With this access can anyone tamper anything?

thanks

Thanks a lot, I assumed this because of the below 2 screenshots

The Sitemap shows warnings,. Is this something that you can help with identifying why we get these errors. 2 images that explain more

ojpbkJO PLlTbxW

I guess i was not clear with my question.

So i have this in robots.txt (Disallow: /search/)

My intension yo place /search/ is to stop Google indexing any of my search posts

www.somesite.com/search/node/

Now whats happened is

www.somesite.com/questions/search-the-internet

Posts like above are also being blocked

Hi,

I want all such search pages skipped from indexing

www.somesite.com/search/node/

So i have this in robots.txt (Disallow: /search/)

Now any posts that start with search are being blocked and in Google i see this message

A description for this result is not available because of this site's robots.txt – learn more.

How can i handle this and also how can i find all URL's that Google is blocking from showing

Thanks

https://www.google.com/webmasters/tools/internal-links-details?hl=en&siteUrl=

| Total links |
| /blog/top-select-9le-iphone-5 | 234,480 |

When i check i get 234,480 as count of found places. I guess we had a footer 2 months back which holds 50+ links always on top viewed posts could be thats the reason

Webmaster has not updated yet but is there some other way i can check this?