Is my page being indexed?

[alexrbrg]

To put you all in context, here is the situation,

I have pages that are only accessible via an intern search tool that shows the best results for the request. Let's say i want to see the result on page 2, the page 2 will have a request in the url like this:

?p=2&s=12&lang=1&seed=3688

The situation is that we've disallowed every URL's that contains a "?" in the robots.txt file which means that Google doesn't crawl the page 2,3,4 and so on. If a page is only accessible via page 2, do you think Google will be able to access it? The url of the page is included in the sitemap.

Thank you in advance for the help!

[Cesare.Marchetti]

Hi Alexandre,

It depends:

• If the page you are talking about is one of that you disallowed (...URL's that contains a "?") then i guess not because then in the robots.txt you would prevent Google to crawl it even if its in your sitemap.

• If this is not the case then Google will be able to access it. If it does and when is another question.

--> I am not sure if you should include the (...URL's that contains a "?")  pages in robots.txt. If they are unique and do not include duplicate content you could Google let them crawl and just prevent them from being indexed by using NOINDEX tag: https://support.google.com/webmasters/answer/93710?hl=en

Hope this helps.

Cheers,

Cesare

[Roman-Delcarmen]

If you have a Google Search Console (Mandatory for anyone working with SEO)

Go to your Search Console > Dashboard > Google Index > Index Status

[GastonRiera]

Hello Alexandre,

If the page is listed in the sitemap, yes Google will eventually access it and then index it.
It is a really good thing to have all the pages at least linked with other pages. A nice way to see it is to create a spider net with internal links, so as every page is accesible from any other o many other pages. There should be no lonely page.

To know whether a specific page is indexed, just perform a search in the selected search engine like this: site:mydomain.com/that-url

Hope it helps.
Best Luck.
GR.