Welcome to the Q&A Forum

ok thanks

hi

thanks for the answer, tried screaming frog now as well and seems it has the same problem,

is it possible to allow only certain spiders/robots to crawl all files, with the robots.txt?

thanks

hi,

i have waited for over 2 weeks now and the crawler only got 8 pages, and is not getting all the open cart pages and products.

any idea of what can be wrong?

im using joomla 2.5.11 and mijoshop 2.0.5 (which uses opencart 1.5.5.1).

thanks