Is it possible to exclude specific urls in the crawl that contain certain arguments - like you can do in google webmaster tools?
Posts made by djangojunkie
-
Is it possible to have the crawler exclude urls with specific arguments?posted in On-Page Optimization