Long Url but makes no sense
-
Hi Just joined.
Crawl states that I am getting a lot of errors, looks like the spider is getting confused and looping back on itself ?
Is there a way to see where the crawl was formulated (ie where from) ?
It is generating urls like:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/auction/auction/auction/auction/auction/auction/Default.aspx from http://www.wickman.net.au/wineauction/wine_auction_alert.aspx
-
Welcome! We're happy to have you here, and glad to have helped you solve your problem.
-
Thank you. Thats exactly what I needed. Downloaded the csv and was able to find the referring URLS and track back to the offending page.. Searched my site and voila - silly me put a trailing slash after the file prefix in the sitemap.. must have really messed up the robot.
so I had:
<loc>http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/</loc>
Ooops.. I think I like this SEOMoz place already
-
Did launch a quick crawl on your site, these url were not found (but you have several broken links!). These strange URL usually come from bad robots, and may also come from the interpretation of javascript URL or redirects. GoogleBot gets really confused with them.
If you want to dig, check the servers logs.
-
Hi Martijn,
I did take a look at the source code, did not find that link anywhere, however that page is live:
Not sure if its a dynamically created or a static one...
Mark:
take a look at your physical directories on your server using your favorite FTP software, see if you can follow the same navigation and see if you have these folders and file
-
Hi Igor,
If you have a look at the page the URL is not found on this page.
-
Hi Mark,
What I would recommend, is open this page in your browser:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx
Then view the source page and try to search for the url:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/auction/auction/auction/auction/auction/auction/Default.aspx
Are you using a CMS or ecommerce platform for your site like wordpress or x-cart? If so it might be something wrong with the configuration which produces the pages and links automatically
-
Hi Mark,
Within you Crawl Diagnostics you're able to export your data to CSV (on the topright side of the overview). By doing this you can find the links to the page you think is incorrect.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Making Shopify URL's Simpler - Losing the words 'collection', 'product' and 'page' in a Shopify store URL. Any advice?
Hi Mozers! I have a Shopify store (of which there are many advantages) however one big SEO disadvantage, is that my URL structures contravene all Moz advice on dynamic URL structure and whats more I am reminded about this every week when I have a Moz site crawl and I have a batch of URL's that are longe than the 75 characters. A Shopify URL will run www.domain name.com/collections/collection-name/product/product-name. According to advice a it should be www.domain name.com/collection-name/product-name - Don't even get started on sub-collections! I sell portfolio books, album etc and keepsake memory boxes (so long keywords) AND, I have a long(ish) business name. So, For user experience and keyword length, do I just ignore trying to achieve a dynamic URL under 75 characters? When I have asked Shopify, the say their URL's are an integral part of the "Ruby on Rails" system, so nothing can be done Or can it ??? I can't be the only Moz member with this issue can I ??
On-Page Optimization | | nick_HandCo0 -
Potential new URL structure for my ecommerce site
At the moment my site suffers from a flat product category structure where over 600 items fall into one category alone. This category is then filtered using a faceted search which appends query strings to the category URL and changes the products displayed on the page. At the moment our product category URL is as follows, www.domain.com/category/greeting-cards and this holds all cards including occasions such as anniversary, birthdays etc and also themes such as animal cards, contemporary cards etc I have proposed changes to my developer to change this structure to include subcategories. I can now go two subcategories deep. For example, "greeting cards > occasions > birthday cards" or "greeting cards > themes > animals". This is reflected in the new URL structure, which has been proposed, www.domain.com/greeting-cards/occasions/birthday-cards. In this URL do I need "occasions" in the URL as I don't think it adds much value to the user? Would I be better of having www.domain.com/greeting-cards/birthday-cards. If a user searches for "birthday cards" then I think this would be more relevant?
On-Page Optimization | | joe-ainswoth0 -
Duplicate URL errors when URL's are unique
Hi All, I'm running through MOZ analytics site crawl report and it is showing numerous duplicate URL errors, but the URLs appear to be unique. I see that the majority of the URL's are the same, but shouldn't the different brands make them unique to one another? http://www.sierratradingpost.com/clearance~1/clothing~d~5/tech-couture~b~33328/ http://www.sierratradingpost.com/clearance~1/clothing~d~5/zobha~b~3072/ Any ideas as to why these would be shown as duplicate URL errors?
On-Page Optimization | | STP_SEO0 -
Redirecting URLS on windows
Could anyone help out here please. A client of ours have reveloped their website from HTML to ASP (helpful!). They have 60 odd pages indexed in Google with the .html extension. We need to do a redirect on these pages so that all link juice is passed to the new pages. What would be the best way to do this please?
On-Page Optimization | | Grumpy_Carl0 -
Does concatenating two words make them lose their SEO value
I'm working with a client whose product titles are things like "InternetSecurity" and for branding purposes has thus far required any reference to the products be concatenated in this fashion (on page, links, URL, title tags). It seems to me that would greatly reduce their SEO relevance. Any thoughts? Thanks, Mark
On-Page Optimization | | DenverKelly0 -
301 redirects / clean urls (2)
hello again! 1st i want to thank robert, istvan and everyone else for the great answers to my last question. i guess i should have been a bit more specific with the questionas i am still a bit unclear about a couple of things. i forgot to mention that we actually moved the site several months back and redirected all the "category" pages, but, i wasnt aware that the "product" pages were never redirecte! so my next questions are: at this point is it even worth redirecting those old product pages? if so, should we use the IP address as shown below or the domain as shown below ...i am guessing at the IP address. http://72.3.181.97/catalog/CanineCushionDogCouchBeds.aspx
On-Page Optimization | | k9byron
http://www.k9electronics.com/catalog/CanineCushionDogCouchBeds.aspx also, our old site was never deleted from the server. our ranking / sales dropped off by about 50% when the new site went live so im guessing this can be directly contributed to the products not being redirected / duplicate content from the 2 sites? im also guessing i need to find a new developer ..can i get a vote on that? 😉 <colgroup><col width="856"></colgroup>
| http://72.3.181.97/catalog/CanineCushionDogCouchBeds.aspx |0 -
Using magentos own url re-writes
We are changing ecommerce platforms. Is it best to use magentos own url re-writes to redirect every page of a site from its old url to it new one?
On-Page Optimization | | LadyApollo0 -
Keywords in URL:
what kind of URL should we use? www.keyword.net/keyword-city or www.keyword.net/city which URL you would prefer?
On-Page Optimization | | alibeef0