Long Url but makes no sense
-
Hi Just joined.
Crawl states that I am getting a lot of errors, looks like the spider is getting confused and looping back on itself ?
Is there a way to see where the crawl was formulated (ie where from) ?
It is generating urls like:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/auction/auction/auction/auction/auction/auction/Default.aspx from http://www.wickman.net.au/wineauction/wine_auction_alert.aspx
-
Welcome! We're happy to have you here, and glad to have helped you solve your problem.
-
Thank you. Thats exactly what I needed. Downloaded the csv and was able to find the referring URLS and track back to the offending page.. Searched my site and voila - silly me put a trailing slash after the file prefix in the sitemap.. must have really messed up the robot.
so I had:
<loc>http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/</loc>
Ooops.. I think I like this SEOMoz place already
-
Did launch a quick crawl on your site, these url were not found (but you have several broken links!). These strange URL usually come from bad robots, and may also come from the interpretation of javascript URL or redirects. GoogleBot gets really confused with them.
If you want to dig, check the servers logs.
-
Hi Martijn,
I did take a look at the source code, did not find that link anywhere, however that page is live:
Not sure if its a dynamically created or a static one...
Mark:
take a look at your physical directories on your server using your favorite FTP software, see if you can follow the same navigation and see if you have these folders and file
-
Hi Igor,
If you have a look at the page the URL is not found on this page.
-
Hi Mark,
What I would recommend, is open this page in your browser:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx
Then view the source page and try to search for the url:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/auction/auction/auction/auction/auction/auction/Default.aspx
Are you using a CMS or ecommerce platform for your site like wordpress or x-cart? If so it might be something wrong with the configuration which produces the pages and links automatically
-
Hi Mark,
Within you Crawl Diagnostics you're able to export your data to CSV (on the topright side of the overview). By doing this you can find the links to the page you think is incorrect.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Wordpress: Why do the URLs of my posts keep changing to match the posts titles?
I'll try to keep this brief. The URLs of my posts keep snapping back to exactly match their post titles, no matter how often I try to change them. e.g. title: How to Tie Your Shoelaces desired URL: tie-shoelaces BUT actual URL: how-to-tie-your-shoelaces Anyone come across/ resolved this issue before?
On-Page Optimization | | GerardAdlum0 -
Will Multiple 301's to the Same URL Cause Issues?
Hey Everyone, We have a client (I don't have permission to disclose) that has just attempted to create better URL's for their site, per our direction. In the process, their website platform kind of took over their renaming attempts and instead of creating the clean, short, descriptive URLs we all wanted, they got convoluted, longer URLs. This all happened within the past 3 or 4 days. So, they went out and got an add-on that's going to help them create better URL's. In the meantime, they now have the original page/URL plus two new ones for a total of three. No 301's have been setup yet. When they create the new and (hopefully) improved URL tomorrow, will it hurt their rankings to have three pages redirected to the new one? Is a 301 redirect the right method for this issue or should they do something different? Thanks in advance, Kirk
On-Page Optimization | | kbates0 -
Duplicate URL's in Sitemap? Is that a problem?
I submitted a sitemap to on Search Console - but noticed that there are duplicate URLs, is that a problem for Google?
On-Page Optimization | | Luciana_BAH0 -
can we include iframe content if we properly reference the source in the url?
can we safely include iframe content if we properly source the source url. eg we have a travel company we are looking to produce another website, but use the same hotel descriptions in the hotel directory. can we do this?
On-Page Optimization | | Direct_Ram0 -
Changing a page url
I have a page that ranks well (#4) for a good keyword. However, the url has the keyword in it but is misspelled. I would like to change the url to have the correct spelling but do not want to lose the ranking that I have. What is the best and safest way to proceed?
On-Page Optimization | | bhsiao0 -
Wordpress category url problem.
I have set up wordpress categories but the permalinks are showing as www.mydomain.com/?cat=12 as opposed to the category name. The child categories though work fine and show as www.mydomain.com/category/chidcatgegory I've obviously got my permalink settings wrong somewhere. How do I fix this?
On-Page Optimization | | SamCUK0 -
Is it still worth changing a url with half the pages target keyphrase in to the entire phrase still ?
Hi If a pages url has half the pages target keyphrase (i.e. 1 word instead of 2) is it still worth changing to include entire keyphrase (2 words) given need to then add 301 redirects etc after ? If it was a new page then I would definately include full keyphrase but the page is a few months old and has quite high page authority as is (i know a 301 should transfer most authority) but given this page and other sub pages would also need to be 301'd if this change occurs and the dev time/cost that would incurred/charged by the design/dev agency. Also thinking Google being cleverer now (the pages content will be about the target kw) so thinking G would work it out from rest of page content and partial match kw in url. In other words to best target keyphrase is it best to leave url as is or change url to include keyphrase ? For example if the pages target kw is 'swimming clubs' and the current url is www.franksleisurecentres.com/clubs changing it to www.franksleisurecentres.com/swimming-clubs :Thanks Dan
On-Page Optimization | | Dan-Lawrence0 -
New bookingsengine url, what would you do?
A client of mine is introducing a new and improved bookingsengine. They're launching it on a different url than the existing one. The existing one needs to stay online a little bit longer for affiliate purposes. The old engine url has a sitelink in the SERPS and ranks well on a few terms. I'm wondering what you would do in this case? They want the new url to rank as quickly as possible also as sitelink of course. Any help greatly appreciated. I have some thoughts of my own of course... 🙂 But to keep the discussion as wide as possible... I'll wait a bit to add m thoughts.
On-Page Optimization | | YannickVeys0