Long Url but makes no sense
-
Hi Just joined.
Crawl states that I am getting a lot of errors, looks like the spider is getting confused and looping back on itself ?
Is there a way to see where the crawl was formulated (ie where from) ?
It is generating urls like:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/auction/auction/auction/auction/auction/auction/Default.aspx from http://www.wickman.net.au/wineauction/wine_auction_alert.aspx
-
Welcome! We're happy to have you here, and glad to have helped you solve your problem.
-
Thank you. Thats exactly what I needed. Downloaded the csv and was able to find the referring URLS and track back to the offending page.. Searched my site and voila - silly me put a trailing slash after the file prefix in the sitemap.. must have really messed up the robot.
so I had:
<loc>http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/</loc>
Ooops.. I think I like this SEOMoz place already
-
Did launch a quick crawl on your site, these url were not found (but you have several broken links!). These strange URL usually come from bad robots, and may also come from the interpretation of javascript URL or redirects. GoogleBot gets really confused with them.
If you want to dig, check the servers logs.
-
Hi Martijn,
I did take a look at the source code, did not find that link anywhere, however that page is live:
Not sure if its a dynamically created or a static one...
Mark:
take a look at your physical directories on your server using your favorite FTP software, see if you can follow the same navigation and see if you have these folders and file
-
Hi Igor,
If you have a look at the page the URL is not found on this page.
-
Hi Mark,
What I would recommend, is open this page in your browser:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx
Then view the source page and try to search for the url:
http://www.wickman.net.au/wineauction/wine_auction_alert.aspx/auction/auction/auction/auction/auction/auction/Default.aspx
Are you using a CMS or ecommerce platform for your site like wordpress or x-cart? If so it might be something wrong with the configuration which produces the pages and links automatically
-
Hi Mark,
Within you Crawl Diagnostics you're able to export your data to CSV (on the topright side of the overview). By doing this you can find the links to the page you think is incorrect.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
To avoid the duplicate content issue I have created new urls for that specific site I am posting to and redirecting that url to the original on my site. Is this the right way to do it?
I am trying to avoid the duplicate content issue by creating new urls and redirecting them to the original url. Is this the proper way of going about it?
On-Page Optimization | | yagobi210 -
What word should I use in my URL for my blog
Should I use the word "blog" in my sub folder as in : http://www.mybusiness.com/blog or should I use http://www.mybusiness.com/news. Is there a difference for when my site is crawled. I understand that a blog works a little differently. Can someone explain the basics?
On-Page Optimization | | graemesanderson0 -
Duplicate content issues - page content and store URLs
Hi, I'm experiencing some heavy duplicate content Crawl errors on Moz with www.redrockdecals.com and therefore I really need some help. It brings up different connections between products and I'm having a hard time figuring out what it means. It is listing the same products as duplicate content but they have different URL endings. For example:http://www.redrockdecals.com/car-graphics/chevrolet-silverado?___store=nl&___from_store=us
On-Page Optimization | | speedbird1229
&
http://www.redrockdecals.com/car-graphics/chevrolet-silverado?___store=d&___from_store=us It seems like Moz considers the copy-pasted parts in the Full Description (scrolled a bit down on product pages) as Duplicate Content. For example the general text found on this page: http://www.redrockdecals.com/caution-tow-limited-turning-radius-decal Or this page: http://www.redrockdecals.com/if-you-don-t-succeed-first-time-then-skydiving-isn-t-for-you-bumper-sticker I am planning to write new and unique descriptions for all products but what do you suggest - should I either remove the long same descriptions or just shorten them perhaps so they don't outweigh the short but unique descriptions above? I've heard search engines understand that some parts of the page can be same on other pages but I wonder if in my case this has gone too deep... Thanks so much!0 -
The value of changing URL structure
Dear Moz members, There have been many questions on this forum on this topic but I cannot find one that completely answers my question. We launched our new website about 7 months ago and the website contains around 3.000 product pages. The average page authority of the product pages is quite still quite low (12). The URL structure is built like this: www.website.com/catalog/ID/productname/ (with right keywords in the product name). So e.g the current URL is Our competitors rank higher on certain keywords while page authority (and DA) are significantly lower. Their URL structure is set up like this: www.website.com/productname/. Our most import keyword is "grafmonumenten" and the link we would like to rank on is: https://www.denhollandsche.nl/grafmonumenten/ My question now is:
On-Page Optimization | | stepsstones
1: how important is the length/depth of the URL structure?
2: is it beneficial for us to change the structure (www.website.com/productname/) use permanent redirects? My expierence is that changing the 'page url' can cause a short term drop in the serps, but can have positive effects on the longer term. Thanks for helping me out!0 -
Mixing hyphens and underscores in a url
Hello. I am working on a site that was built with underscores in the urls, but only in the page names, not in the subdirectories. All the subdirectories have one-word names. So a typical url is "example.com/sub1/sub2/page_name." We would like to change the name of one of the subdirectories to a name that would be very useful for SEO, but this new name is a hyphenated word, let's call it "new-sub." If we changed "sub2" to "new-sub" then our url would have a mix of underscores and hyphens: example.com/sub1/new-sub/page_name. But if I used "new_sub" instead, google would read the words as connected with an underscore, instead of reading the subdirectory as a hyphenated word, which would be less useful for SEO. It seems like it might be a problem to have a hyphen in a subdirectory and underscores in the page names. But I want the SEO value of the hyphenated word. Any recommendations? Thank you!
On-Page Optimization | | nyc-seo0 -
How do I PERMANENTLY change an incorrect URL link with one of my keywords?
Hello, I received an “F” grade on my on-page report for one of my keywords. I noticed that the URL linked with that keyword was wrong. After changing it to the correct URL, I received an “A.” However, the change was not permanent. How do I permanently change the URL? I don’t see any “Save Changes” or “Apply Changes” button anywhere. Thank you!
On-Page Optimization | | jampaper0 -
Keyword Placement in Page Title - will changing it make a big difference?
Hiya guys I've noticed since changing my Title of my forum from: Talk Nightlife | Nightlife and Clubbing forum for the UK to Talk Nightlife | Nightlife Forum and Clubbing Guide for the UK (current) ... That its jumped from 22nd to 10th in google for term "nightlife forum" Am wondering, because of the on site optimisation tool telling me I should put the keyword to the front to something like eg: Nightlife Forum | Talk Nightlife Clubbing Guide for the UK Will changing the Keyword and putting it to front of the Title make a big difference? Your thoughts please guys Cheers Luke
On-Page Optimization | | Lukescotty0 -
URL Strucutre
Hi there, Need some advice please on URL structure. I have been doing SEO for quite sometime now, however one thing that always get me is URL structure. I have a decision to make, its either: URL 1 /conditions/allergies/food/ URL 2 /conditions/allergies-food/ Lets say i am optimizing for the key-phase "Food Allergies" what do you think is best practice? I know that this is not a major factor in gaining high SERPs & maybe i'm thinking about it too much, however your input would be really helpful. Kind Regards,
On-Page Optimization | | Paul780