Extract URL's from a website? - asp.net

I would like to migrate a site, but the new URL's are completely different from the old URL's. I do not want to break my old sites links that are out there on the web. Is there a way to extract all the links from a site so I can generate a redirect table (I will probably put the redirects on the web server level)? The old is on ASP.NET with SQL server 2008 by the way. Am open to crawling the site or mining the SQL database, but need some help or advice.

You could use IIS Seo Optimalization Toolkit for that. http://www.iis.net/download/seotoolkit
With that tool you can spider the entire website. Then when the report finishes, go to Content -> Host summary and double click the host of the website. There you have a complete list of all spedered URL's.
And ofcourse, when you have these url's, you can make URL rewrite of routing mechanisms available to 301 to the right content on the new website.

The best way is to actually put a 301 redirect to notify all engines that your URL's have permanently moved Search for 301 in this http response code documentation for more info on 301. That is if I am understanding your problem (that you want links from other sites and searches and whatnot to realize that your site moved?).

It doesn't sound like you're running Apache. However, Apache has an available module called mod_rewrite. There may be a similar module for other web servers.
mod_rewrite allows you to do exactly what you are describing.

Perhaps with litle js magic if works for you

Related

Redirect page traffic to new urls in asp.net appllication

I have a WordPress site. which is now moving to asp.net cms (Sitefinity). In this process my url structures are getting changed but I want to keep the traffic of previous urls on the new urls as well.
Old as the domain will be transferred to new site old pages will not be found (404)
Things making it complicated.
Old and new site has lots of Dynamic urls
Old site has different urls structure than new url
I do not wan't to put all these urls in web.config file.
Solutions I tried
I tried to write 301 redirect on Robot.txt as I can capture old and new url at the time of migration
I searched for solutions all over net but didn't got any straight forward solutions
One of the forums mentioned that we should not write 301 redirects on Robot.txt
Don't know what to follow or where to search. Please guide me to correct path.
Thank You
Chandresh
If you have an identifiable pattern between the two using the URL rewrite module would be your best bet. Or write some code to insert the old urls as multiple URLs on the content items.
Do you have an example of the old URL and what the new URL will look like? It is possible that if you know how the URL pattern will change you can create a redirect rule in your web.config.
Also, Sitefinity allows you to create redirects as well. This includes creating alternative urls for pages or creating redirecting pages.
The exact solution really depends on how much the URL is changing and how many redirect urls are needed.

SSL and relative URLs in site links and redirections

I have been working on a website in beta phase for some time now, and am finally about to launch it. There are several links, anchor tags, with relative URLs throughout the site that link to the admin and cart sections of the website, and now they have to be SSL secured.
Also, same question for relative URLs in Response.Redirect("~/../..");
When a user is browsing over http, is there anyway to redirect them to a page with https connection using a relative URL? It seems like poor practice to code absolute URLs for links and redirections for the purpose of SSL. If the domain name changes, I have to rewrite them all. Plus, if I want them to work on my localhost, I would have to change them every time I upload to server. There must be some solution.
Switching Between HTTP and HTTPS Automatically is a very good code to use for the implementation of switching logic fast and easy - and not change your existing code.
Similar: Preparing my ASP.NET / MVC site to use SSL?
These helper methods by Rick Strahl will help you
http://www.west-wind.com/weblog/posts/2007/Sep/18/ResolveUrl-without-Page
Pay special attention to ResolveServerUrl.
Depending on what version of IIS you are running, you could always offload this functionality to the webserver. Check out the URL Rewrite module here.

how to convert a asp website to wordpress?

i've a small website(with few of pages-- max 20) on asp running on windows server since last 3 years with a lot of traffic and all the pages are indexed and ranked high by google and other search engines, but now i decided to convert my existing asp website to wordpress on that same domain and host.i'll request the godaddy to change my hosting server from windows to linux, and that i'll install wordpress there and i'll recreate all 20 pages there, but the matter is that i'll lose my all traffic.is there anyway to redirect those asp indexed links to my new wordpress posts?
any kind of help will be appreciated-- Thanks in advance :)
You can use 301 redirect to redirect all your old asp urls to the new wordpress urls using htaccess.
http://ndesign-studio.com/blog/301-htaccess-redirect
You have only 20 pages so it would be easy for you to do it manually i think. Thanks
I found the following plugins to easily manage 301 redirects. Please use any of the one given below.
http://wordpress.org/extend/plugins/redirection/screenshots/
http://wordpress.org/extend/plugins/simple-301-redirects/screenshots/
You just need to put the old asp url without the domain name and the new wordpess url with domain name. Thanks
Keeping the existing SE rankings must be the top priority and for that you have no other option but use 301 redirect.
It's good to know how 301 redirect works; so this article may be useful;
http://www.seochat.com/c/a/Search-Engine-Optimization-Help/WordPress-301-Redirect-Tips-and-Techniques/
Since you will be porting your site into wordpress, it makes a lot of sense to use a known plug in for this particular task.
As always, download a known/rated/trustworthy/uptodate plug in.
Here is one that fits the bill, for you.
http://wordpress.org/extend/plugins/simple-301-redirects/
HTH

Redirect subdomain to subfolder of another subdomain

What I want to do is take traffic that is going to shop.mywebsite.com and redirect or rewrite (I'm not sure of the terminology) the domain to be www.mywebsite.com/shop. Both shop.* and www.* are separate web applications (nopCommerce and Umbraco respectively) that don't seem to cooperate when I've tried to nest them. Both applications are in a Server 2008 R2/IIS 7.5 environment.
I've searched around stackoverflow and what I've found is a lot of answers to mapping the other direction (ie subfolder to a subdomain) but that's not what I'm looking for as far as I understand the problem.
The end goal is to combine the SEO reputation of the shop subdomain into the www subdomain. I readily admit that I might have this all backwards and am willing to try any suggestions I'm offered.
Thanks.
I think you are looking for URL rewriting.
URL rewriting is the process of
intercepting an incoming Web request
and redirecting the request to a
different resource. When performing
URL rewriting, typically the URL being
requested is checked and, based on its
value, the request is redirected to a
different URL
EDIT:
You may also want to check URL Rewrite Extension from microsoft, it will fix common SEO problems that your site might have.

SEO friendly 301 redirect .htm to .aspx

I currently have a small-midsize website with .htm extensions. I have redesigned the full website, this time using a .aspx extension. I want to issue 301 redirects to keep my search engine rankings, but am unsure of how to do so from an .html page in a spider friendly way. With research I have repeatedly encountered references to ISAPI redirects (but no where can I seem to find a full explanation, just a link to isapiredirect.com, which does not load). Other than this I have been advised to run all .htm pages through the asp.net engine and issue a redirect through asp code. I have no idea how to get that done.
I am unfamiliar with asp.NET (the new site was not designed by me), and only with LAMP, which seems far more simply managed with .htaccess.
Thank you so much for any help, time, considerations or suggestions
You can use a .htaccess file if you get a license to the Helicon's ISAPI Rewrite module. It might be a familiar environment for you. But you are right, the home page doesn't load.
http://www.seoconsultants.com/windows/isapi/
Here's a link to some information about the product. It does work, it's a good product. I'm not sure I'd recommend ordering it while the vendor's site is down though.
EDIT
The vendor site is back up and here: http://www.helicontech.com/isapi_rewrite/

Resources