Fiddler V2x beta bug and web crowler

Fiddler V2x beta bug and web crowler


Well, fiddler is very nice tool to monitor outgoing request from your IE or AspNet development server to any third party web.

Fiddler is good tool to analyse the request going through IE. After monitoring the requests parameters posted to any web
one can write a program to crowl that web.  best way use C#.net for programming crowler.

You can download Fiddler from here
http://www.fiddler2.com/Fiddler2/version.asp

Latest Fiddler beta version 2.x for .net framework has bug

After 25000 to 50000 request fiddler throws MemoryExceptions. I tested it with 1GB and 2Gb ram on windows XP
with .net Framework 2.0 with latest service pack.

If you are looking for writting web crowler using .Net technology, you can refer http://www.revenmerchantservices.com/category/HttpWebRequest.aspx

and use System.Net.HttpWebRequest or WebCleint and NameValueCollection.


Satalaj

Tags:

httpwebrequest web proxyMembership ProviderAndroid WebView ExampleHttpWebRequest Post methodlive web trafficHow to use HttpWebRequest and HttpWebResponse.how to open a blog websiteWeb Hosting ProvidersHttpWebRequest and yahooAsp.net WebSite PerformanceWhat is web garden in Asp.net?

Author

My name is Satalaj, but people call me Sat. Here is my homepage: . I live in Pune, PN and work as a Software Engineer. I'm former MVP in ASP.net year 2010.
Disclaimer: Views or opinion expressed here are my personal research and it has nothing to do with my employer. You are free to use the code, ideas/hints in your projects. However, you should not copy and paste my original content to other web sites. Feel free to copy or extend the code.
If you want to fight with me, this website is not for you.
 

I'm Satalaj.