How can I capture data send to a webserver/website? - http

What is an easy way to capture data send to a webserver?
I want to get the code, which gets send when I give someone reputation on a forum...

Try Fiddler. It acts as a system-wide proxy and captures all http requests and provides a way to inspect them.

If the data is sent using a browser.
You can monitor the traffic using Firebug in firefox or Developer Console in Chrome.

Related

Tool for monitoring network request (not packets) on mac os

Firebug has output like what I need but I have to monitor a little server and not a web page load. I tried Wireshark but the output is not very useful since wading through all the packets to put a request together is very time consuming and complicated. I would like to quickly see all the request sent and received. So I would like a tool that has output like Firebug but can monitor request sent from any application like Wireshark. Any ideas? Thanks
I am using fiddler, really useful tool for web developer :)
http://www.fiddler2.com/fiddler2/

Is there a way to discover the specific HTTP requests my browser sends while I navigate?

The question is pretty straightforward. I want to know if there are ways of discovering the HTTP requests my browser sends while I navigate. For instance, what happens when I click on a certain link which sends a PUT method? I mean, I wish I could determine the exact HTTP request that my browser sends to that website. Further, I want to, later, reproduce that request on Curl. Basically, I want to inspect requests my browser sends so I can automate that task later through the Curl command (command, not library).
Thanks in advance!
Fernando.
Fiddler does exactly what you want. It sets up a proxy that can monitor http communication from your browser.
http://www.fiddler2.com/fiddler2/
You would want the Firebug extesion for Firefox. It can show a lot of what is happening, and you can add more options by installing more extensions.
On the other hand, you can use wireshark to capture the traffic to and from your computer.
Then you can use filters to save the relevant packets (pcap is often the format for storing the packets).
Later, you can replay the packets using tools like tcpreplay.
You could try it out with backtrack linux (live cd/usb).
And nowadays there should be some new tools for windows also. :)
EO2 and JohnnyC are correct. Fiddler, WireShark, FireBug (FireFox addon), etc. are what you are going to look for. You can use them free of charge.
WireShark will capture all incoming and outgoing traffic on your box. You can listen on any port, filter data etc.
FireBug will capture outgoing and incoming data streams, the raw data (XML, JSON, images etc.) for each request.
Fiddler is great for tracking web data in a seperate application if you do not use FireFox.

How to debug the http response headers from a HTTP call

I've installed FireBug, but I am not sure how to find out if a certain http header is present in my HTTP response. Where should I look for this information?
Use the Net tab in Firebug to monitor network traffic. There you can see the complete headers as well as the timing and content of any network/HTTP queries.
Looks like this:
Fiddler is the best tool I know of to do this and much more, including inspecting the entire request/response in many formats including a nice XML browser.
Fiddler in good but sometimes it causes problems because of changing the system proxy configuration.
Check the HTTP Debugger, it's not a proxy and doesn't create such problems
https://www.httpdebugger.com

Sniff HTTP packets for GET and POST requests from an application

I am coding an SEO tool in C# for doing keyword research. I need to make calls to Google Adword keyword tool. Now I know some tools which are doing the same already.
I just need to decipher what they are doing. I tried using Wireshark but it's very complex to get the actual POST data using Wireshark.
I tried using fiddler on IE but seems like too many Javascript requests are made which confuses fiddler a lot.
If I can just find out the exact requests the other tool is making I think my job is done. How can I do this?
Put http.request.method == "POST" in the display filter of wireshark to only show POST requests. Click on the packet, then expand the Hypertext Transfer Protocol field. The POST data will be right there on top.
You will have to use some sort of network sniffer if you want to get at this sort of data and you're likely to run into the same problem (pulling out the relevant data from the overall network traffic) with those that you do now with Wireshark.

http response message

I want to know that when browser sends a request do the server sends back the contents explicitly? And how would i confirm it?
There are several toolbars in Firefox that show exactly what are coming and going when making an HTTP request.
For firefox i use the following plugins:
Firebug
Web Developer
You could also install a utility called WireShark. It will "sniff" all the network traffic on your computer and show you at a packet level how it all works.
Browser plugins such as firebug (for firefox) let you see exactly what the server is returning; that's quite instructive and recommended! You'll see a bunch of headers followed by the response body in any of several formats (could be chunked, etc, etc).
In a Windows environment you can use Fiddler.
Fiddler includes a fair amount of documentation and is easy to use.

Resources