Capture all browser HTTP[s] calls to load a web page

How does one find out what network calls, browser requests to load web pages? The simple method - download the HTML page, parse the page, find out all the network calls using web parsers like beautifulsoup. The shortcoming in the method, what about the network calls made by your browser before requesting the web page? For example, firefox makes a call to ocsp.digicert.com to obtain revocation status on digital certificates. The protocol is Online Certificate Status Protocol. [Read More]
python  proxy  HTTP 

Setting up privoxy proxy server for browsing

I wanted to setup proxy server for browsing. Tried http://www.squid-cache.org/ felt cumbersome to configure though it has advanced features. Finally decided to setup http://www.privoxy.org/. I assume you have personal server where all the requests are forwarded. Installation __ Server Config__ sudo apt-get install privoxy sudo vim /etc/privoxy/config look for listen-address and add ip:port listen-address 78.12.204.2:8118 To enable logging for all requests uncomment debug 1(you will need to rotate log file using cronjob). [Read More]