I route all of my non-work related home internet connectivity via an external jurisdiction (pfSense, openVPN and VPS based) which is great, however Amazon Video and Netflix traffic is significant and I don’t wish to abuse my “fair use” of the virtual server provider when the traffic is all SSL by default / only associates my connection as a user of Netflix. I use the following domains (pfsense host alias) and netblocks (pfsense net alias) to add custom routes to exclude Netflix traffic from the default route / going over VPN, but you can use the same list to include your traffic to VPN endpoints in other geographic regions.
SLOG of Carl Heaton Posts
Many members of parliament.uk choose to host their websites outside of the UK (or blindly follow their political parties choice of provider), I look at who they are.
As the subject suggests after parsing parliament.uk for a list of all MP websites and twitter accounts, I performed DNS queries against each websites domain…
I needed to get a list of all websites for UK members of parliament and have it update reasonably frequently / ability to repeat.
http://www.parliament.uk/mps-lords-and-offices/mps/ lists all the current members so a simple PHP script was written using http://simplehtmldom.sourceforge.net/ to parse the list of members, fetch each member profile and parse the name, website and twitter handles.
This script in all it’s hackyness may be found below (best run via php-cli to minimise timeout or memory issues) and example output at http://slog.carlheaton.co.uk/list-of-all-uk-members-of-parliament-name-website-twitter-handle/
Parsed contents of http://www.parliament.uk/mps-lords-and-offices/mps/ to CSV for name, website, twitter as of 2016/11/11.
Sometimes you just want to check the performance of a website or asset over a short period of time to get a general idea if it is performing normally. The bash script below simplifies that by calling curl with performance counter output formatting, wait and recursion. Tested on CentOS7 (and Ubuntu 14.0.4).
There are several vbulletin communities to which I am member and long term contributor, where there is a risk these contributions may go offline / be lost as people move on to other things, so I make infrequent private mirrors/copies for this purpose (copyright implications considered) with the following wget cookie method.